-- Logs begin at Thu 2022-10-27 12:46:37 UTC, end at Thu 2022-10-27 13:37:17 UTC. -- Oct 27 13:10:58.986349 dv-cinder-862432-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 27 13:10:58.999040 dv-cinder-862432-3-smb devstack@keystone.service[81469]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 27 13:10:59.001450 dv-cinder-862432-3-smb devstack@keystone.service[81469]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 27 13:10:58 2022] *** Oct 27 13:10:59.001450 dv-cinder-862432-3-smb devstack@keystone.service[81469]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 27 13:10:59.001450 dv-cinder-862432-3-smb devstack@keystone.service[81469]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 27 13:10:59.001450 dv-cinder-862432-3-smb devstack@keystone.service[81469]: nodename: dv-cinder-862432-3-smb Oct 27 13:10:59.001450 dv-cinder-862432-3-smb devstack@keystone.service[81469]: machine: x86_64 Oct 27 13:10:59.001450 dv-cinder-862432-3-smb devstack@keystone.service[81469]: clock source: unix Oct 27 13:10:59.001450 dv-cinder-862432-3-smb devstack@keystone.service[81469]: pcre jit disabled Oct 27 13:10:59.001450 dv-cinder-862432-3-smb devstack@keystone.service[81469]: detected number of CPU cores: 4 Oct 27 13:10:59.001450 dv-cinder-862432-3-smb devstack@keystone.service[81469]: current working directory: / Oct 27 13:10:59.001450 dv-cinder-862432-3-smb devstack@keystone.service[81469]: detected binary path: /usr/bin/uwsgi-core Oct 27 13:10:59.002082 dv-cinder-862432-3-smb devstack@keystone.service[81469]: your processes number limit is 47680 Oct 27 13:10:59.002082 dv-cinder-862432-3-smb devstack@keystone.service[81469]: your memory page size is 4096 bytes Oct 27 13:10:59.002082 dv-cinder-862432-3-smb devstack@keystone.service[81469]: detected max file descriptor number: 2048 Oct 27 13:10:59.002082 dv-cinder-862432-3-smb devstack@keystone.service[81469]: lock engine: pthread robust mutexes Oct 27 13:10:59.002082 dv-cinder-862432-3-smb devstack@keystone.service[81469]: thunder lock: enabled Oct 27 13:10:59.002082 dv-cinder-862432-3-smb devstack@keystone.service[81469]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 27 13:10:59.002082 dv-cinder-862432-3-smb devstack@keystone.service[81469]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 27 13:10:59.042615 dv-cinder-862432-3-smb devstack@keystone.service[81469]: Python main interpreter initialized at 0x5608844799c0 Oct 27 13:10:59.042615 dv-cinder-862432-3-smb devstack@keystone.service[81469]: python threads support enabled Oct 27 13:10:59.042615 dv-cinder-862432-3-smb devstack@keystone.service[81469]: your server socket listen backlog is limited to 100 connections Oct 27 13:10:59.042615 dv-cinder-862432-3-smb devstack@keystone.service[81469]: your mercy for graceful operations on workers is 90 seconds Oct 27 13:10:59.042960 dv-cinder-862432-3-smb devstack@keystone.service[81469]: mapped 403077 bytes (393 KB) for 2 cores Oct 27 13:10:59.043039 dv-cinder-862432-3-smb devstack@keystone.service[81469]: *** Operational MODE: preforking *** Oct 27 13:10:59.043301 dv-cinder-862432-3-smb devstack@keystone.service[81469]: *** uWSGI is running in multiple interpreter mode *** Oct 27 13:10:59.043301 dv-cinder-862432-3-smb devstack@keystone.service[81469]: spawned uWSGI master process (pid: 81469) Oct 27 13:10:59.043509 dv-cinder-862432-3-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 27 13:10:59.044538 dv-cinder-862432-3-smb devstack@keystone.service[81469]: spawned uWSGI worker 1 (pid: 81481, cores: 1) Oct 27 13:10:59.044538 dv-cinder-862432-3-smb devstack@keystone.service[81469]: spawned uWSGI worker 2 (pid: 81482, cores: 1) Oct 27 13:10:59.044538 dv-cinder-862432-3-smb devstack@keystone.service[81469]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 27 13:11:03.345042 dv-cinder-862432-3-smb devstack@keystone.service[81482]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 13:11:03.345042 dv-cinder-862432-3-smb devstack@keystone.service[81482]: from cryptography.utils import int_from_bytes Oct 27 13:11:03.346002 dv-cinder-862432-3-smb devstack@keystone.service[81482]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 13:11:03.346002 dv-cinder-862432-3-smb devstack@keystone.service[81482]: from cryptography.utils import int_from_bytes Oct 27 13:11:03.347781 dv-cinder-862432-3-smb devstack@keystone.service[81481]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 13:11:03.347781 dv-cinder-862432-3-smb devstack@keystone.service[81481]: from cryptography.utils import int_from_bytes Oct 27 13:11:03.348264 dv-cinder-862432-3-smb devstack@keystone.service[81481]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 13:11:03.348264 dv-cinder-862432-3-smb devstack@keystone.service[81481]: from cryptography.utils import int_from_bytes Oct 27 13:11:03.394633 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 13:11:03.394822 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 13:11:03.394990 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] command line args: [] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 13:11:03.395262 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 13:11:03.395391 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ================================================================================ {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 13:11:03.395672 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] admin_token = **** {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.395897 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 13:11:03.396036 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] config_dir = [] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.396036 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.396164 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 13:11:03.396229 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] config_source = [] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.396286 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] command line args: [] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 13:11:03.396414 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] debug = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.396551 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 13:11:03.396636 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.396873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ================================================================================ {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 13:11:03.397004 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.397176 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] admin_token = **** {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.397306 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.397429 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.397519 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] config_dir = [] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.397664 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.397755 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.397911 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] list_limit = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.398019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] config_source = [] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.398093 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] log_config_append = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.398159 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] debug = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.398217 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.398285 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.398371 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] log_dir = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.398518 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.398636 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] log_file = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.398702 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.398766 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.398944 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.399031 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.399189 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.399321 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.399398 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] list_limit = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.399457 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.399600 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] log_config_append = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.399747 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.399836 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.399906 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.399967 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] log_dir = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.400033 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.400092 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] log_file = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.400267 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.400375 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.400443 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.400600 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.400755 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.400831 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.400891 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.401024 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.401112 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.401181 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.401327 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.401417 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.401582 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.401683 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.401859 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.401937 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.402100 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.402332 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.402417 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.52/identity {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.402496 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] publish_errors = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.402569 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.402712 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.402788 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.402946 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.403039 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.403117 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.403253 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.403382 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.403529 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.403651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.403785 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] standard_threads = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.404011 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.404102 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.52/identity {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.404178 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] publish_errors = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.404312 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.404408 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.404488 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.404557 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] use_journal = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.404671 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.404750 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] use_json = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.404829 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.404900 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] use_stderr = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.405000 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.405081 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] use_syslog = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.405244 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.405331 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.405455 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] standard_threads = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.405543 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.405703 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.405798 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.405943 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.406030 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.406111 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.406181 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.406281 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] use_journal = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.406437 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.406518 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] use_json = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.406618 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] use_stderr = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.406706 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.406779 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] use_syslog = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.406905 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.406987 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:11:03.407139 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.407228 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.407380 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.407462 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.407625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.407705 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.407871 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.407951 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.408097 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.408179 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.408342 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.408429 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.408574 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.408655 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.408815 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.408896 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.409056 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.409137 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.409284 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.409365 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.409567 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.409746 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.409819 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.409888 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.410017 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.410094 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.410244 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.410331 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.410494 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.410581 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.410737 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.410817 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.410964 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.411037 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.411211 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.411290 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.411439 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.411538 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.411675 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.411755 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.411877 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.411954 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.412105 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.412189 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.412492 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.412611 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.412745 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.412954 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.413038 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.413190 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.413266 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.413434 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.413511 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.413701 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.413781 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.413935 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.414014 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.414178 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.414254 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.414405 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.414480 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.414636 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.414714 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.414865 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.414941 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.415091 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.415167 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.415318 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.415396 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.415542 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.415625 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.415767 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.415843 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.415997 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.416081 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.416242 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.416318 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.416469 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.416545 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.416689 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.416768 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.416911 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.416994 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.417145 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.417222 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.417373 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.417450 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.417629 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.417710 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.417854 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.417929 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.418087 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.418172 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.418317 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.418393 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.418546 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.418623 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.418777 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.418854 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.419005 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.419080 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.419230 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.419306 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.419473 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.419557 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.419701 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.419814 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.419931 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.420040 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.420144 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.420247 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.420381 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.420486 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.420611 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.420721 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.420825 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.420903 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.421055 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.421136 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.421285 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.421377 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.421522 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.421673 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.421782 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.421901 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.422014 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.422101 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.422264 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.422348 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.422496 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.422574 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.422726 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.422812 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.422955 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.423043 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.423190 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.423268 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.423422 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.423498 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.423653 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.423737 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.423890 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.423984 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.424122 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.424201 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.424365 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.424454 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.424598 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.424713 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.424826 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.424902 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.425059 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.425144 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.425289 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.425369 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.425516 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.425620 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.425780 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.425872 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.426019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.426098 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.426261 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.426337 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.426495 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.426581 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.426727 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.426803 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.426959 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.427035 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.427194 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.427280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.427422 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.427504 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.427653 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.427731 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.427903 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.428083 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.428160 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.428290 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.428500 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.428578 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.428740 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.428827 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.428971 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.429049 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.429208 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.429286 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.429439 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.429516 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.429703 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.429785 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.429935 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.430012 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.430156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.430235 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.430384 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.430463 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.430620 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.430710 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.430854 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.430932 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] auth.external = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.431085 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.431170 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.431320 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.431404 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.431570 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.431674 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.431806 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.431886 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] auth.password = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.432030 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] auth.token = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.432115 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.432264 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.432349 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.432495 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.432573 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.432736 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.432816 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] auth.external = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.432961 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.433043 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.433507 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.433660 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.433779 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.433860 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.434006 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.434084 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] auth.password = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.434237 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] credential.caching = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.434315 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] auth.token = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.434477 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.434556 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.434713 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.434791 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.434954 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.435031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.435183 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.435262 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.435420 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.435497 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.435649 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.435728 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.435881 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.435959 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.436115 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] credential.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.436194 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.436346 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.436424 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.436595 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.436675 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.436852 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.436931 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.437094 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.437172 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.437337 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.437417 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.437595 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.437679 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.437845 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.437923 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.438076 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] federation.caching = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.438156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.438310 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.438388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.438551 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.438630 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.438793 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.438873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.439019 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.439096 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.439260 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.439346 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.439492 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.439571 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.439742 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.439820 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.439974 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.440064 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] federation.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.440223 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.440302 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.440454 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.440532 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.440695 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.440781 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.440926 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.441009 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity.caching = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.441168 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.441245 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.441405 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.441490 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.441657 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.441770 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.441893 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.442012 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.442136 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.442293 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.442370 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.442493 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.442572 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.442743 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.442821 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.442979 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.443059 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.443226 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.443304 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.443542 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.443620 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.443904 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.443983 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.444151 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.444338 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.444416 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.444596 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.444682 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.444834 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.444921 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.445075 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.445155 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.445329 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.445416 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.445583 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.445666 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.445818 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.445897 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.446044 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.446135 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.446274 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.446351 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.446497 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.446574 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.446726 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.446812 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.446964 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.447042 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.447204 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.447281 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.447445 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.447534 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.447671 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.447749 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.447913 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.447991 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.448156 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.448245 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.448384 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.448461 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.448622 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.448699 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.448853 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.448938 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.449075 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.449158 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.449306 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.449385 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.449544 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.449627 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.449783 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.449861 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.450017 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.450095 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.450255 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.450335 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.450487 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.450565 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.450721 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.450829 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.450968 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.451079 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.451213 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.451324 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.451444 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.451554 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.451682 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.451783 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.451915 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.452028 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.452152 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.452274 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.452388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.452506 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.452629 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.452738 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.452865 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.452971 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.453119 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.453200 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.453350 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.453428 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.453630 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.453713 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.453866 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.453947 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.454096 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.454174 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.454344 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.454424 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.454590 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.454708 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.454820 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.454930 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.455052 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.455127 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.455267 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.455379 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.455498 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.455615 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.455730 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.455858 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.455945 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.456122 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.456200 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.456356 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.456434 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.456606 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.456692 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.456860 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.456938 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.457108 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.457186 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.457329 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.457415 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.457578 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.457658 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.457817 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.457894 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.458047 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.458135 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.458279 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.458357 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.458508 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.458585 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.458747 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.458832 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.458990 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.459068 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.459258 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.459338 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.459517 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.459712 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.459797 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.459967 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.460044 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.460198 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.460276 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.460428 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.460508 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.460659 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.460738 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.460901 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.460979 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.461137 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.461220 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.461363 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.461441 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.461620 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.461702 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.461859 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] resource.caching = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.461939 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.462105 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.462187 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.462348 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.462427 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.462580 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.462661 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.462826 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.462903 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.463066 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.463151 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.463295 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.463373 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.463534 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.463611 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.463763 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.463840 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.463995 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.464076 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.464225 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] role.caching = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.464303 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.464461 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.464547 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] role.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.464683 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.464762 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] resource.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.464925 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.465004 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.465168 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.465321 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.465397 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.465467 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.465662 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.465753 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.465906 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.466000 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.466148 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.466226 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.466378 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.466493 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.466618 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.466706 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.466845 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.466923 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.467085 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] role.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.467162 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.467330 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.467416 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] role.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.467561 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.467639 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.467799 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.467875 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.468046 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.468183 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.468296 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.468415 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.468545 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.468659 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.468793 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.468905 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.469042 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.469147 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.469290 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.469390 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.469552 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.469647 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.469794 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.469878 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.470048 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.470126 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.470296 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.470383 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.470542 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.470619 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.470770 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.470848 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.470994 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.471167 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.471246 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.471409 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.471487 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.471662 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.471749 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.471913 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.471997 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.472143 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.472220 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.472368 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.472454 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.472599 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] token.caching = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.472677 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.472830 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.472908 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.473074 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.473163 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.473306 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.473384 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.473568 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.473650 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.473810 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.473900 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.474042 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.474120 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.474280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.474359 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.474518 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.474605 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.474816 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.474961 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.475070 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.475211 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.475297 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.475492 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.475629 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.475734 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.475874 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.476002 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.476116 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] token.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.476229 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.476360 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.476470 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.476613 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.476732 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.476853 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.476991 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.connection = **** {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.477112 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.477239 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.477363 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.477480 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.477613 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.477741 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.477851 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.477966 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.478099 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.478178 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.478352 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.478430 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.478594 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.478674 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.478836 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.478914 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.479073 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.479151 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.479305 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.479384 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.479546 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.479625 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.479776 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.479855 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.480020 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.480108 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.480253 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.480334 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.480493 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.480578 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.connection = **** {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.480721 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.480799 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.480956 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.481036 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.481186 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.481264 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.481356 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 13:11:03.481488 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.481755 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.481996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.482235 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.482473 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.482722 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.482962 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.483210 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.483448 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.483697 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.483935 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.484183 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.484416 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.484658 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.484896 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:11:03.485066 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 13:11:03.510672 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.510930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.511129 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.514143 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.514375 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.514600 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.519516 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.523423 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.547389 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.547596 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.549697 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.549934 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.600543 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.601718 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.648427 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.648629 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.649704 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.649943 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.805254 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.805487 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.805639 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.805712 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.805874 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.805960 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.806103 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.806188 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.806303 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.806392 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.806528 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.806767 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.829408 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.829672 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.829823 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.829917 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.829999 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.830060 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.830244 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.830371 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.830453 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.830559 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.830636 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.830698 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.830832 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.831074 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.841859 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.843044 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.854581 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.854714 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.854919 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.855128 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.855337 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.855467 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.855549 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.855624 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.855745 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.855835 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.855994 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.856206 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.856424 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.856619 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:11:03.872547 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.872757 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 27 13:11:03.872881 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.873089 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.873214 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 27 13:11:03.873319 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 27 13:11:03.873398 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.873514 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.873671 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 27 13:11:03.873829 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.873973 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.874057 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.874165 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.874328 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.874452 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.874692 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.883801 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.884080 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.884347 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.884471 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.884635 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.884779 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.885024 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.885309 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.891490 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:11:03.892232 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:11:03.894351 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:11:03.894635 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.894916 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.895134 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:11:03.895226 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.895353 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.895451 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.895648 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.895740 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.895938 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.896064 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.896239 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.896373 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.896512 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.896702 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.896831 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.896967 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.897097 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.897299 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.897714 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.897999 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.898281 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.919228 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.920653 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:11:03.920904 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.921037 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.922436 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:11:03.922723 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.925477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:11:03.925784 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.926070 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.927331 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:11:03.927621 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.927987 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.932334 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:11:03.932618 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.934862 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:11:03.935149 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.938544 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:11:03.938849 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.939139 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.939423 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.939698 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.939976 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.940245 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.940510 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.940754 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:11:03.941050 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.941328 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.941645 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.941938 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.942210 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.942501 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.942784 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.955877 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.956160 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.958553 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.958834 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.960063 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:11:03.963017 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:11:03.963254 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.963544 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.966208 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.966507 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.967690 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:11:03.970695 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:11:03.970820 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:11:03.973829 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:11:03.973954 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.974202 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.974524 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.974862 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.975225 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.975497 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.977322 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.977652 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.977954 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.978253 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.978545 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.978832 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.990994 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:11:03.991257 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.991527 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.991801 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.994770 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:11:03.995058 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.995331 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.995595 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:03.998526 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.000031 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.001579 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.001817 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.002399 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.003905 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.004425 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:11:04.004729 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.005003 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.005281 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.005404 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.005667 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.005844 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.008644 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:11:04.008935 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.009226 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.009514 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.009935 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.016551 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:11:04.016838 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.017117 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.017399 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.017799 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.018077 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.018354 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.020920 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:11:04.021210 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.021493 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.022035 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.022431 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.022719 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.022997 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.033383 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:11:04.036228 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:11:04.038471 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:11:04.039178 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.040652 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.041346 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:11:04.042127 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:11:04.042414 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.042814 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.044227 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.045657 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.047207 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:11:04.047515 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.047926 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.049009 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.050485 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:11:04.053346 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.053925 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.054215 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.054495 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.054618 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.056043 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:11:04.059243 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.059645 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.059933 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.060217 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.062469 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:11:04.062758 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.063035 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.067938 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:11:04.068235 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.068672 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.069882 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:11:04.070169 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.070446 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.070723 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.070997 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.071294 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.071548 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.071823 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.072095 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.072363 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.072633 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.072943 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.073210 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.073467 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.075611 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:11:04.075916 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.076200 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.076482 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.076754 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.077048 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.077340 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.077649 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.077923 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.078177 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.078455 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.078730 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.079051 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.079339 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:11:04.107056 dv-cinder-862432-3-smb devstack@keystone.service[81482]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5608844799c0 pid: 81482 (default app) Oct 27 13:11:04.110332 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29308c08-4751-4253-b942-90bf2f7b9a5f None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:04.110613 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29308c08-4751-4253-b942-90bf2f7b9a5f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:04.110884 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29308c08-4751-4253-b942-90bf2f7b9a5f None None] PATH_INFO: `/v3` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:04.113388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5608844799c0 pid: 81481 (default app) Oct 27 13:11:04.115103 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 791 bytes} [Thu Oct 27 13:11:04 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:10.921957 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b48a07-93a7-4705-889b-0cf342f16c8e None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:10.922755 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b48a07-93a7-4705-889b-0cf342f16c8e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:10.922896 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b48a07-93a7-4705-889b-0cf342f16c8e None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:10.930156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1/2] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:11:10 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:11:10.936075 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6908d-393d-4dee-8173-8ab7b0c8d57f None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:10.936525 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6908d-393d-4dee-8173-8ab7b0c8d57f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:10.936663 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6908d-393d-4dee-8173-8ab7b0c8d57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:11.006743 dv-cinder-862432-3-smb devstack@keystone.service[81482]: INFO dbcounter [None req-4da6908d-393d-4dee-8173-8ab7b0c8d57f None None] Registered counter for database keystone Oct 27 13:11:11.027855 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG oslo_db.sqlalchemy.engines [None req-4da6908d-393d-4dee-8173-8ab7b0c8d57f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 13:11:11.035945 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writer thread running {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 13:11:11.217566 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG passlib.handlers.bcrypt [None req-4da6908d-393d-4dee-8173-8ab7b0c8d57f None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81482) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 27 13:11:11.218042 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG passlib.handlers.bcrypt [None req-4da6908d-393d-4dee-8173-8ab7b0c8d57f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81482) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 27 13:11:11.277102 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-4da6908d-393d-4dee-8173-8ab7b0c8d57f None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:11:11.278735 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-4da6908d-393d-4dee-8173-8ab7b0c8d57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:11:11.415963 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 2/3] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:11:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 481 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 27 13:11:11.881511 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b48a07-93a7-4705-889b-0cf342f16c8e None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:11.963280 dv-cinder-862432-3-smb devstack@keystone.service[81481]: INFO dbcounter [None req-d6b48a07-93a7-4705-889b-0cf342f16c8e None None] Registered counter for database keystone Oct 27 13:11:11.988277 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG oslo_db.sqlalchemy.engines [None req-d6b48a07-93a7-4705-889b-0cf342f16c8e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81481) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 13:11:12.000345 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writer thread running {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 13:11:12.120491 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b48a07-93a7-4705-889b-0cf342f16c8e None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:12.125906 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ebab1-21bd-476e-b79d-83627f733451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:12.126527 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ebab1-21bd-476e-b79d-83627f733451 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:12.126805 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ebab1-21bd-476e-b79d-83627f733451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:12.127073 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ebab1-21bd-476e-b79d-83627f733451 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:12.136246 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ebab1-21bd-476e-b79d-83627f733451 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:12.187867 dv-cinder-862432-3-smb devstack@keystone.service[81481]: WARNING keystone.common.rbac_enforcer.enforcer [None req-194ebab1-21bd-476e-b79d-83627f733451 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 27 13:11:12.188202 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ebab1-21bd-476e-b79d-83627f733451 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:12.198354 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 2/4] 10.222.0.52 () {58 vars in 1324 bytes} [Thu Oct 27 13:11:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 13:11:12.204827 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6908d-393d-4dee-8173-8ab7b0c8d57f None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:12.223836 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6908d-393d-4dee-8173-8ab7b0c8d57f None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:12.230080 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aec4d7-45c6-491e-b6ba-bebcfafdc1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:12.231890 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aec4d7-45c6-491e-b6ba-bebcfafdc1a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:12.232368 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aec4d7-45c6-491e-b6ba-bebcfafdc1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:12.232841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aec4d7-45c6-491e-b6ba-bebcfafdc1a7 admin admin] PATH_INFO: `/v3/projects/818c3abbd7494faeb4f418fcf977e5d3` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:12.235676 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aec4d7-45c6-491e-b6ba-bebcfafdc1a7 admin admin] RBAC: Authorizing `identity:get_project(project_id=818c3abbd7494faeb4f418fcf977e5d3)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:12.290469 dv-cinder-862432-3-smb devstack@keystone.service[81482]: WARNING keystone.common.rbac_enforcer.enforcer [None req-99aec4d7-45c6-491e-b6ba-bebcfafdc1a7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 27 13:11:12.290812 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aec4d7-45c6-491e-b6ba-bebcfafdc1a7 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:12.295473 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 3/5] 10.222.0.52 () {56 vars in 1207 bytes} [Thu Oct 27 13:11:12 2022] GET /identity/v3/projects/818c3abbd7494faeb4f418fcf977e5d3 => generated 344 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:14.406760 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b199f6-0a63-4609-9264-256f619db83a None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:14.407593 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b199f6-0a63-4609-9264-256f619db83a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:14.407593 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b199f6-0a63-4609-9264-256f619db83a None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:14.414390 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 3/6] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:11:14 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:11:14.420155 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33699177-0d36-43db-a923-11204edd515f None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:14.420566 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33699177-0d36-43db-a923-11204edd515f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:14.420648 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33699177-0d36-43db-a923-11204edd515f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:14.441982 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-33699177-0d36-43db-a923-11204edd515f None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:11:14.443544 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-33699177-0d36-43db-a923-11204edd515f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:11:14.452731 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 4/7] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:11:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 27 13:11:14.715555 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b199f6-0a63-4609-9264-256f619db83a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:14.733549 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b199f6-0a63-4609-9264-256f619db83a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:14.738981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71fb25d-61d7-48d4-895b-6cb25838467c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:14.739633 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fb25d-61d7-48d4-895b-6cb25838467c admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:14.739925 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fb25d-61d7-48d4-895b-6cb25838467c admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:14.740173 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fb25d-61d7-48d4-895b-6cb25838467c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:14.749169 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71fb25d-61d7-48d4-895b-6cb25838467c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:14.750993 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71fb25d-61d7-48d4-895b-6cb25838467c admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:14.760228 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 4/8] 10.222.0.52 () {58 vars in 1324 bytes} [Thu Oct 27 13:11:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 13:11:14.766525 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33699177-0d36-43db-a923-11204edd515f None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:14.781123 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33699177-0d36-43db-a923-11204edd515f None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:14.788956 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6caa264-201c-4dda-a69b-b3b0d1d3337a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:14.789615 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6caa264-201c-4dda-a69b-b3b0d1d3337a admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:14.790086 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6caa264-201c-4dda-a69b-b3b0d1d3337a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:14.790357 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6caa264-201c-4dda-a69b-b3b0d1d3337a admin admin] PATH_INFO: `/v3/users/cc57ef7f9089496cb07d829e5172cc92` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:14.791773 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6caa264-201c-4dda-a69b-b3b0d1d3337a admin admin] RBAC: Authorizing `identity:get_user(user_id=cc57ef7f9089496cb07d829e5172cc92)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:14.793666 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6caa264-201c-4dda-a69b-b3b0d1d3337a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:14.795215 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 5/9] 10.222.0.52 () {56 vars in 1198 bytes} [Thu Oct 27 13:11:14 2022] GET /identity/v3/users/cc57ef7f9089496cb07d829e5172cc92 => generated 247 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:16.965942 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6d518-02ac-4e34-a197-8e9beff63c07 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:16.966509 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6d518-02ac-4e34-a197-8e9beff63c07 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:16.966509 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6d518-02ac-4e34-a197-8e9beff63c07 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:16.967857 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 5/10] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:11:16.973293 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39decd-3189-4739-8056-71858485f4e8 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:16.973760 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39decd-3189-4739-8056-71858485f4e8 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:16.973858 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39decd-3189-4739-8056-71858485f4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:16.992840 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-eb39decd-3189-4739-8056-71858485f4e8 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:11:16.994051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-eb39decd-3189-4739-8056-71858485f4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:11:17.040482 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81da1f2-89bd-494a-ab7f-319d8a3efb71 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:17.040742 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81da1f2-89bd-494a-ab7f-319d8a3efb71 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:17.041041 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81da1f2-89bd-494a-ab7f-319d8a3efb71 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:17.042450 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 6/11] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:11:17.047576 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fa9fb-bd13-4abc-8936-cc98b54e23dd None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:17.047857 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fa9fb-bd13-4abc-8936-cc98b54e23dd None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:17.048132 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fa9fb-bd13-4abc-8936-cc98b54e23dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:17.082572 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 6/12] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:11:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:11:17.091722 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG passlib.handlers.bcrypt [None req-c68fa9fb-bd13-4abc-8936-cc98b54e23dd None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81481) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 27 13:11:17.092107 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG passlib.handlers.bcrypt [None req-c68fa9fb-bd13-4abc-8936-cc98b54e23dd None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81481) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 27 13:11:17.140332 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-c68fa9fb-bd13-4abc-8936-cc98b54e23dd None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:11:17.141904 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c68fa9fb-bd13-4abc-8936-cc98b54e23dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:11:17.242877 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 7/13] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:11:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:11:17.350035 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb39decd-3189-4739-8056-71858485f4e8 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:17.375354 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:17.461282 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb39decd-3189-4739-8056-71858485f4e8 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:17.495999 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7948c2-09ef-4709-99b0-e885112697c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:17.496626 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7948c2-09ef-4709-99b0-e885112697c7 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:17.496901 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7948c2-09ef-4709-99b0-e885112697c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:17.497170 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7948c2-09ef-4709-99b0-e885112697c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:17.507586 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68fa9fb-bd13-4abc-8936-cc98b54e23dd None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:17.508891 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7948c2-09ef-4709-99b0-e885112697c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:11:17.517805 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-cd7948c2-09ef-4709-99b0-e885112697c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:11:17.517805 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:11:17.517805 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:11:17.517805 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:11:17.517805 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:11:17.517805 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:11:17.517805 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:11:17.517805 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:11:17.517805 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:11:17.517805 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:11:17.517805 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:11:17.517805 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:11:17.517805 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:11:17.517805 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:11:17.517805 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:11:17.517805 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:11:17.518745 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:11:17.518745 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:11:17.518745 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:11:17.518745 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:11:17.518745 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:11:17.518745 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:11:17.518745 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:11:17.518745 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:11:17.518745 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:11:17.518745 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:11:17.518745 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:11:17.518745 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:11:17.518745 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:11:17.518745 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:11:17.518745 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:11:17.518745 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:11:17.519603 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:11:17.519603 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:11:17.519603 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:11:17.519603 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:11:17.519603 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:11:17.519603 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:11:17.519603 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:11:17.519603 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:11:17.519603 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:11:17.519603 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:11:17.519603 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:11:17.519603 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:11:17.519603 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 7/14] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Oct 27 13:11:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:11:17.524774 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7948c2-09ef-4709-99b0-e885112697c7 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:17.606241 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:17.611161 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68fa9fb-bd13-4abc-8936-cc98b54e23dd None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:17.613440 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:17.624634 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7948c2-09ef-4709-99b0-e885112697c7 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:17.652500 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481ca1f-2616-4db0-8043-4fdfd25d45b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:17.653375 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481ca1f-2616-4db0-8043-4fdfd25d45b8 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:17.653693 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481ca1f-2616-4db0-8043-4fdfd25d45b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:17.653975 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481ca1f-2616-4db0-8043-4fdfd25d45b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:17.654953 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b481ca1f-2616-4db0-8043-4fdfd25d45b8 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:17.656374 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b481ca1f-2616-4db0-8043-4fdfd25d45b8 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:17.659000 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0726a-367d-4911-962b-4c87dd3d0536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:17.659611 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0726a-367d-4911-962b-4c87dd3d0536 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:17.659889 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0726a-367d-4911-962b-4c87dd3d0536 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:17.660159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0726a-367d-4911-962b-4c87dd3d0536 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:17.660858 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f0726a-367d-4911-962b-4c87dd3d0536 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:11:17.661162 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f0726a-367d-4911-962b-4c87dd3d0536 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:17.662699 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f0726a-367d-4911-962b-4c87dd3d0536 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:17.668443 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.sql.core [None req-b481ca1f-2616-4db0-8043-4fdfd25d45b8 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 27 13:11:17.668443 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 27 13:11:17.668443 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [parameters: {'id': 'd644575162914a868fb3d7a290f23bdc', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 27 13:11:17.668443 dv-cinder-862432-3-smb devstack@keystone.service[81481]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81481) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 27 13:11:17.675008 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 8/15] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Oct 27 13:11:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:11:17.680664 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0726a-367d-4911-962b-4c87dd3d0536 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:17.687914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-b481ca1f-2616-4db0-8043-4fdfd25d45b8 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 27 13:11:17.687914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:11:17.687914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 13:11:17.687914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 27 13:11:17.687914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 13:11:17.687914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 27 13:11:17.687914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 13:11:17.687914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application result = self._query(query) Oct 27 13:11:17.687914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 13:11:17.687914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application conn.query(q) Oct 27 13:11:17.687914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 13:11:17.687914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 13:11:17.687914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 13:11:17.687914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application result.read() Oct 27 13:11:17.688718 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 13:11:17.688718 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 27 13:11:17.688718 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 13:11:17.688718 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 27 13:11:17.688718 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 13:11:17.688718 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 27 13:11:17.688718 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 13:11:17.688718 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 27 13:11:17.688718 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 27 13:11:17.688718 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:11:17.688718 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 27 13:11:17.688718 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:11:17.688718 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:11:17.688718 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 27 13:11:17.688718 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 27 13:11:17.688718 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 27 13:11:17.688718 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 27 13:11:17.688718 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 27 13:11:17.689649 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application next(self.gen) Oct 27 13:11:17.689649 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 27 13:11:17.689649 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application yield resource Oct 27 13:11:17.689649 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 27 13:11:17.689649 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application next(self.gen) Oct 27 13:11:17.689649 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 27 13:11:17.689649 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self.session.rollback() Oct 27 13:11:17.689649 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 13:11:17.689649 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self.force_reraise() Oct 27 13:11:17.689649 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 13:11:17.689649 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise self.value Oct 27 13:11:17.689649 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 27 13:11:17.689649 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 27 13:11:17.689649 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 27 13:11:17.689649 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application session.commit() Oct 27 13:11:17.689649 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 27 13:11:17.689649 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 27 13:11:17.690599 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 27 13:11:17.690599 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._prepare_impl() Oct 27 13:11:17.690599 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 27 13:11:17.690599 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self.session.flush() Oct 27 13:11:17.690599 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 27 13:11:17.690599 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._flush(objects) Oct 27 13:11:17.690599 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 27 13:11:17.690599 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 27 13:11:17.690599 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 27 13:11:17.690599 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application compat.raise_( Oct 27 13:11:17.690599 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 13:11:17.690599 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception Oct 27 13:11:17.690599 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 27 13:11:17.690599 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application flush_context.execute() Oct 27 13:11:17.690599 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 27 13:11:17.690599 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rec.execute(self) Oct 27 13:11:17.690599 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 27 13:11:17.691521 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 27 13:11:17.691521 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 27 13:11:17.691521 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 27 13:11:17.691521 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 27 13:11:17.691521 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 27 13:11:17.691521 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 27 13:11:17.691521 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 27 13:11:17.691521 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 27 13:11:17.691521 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 27 13:11:17.691521 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 27 13:11:17.691521 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 27 13:11:17.691521 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 27 13:11:17.691521 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 27 13:11:17.691521 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 27 13:11:17.691521 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 27 13:11:17.692249 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 13:11:17.692249 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception Oct 27 13:11:17.692249 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 13:11:17.692249 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 27 13:11:17.692249 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 13:11:17.692249 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 27 13:11:17.692249 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 13:11:17.692249 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application result = self._query(query) Oct 27 13:11:17.692249 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 13:11:17.692249 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application conn.query(q) Oct 27 13:11:17.692249 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 13:11:17.692249 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 13:11:17.692249 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 13:11:17.692249 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application result.read() Oct 27 13:11:17.692249 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 13:11:17.692249 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 27 13:11:17.692249 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 13:11:17.693136 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 27 13:11:17.693136 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 13:11:17.693136 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 27 13:11:17.693136 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 13:11:17.693136 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 27 13:11:17.693136 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 27 13:11:17.693136 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 27 13:11:17.693136 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [parameters: {'id': 'd644575162914a868fb3d7a290f23bdc', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 27 13:11:17.693136 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 27 13:11:17.693136 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:11:17.693136 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 13:11:17.693136 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:11:17.693136 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:11:17.693136 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 27 13:11:17.693136 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 27 13:11:17.694574 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 27 13:11:17.694574 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 27 13:11:17.694574 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 27 13:11:17.694574 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:11:17.694574 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 13:11:17.694574 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:11:17.694574 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:11:17.694574 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:11:17.694574 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:11:17.694574 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:11:17.694574 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:11:17.694574 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:11:17.694574 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:11:17.694574 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:11:17.694574 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:11:17.694574 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:11:17.694574 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:11:17.696065 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 27 13:11:17.696065 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 27 13:11:17.696065 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:11:17.696065 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:11:17.696065 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 27 13:11:17.696065 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 27 13:11:17.696065 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:11:17.696065 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:11:17.696065 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 27 13:11:17.696065 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 27 13:11:17.696065 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 27 13:11:17.696065 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:11:17.696065 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 8/16] 10.222.0.52 () {60 vars in 1137 bytes} [Thu Oct 27 13:11:17 2022] POST /identity/v3/domains => generated 190 bytes in 187 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:11:17.696065 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481ca1f-2616-4db0-8043-4fdfd25d45b8 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:17.787742 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0726a-367d-4911-962b-4c87dd3d0536 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:17.806372 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481ca1f-2616-4db0-8043-4fdfd25d45b8 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:17.824281 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c54db-2ce9-438a-bc78-2c27610fba38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:17.824917 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c54db-2ce9-438a-bc78-2c27610fba38 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:17.825193 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c54db-2ce9-438a-bc78-2c27610fba38 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:17.825460 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c54db-2ce9-438a-bc78-2c27610fba38 None admin] PATH_INFO: `/v3/users/cc57ef7f9089496cb07d829e5172cc92` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:17.826650 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c54db-2ce9-438a-bc78-2c27610fba38 None admin] RBAC: Authorizing `identity:get_user(user_id=cc57ef7f9089496cb07d829e5172cc92)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:17.828108 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c54db-2ce9-438a-bc78-2c27610fba38 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:17.829716 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 9/17] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Oct 27 13:11:17 2022] GET /identity/v3/users/cc57ef7f9089496cb07d829e5172cc92 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:17.835321 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c54db-2ce9-438a-bc78-2c27610fba38 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:17.840349 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34c85b-0b2e-4e45-bd98-2d65183c78a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:17.841215 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34c85b-0b2e-4e45-bd98-2d65183c78a6 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:17.841490 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34c85b-0b2e-4e45-bd98-2d65183c78a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:17.841863 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34c85b-0b2e-4e45-bd98-2d65183c78a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:17.849423 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:17.861420 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34c85b-0b2e-4e45-bd98-2d65183c78a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:17.862869 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34c85b-0b2e-4e45-bd98-2d65183c78a6 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:17.880036 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-9c34c85b-0b2e-4e45-bd98-2d65183c78a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:11:17.880036 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:11:17.880036 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:11:17.880036 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:11:17.880036 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:11:17.880036 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:11:17.880036 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:11:17.880036 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:11:17.880036 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:11:17.880036 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:11:17.880036 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:11:17.880036 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:11:17.880036 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:11:17.880036 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:11:17.880036 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:11:17.880036 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:11:17.881388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:11:17.881388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:11:17.881388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:11:17.881388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:11:17.881388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:11:17.881388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:11:17.881388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:11:17.881388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:11:17.881388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:11:17.881388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:11:17.881388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:11:17.881388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:11:17.881388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:11:17.881388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:11:17.881388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:11:17.881388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:11:17.881388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:11:17.882228 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:11:17.882228 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:11:17.882228 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:11:17.882228 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 9/18] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:11:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:11:17.887396 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34c85b-0b2e-4e45-bd98-2d65183c78a6 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:17.909341 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:17.938198 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c54db-2ce9-438a-bc78-2c27610fba38 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:17.973560 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0f238-8f88-44ba-8cc4-8167aa824493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:17.974304 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0f238-8f88-44ba-8cc4-8167aa824493 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:17.974701 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0f238-8f88-44ba-8cc4-8167aa824493 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:17.975180 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0f238-8f88-44ba-8cc4-8167aa824493 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:17.976343 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b0f238-8f88-44ba-8cc4-8167aa824493 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:17.977852 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b0f238-8f88-44ba-8cc4-8167aa824493 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:17.979467 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 10/19] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:11:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:11:17.985062 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0f238-8f88-44ba-8cc4-8167aa824493 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:17.987268 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34c85b-0b2e-4e45-bd98-2d65183c78a6 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:18.024232 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b363d61-f315-44cb-9700-ad9508aee564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:18.024837 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b363d61-f315-44cb-9700-ad9508aee564 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:18.025118 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b363d61-f315-44cb-9700-ad9508aee564 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:18.025394 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b363d61-f315-44cb-9700-ad9508aee564 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:18.026080 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b363d61-f315-44cb-9700-ad9508aee564 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:11:18.026374 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b363d61-f315-44cb-9700-ad9508aee564 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:18.027772 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b363d61-f315-44cb-9700-ad9508aee564 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:18.045355 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 10/20] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:11:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:11:18.072912 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:18.094446 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0f238-8f88-44ba-8cc4-8167aa824493 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:18.132251 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734d01f-06dd-4b95-b7da-9b998a1233e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:18.132840 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734d01f-06dd-4b95-b7da-9b998a1233e1 None admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:18.133090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734d01f-06dd-4b95-b7da-9b998a1233e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:18.133356 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734d01f-06dd-4b95-b7da-9b998a1233e1 None admin] PATH_INFO: `/v3/domains/default/users/cc57ef7f9089496cb07d829e5172cc92/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:18.135401 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734d01f-06dd-4b95-b7da-9b998a1233e1 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=cc57ef7f9089496cb07d829e5172cc92, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:18.136896 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734d01f-06dd-4b95-b7da-9b998a1233e1 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:18.250735 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 11/21] 10.222.0.52 () {58 vars in 1361 bytes} [Thu Oct 27 13:11:17 2022] PUT /identity/v3/domains/default/users/cc57ef7f9089496cb07d829e5172cc92/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:11:20.903914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc9199-4fa4-43f8-8d05-5c54ee0fcb37 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:20.904918 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc9199-4fa4-43f8-8d05-5c54ee0fcb37 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:20.905403 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc9199-4fa4-43f8-8d05-5c54ee0fcb37 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:20.907168 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 11/22] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:11:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:11:20.914079 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088dec14-e8df-4180-b031-cc195e00b937 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:20.914643 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088dec14-e8df-4180-b031-cc195e00b937 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:20.914643 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088dec14-e8df-4180-b031-cc195e00b937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:20.942754 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-088dec14-e8df-4180-b031-cc195e00b937 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:11:20.944453 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-088dec14-e8df-4180-b031-cc195e00b937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:11:21.029021 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 12/23] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:11:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:11:21.037847 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7023c24-c06a-493b-b19d-07a7f7203e88 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:21.038129 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7023c24-c06a-493b-b19d-07a7f7203e88 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:21.038400 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7023c24-c06a-493b-b19d-07a7f7203e88 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:21.039764 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 12/24] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:11:21.045099 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93969d0a-4a00-47ab-95fb-541a6c3740c4 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:21.045560 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93969d0a-4a00-47ab-95fb-541a6c3740c4 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:21.045981 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93969d0a-4a00-47ab-95fb-541a6c3740c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:21.074647 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-93969d0a-4a00-47ab-95fb-541a6c3740c4 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:11:21.076047 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-93969d0a-4a00-47ab-95fb-541a6c3740c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:11:21.161375 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:21.167238 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 13/25] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:11:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:11:21.190933 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e81d4-e7ad-475e-9df9-f414f04e68a2 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:21.191235 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e81d4-e7ad-475e-9df9-f414f04e68a2 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:21.191483 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e81d4-e7ad-475e-9df9-f414f04e68a2 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:21.193120 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 13/26] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:11:21.207103 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dafa5e8-53b5-45ae-88d6-73fab5d4f3c1 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:21.207383 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dafa5e8-53b5-45ae-88d6-73fab5d4f3c1 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:21.207663 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dafa5e8-53b5-45ae-88d6-73fab5d4f3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:21.235537 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-4dafa5e8-53b5-45ae-88d6-73fab5d4f3c1 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:11:21.236712 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-4dafa5e8-53b5-45ae-88d6-73fab5d4f3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:11:21.256265 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9e8d0-7ab1-480d-8216-1f56c1aaf837 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:21.256265 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9e8d0-7ab1-480d-8216-1f56c1aaf837 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:21.256265 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9e8d0-7ab1-480d-8216-1f56c1aaf837 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:21.256265 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 14/27] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 13:11:21.263102 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894fd0a9-d20b-4203-8919-7dcf0f9144e4 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:21.263615 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894fd0a9-d20b-4203-8919-7dcf0f9144e4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:21.264077 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894fd0a9-d20b-4203-8919-7dcf0f9144e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:21.295540 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-894fd0a9-d20b-4203-8919-7dcf0f9144e4 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:11:21.296718 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-894fd0a9-d20b-4203-8919-7dcf0f9144e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:11:21.367919 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 14/28] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:11:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 13:11:21.375718 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 15/29] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:11:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 13:11:21.381474 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dafa5e8-53b5-45ae-88d6-73fab5d4f3c1 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:21.546934 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dafa5e8-53b5-45ae-88d6-73fab5d4f3c1 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:21.576774 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:21.583742 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894fd0a9-d20b-4203-8919-7dcf0f9144e4 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:21.586871 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2299d-55c1-4a71-af3e-d5d04873125f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:21.587492 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2299d-55c1-4a71-af3e-d5d04873125f None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:21.587769 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2299d-55c1-4a71-af3e-d5d04873125f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:21.588039 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2299d-55c1-4a71-af3e-d5d04873125f None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:21.588713 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa2299d-55c1-4a71-af3e-d5d04873125f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:21.590346 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa2299d-55c1-4a71-af3e-d5d04873125f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:21.601581 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:21.615431 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 15/30] 10.222.0.52 () {60 vars in 1131 bytes} [Thu Oct 27 13:11:21 2022] POST /identity/v3/roles => generated 219 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:11:21.746635 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894fd0a9-d20b-4203-8919-7dcf0f9144e4 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:21.752960 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2299d-55c1-4a71-af3e-d5d04873125f None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:21.830127 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c4a031-72f6-4128-8906-f9feddb4ea53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:21.830774 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4a031-72f6-4128-8906-f9feddb4ea53 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:21.831056 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4a031-72f6-4128-8906-f9feddb4ea53 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:21.831327 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4a031-72f6-4128-8906-f9feddb4ea53 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:21.832056 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c4a031-72f6-4128-8906-f9feddb4ea53 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:21.833595 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c4a031-72f6-4128-8906-f9feddb4ea53 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:21.933794 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2299d-55c1-4a71-af3e-d5d04873125f None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:21.973846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 16/31] 10.222.0.52 () {60 vars in 1131 bytes} [Thu Oct 27 13:11:21 2022] POST /identity/v3/roles => generated 225 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:11:21.974922 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c4a031-72f6-4128-8906-f9feddb4ea53 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:21.976133 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837ed6b-f5a6-492f-b4c1-b0697c521496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:21.976788 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837ed6b-f5a6-492f-b4c1-b0697c521496 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:21.977109 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837ed6b-f5a6-492f-b4c1-b0697c521496 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:21.977382 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837ed6b-f5a6-492f-b4c1-b0697c521496 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:21.991216 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8837ed6b-f5a6-492f-b4c1-b0697c521496 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:21.992850 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8837ed6b-f5a6-492f-b4c1-b0697c521496 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:22.011154 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-8837ed6b-f5a6-492f-b4c1-b0697c521496 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:11:22.011154 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:11:22.011154 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:11:22.011154 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:11:22.011154 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:11:22.011154 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:11:22.011154 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:11:22.011154 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:11:22.011154 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:11:22.011154 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:11:22.011154 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:11:22.011154 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:11:22.011154 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:11:22.011154 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:11:22.011154 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:11:22.011154 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:11:22.012109 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:11:22.012109 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:11:22.012109 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:11:22.012109 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:11:22.012109 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:11:22.012109 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:11:22.012109 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:11:22.012109 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:11:22.012109 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:11:22.012109 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:11:22.012109 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:11:22.012109 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:11:22.012109 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:11:22.012109 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:11:22.012109 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:11:22.012109 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:11:22.012109 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:11:22.012895 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:11:22.012895 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:11:22.012895 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:11:22.012895 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 16/32] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:11:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:11:22.018998 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837ed6b-f5a6-492f-b4c1-b0697c521496 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:22.075184 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:22.153170 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837ed6b-f5a6-492f-b4c1-b0697c521496 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:22.170764 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:22.197432 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c4a031-72f6-4128-8906-f9feddb4ea53 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:22.201317 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb6c3e-5581-4800-80d5-6396e5320752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:22.201992 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb6c3e-5581-4800-80d5-6396e5320752 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:22.202270 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb6c3e-5581-4800-80d5-6396e5320752 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:22.202550 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb6c3e-5581-4800-80d5-6396e5320752 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:22.203199 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb6c3e-5581-4800-80d5-6396e5320752 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:11:22.203503 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb6c3e-5581-4800-80d5-6396e5320752 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:22.204914 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb6c3e-5581-4800-80d5-6396e5320752 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:22.228636 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 17/33] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:11:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:22.230081 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28417ac-3b8d-49cf-b2f5-f338b0278272 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:22.230371 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28417ac-3b8d-49cf-b2f5-f338b0278272 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:22.230641 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28417ac-3b8d-49cf-b2f5-f338b0278272 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:22.231906 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 18/34] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:11:22.236862 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28417ac-3b8d-49cf-b2f5-f338b0278272 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:22.238146 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460de0ff-289c-4e67-8bbb-129d18b73167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:22.238802 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460de0ff-289c-4e67-8bbb-129d18b73167 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:22.239084 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460de0ff-289c-4e67-8bbb-129d18b73167 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:22.239357 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460de0ff-289c-4e67-8bbb-129d18b73167 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:22.255567 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460de0ff-289c-4e67-8bbb-129d18b73167 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:11:22.262539 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-460de0ff-289c-4e67-8bbb-129d18b73167 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:11:22.262539 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:11:22.262539 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:11:22.262539 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:11:22.262539 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:11:22.262539 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:11:22.262539 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:11:22.262539 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:11:22.262539 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:11:22.262539 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:11:22.262539 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:11:22.262539 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:11:22.262539 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:11:22.262539 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:11:22.262539 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:11:22.262539 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:11:22.263420 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:11:22.263420 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:11:22.263420 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:11:22.263420 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:11:22.263420 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:11:22.263420 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:11:22.263420 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:11:22.263420 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:11:22.263420 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:11:22.263420 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:11:22.263420 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:11:22.263420 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:11:22.263420 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:11:22.263420 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:11:22.263420 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:11:22.263420 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:11:22.264153 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:11:22.264153 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:11:22.264153 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:11:22.264153 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:11:22.264153 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:11:22.264153 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:11:22.264153 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:11:22.264153 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:11:22.264153 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:11:22.264153 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:11:22.264153 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:11:22.264153 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:11:22.264153 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 17/35] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Oct 27 13:11:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:11:22.265600 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf6ce5-0f35-4af1-a707-8be3cca6f285 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:22.265600 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf6ce5-0f35-4af1-a707-8be3cca6f285 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:22.269561 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf6ce5-0f35-4af1-a707-8be3cca6f285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:22.285406 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-bcaf6ce5-0f35-4af1-a707-8be3cca6f285 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:11:22.287149 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-bcaf6ce5-0f35-4af1-a707-8be3cca6f285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:11:22.373558 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 18/36] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:11:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:11:22.373558 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf6ce5-0f35-4af1-a707-8be3cca6f285 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:22.374521 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28417ac-3b8d-49cf-b2f5-f338b0278272 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:22.384158 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:22.412010 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6b7c1-611d-4f98-8b32-957e23ef606e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:22.412627 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6b7c1-611d-4f98-8b32-957e23ef606e None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:22.412907 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6b7c1-611d-4f98-8b32-957e23ef606e None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:22.413187 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6b7c1-611d-4f98-8b32-957e23ef606e None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:22.413877 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d6b7c1-611d-4f98-8b32-957e23ef606e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:22.415354 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d6b7c1-611d-4f98-8b32-957e23ef606e None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:22.435754 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:22.448060 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 19/37] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Oct 27 13:11:22 2022] POST /identity/v3/projects => generated 301 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:11:22.449291 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66dc288-2642-4453-ab37-a01899031158 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:22.449771 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66dc288-2642-4453-ab37-a01899031158 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:22.449887 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66dc288-2642-4453-ab37-a01899031158 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:22.451304 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 20/38] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:11:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:11:22.456864 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9eedb6-f6c4-43f1-86d1-be065690611d None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:22.457155 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9eedb6-f6c4-43f1-86d1-be065690611d None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:22.457437 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9eedb6-f6c4-43f1-86d1-be065690611d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:22.479005 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-9f9eedb6-f6c4-43f1-86d1-be065690611d None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:11:22.480452 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-9f9eedb6-f6c4-43f1-86d1-be065690611d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:11:22.498321 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf6ce5-0f35-4af1-a707-8be3cca6f285 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:22.537157 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d27a5-d87e-4b0d-9974-0982161b887b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:22.537783 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d27a5-d87e-4b0d-9974-0982161b887b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:22.538066 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d27a5-d87e-4b0d-9974-0982161b887b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:22.538341 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d27a5-d87e-4b0d-9974-0982161b887b None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:22.539047 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d27a5-d87e-4b0d-9974-0982161b887b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:11:22.539357 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d27a5-d87e-4b0d-9974-0982161b887b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:22.540986 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d27a5-d87e-4b0d-9974-0982161b887b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:22.555802 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 19/39] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Oct 27 13:11:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:22.562355 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d27a5-d87e-4b0d-9974-0982161b887b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:22.686120 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d27a5-d87e-4b0d-9974-0982161b887b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:22.690841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 21/40] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:11:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 13:11:22.695506 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9eedb6-f6c4-43f1-86d1-be065690611d None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:22.713464 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:22.726608 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365591a-801f-48c9-87c3-99c1af604d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:22.727246 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365591a-801f-48c9-87c3-99c1af604d71 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:22.727529 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365591a-801f-48c9-87c3-99c1af604d71 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:22.727856 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365591a-801f-48c9-87c3-99c1af604d71 None admin] PATH_INFO: `/v3/users/cc57ef7f9089496cb07d829e5172cc92` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:22.729301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7365591a-801f-48c9-87c3-99c1af604d71 None admin] RBAC: Authorizing `identity:get_user(user_id=cc57ef7f9089496cb07d829e5172cc92)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:22.730793 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7365591a-801f-48c9-87c3-99c1af604d71 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:22.732748 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 20/41] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Oct 27 13:11:22 2022] GET /identity/v3/users/cc57ef7f9089496cb07d829e5172cc92 => generated 247 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:11:22.738547 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365591a-801f-48c9-87c3-99c1af604d71 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:22.801087 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:22.822291 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9eedb6-f6c4-43f1-86d1-be065690611d None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:22.843484 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365591a-801f-48c9-87c3-99c1af604d71 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:22.857374 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6314ec3-d2f1-4949-bd87-34dd34f78144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:22.858567 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6314ec3-d2f1-4949-bd87-34dd34f78144 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:22.859033 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6314ec3-d2f1-4949-bd87-34dd34f78144 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:22.859309 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6314ec3-d2f1-4949-bd87-34dd34f78144 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:22.859996 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6314ec3-d2f1-4949-bd87-34dd34f78144 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:22.861456 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6314ec3-d2f1-4949-bd87-34dd34f78144 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:22.877218 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 22/42] 10.222.0.52 () {60 vars in 1131 bytes} [Thu Oct 27 13:11:22 2022] POST /identity/v3/roles => generated 223 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:11:22.879174 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c52a5-6132-4ae6-9b1e-d31c9df57d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:22.879811 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c52a5-6132-4ae6-9b1e-d31c9df57d90 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:22.880090 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c52a5-6132-4ae6-9b1e-d31c9df57d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:22.880396 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c52a5-6132-4ae6-9b1e-d31c9df57d90 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:22.881655 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819c52a5-6132-4ae6-9b1e-d31c9df57d90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:22.883155 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819c52a5-6132-4ae6-9b1e-d31c9df57d90 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:22.885023 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 21/43] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:11:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:22.890942 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6314ec3-d2f1-4949-bd87-34dd34f78144 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:22.972651 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c52a5-6132-4ae6-9b1e-d31c9df57d90 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:23.008555 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6314ec3-d2f1-4949-bd87-34dd34f78144 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:23.040366 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:23.047995 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fcc78-a3ef-40a5-8863-97d4a8b86592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:23.048611 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fcc78-a3ef-40a5-8863-97d4a8b86592 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:23.048889 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fcc78-a3ef-40a5-8863-97d4a8b86592 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:23.049159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fcc78-a3ef-40a5-8863-97d4a8b86592 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:23.049945 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648fcc78-a3ef-40a5-8863-97d4a8b86592 None admin] RBAC: Adding query filter params (role.id=93bba834c17a4aa7afdc65c002a12975, scope.domain.id=default, user.id=cc57ef7f9089496cb07d829e5172cc92) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:11:23.050239 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648fcc78-a3ef-40a5-8863-97d4a8b86592 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:23.051781 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648fcc78-a3ef-40a5-8863-97d4a8b86592 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:23.059820 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 23/44] 10.222.0.52 () {56 vars in 1322 bytes} [Thu Oct 27 13:11:22 2022] GET /identity/v3/role_assignments?user.id=cc57ef7f9089496cb07d829e5172cc92&scope.domain.id=default&role.id=93bba834c17a4aa7afdc65c002a12975 => generated 530 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:23.094314 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c52a5-6132-4ae6-9b1e-d31c9df57d90 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:23.135358 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8d861-aeb7-49ed-b961-0a504554a157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:23.136020 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8d861-aeb7-49ed-b961-0a504554a157 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:23.136302 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8d861-aeb7-49ed-b961-0a504554a157 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:23.136576 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8d861-aeb7-49ed-b961-0a504554a157 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:23.137879 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8d861-aeb7-49ed-b961-0a504554a157 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:23.139399 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8d861-aeb7-49ed-b961-0a504554a157 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:23.141049 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 22/45] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:11:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:11:23.147340 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fcc78-a3ef-40a5-8863-97d4a8b86592 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:23.160189 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:23.266126 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fcc78-a3ef-40a5-8863-97d4a8b86592 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:23.302447 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f3e24-a2f3-48d6-b930-4bdb388f999e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:23.302989 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f3e24-a2f3-48d6-b930-4bdb388f999e None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:23.303270 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f3e24-a2f3-48d6-b930-4bdb388f999e None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:23.303548 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f3e24-a2f3-48d6-b930-4bdb388f999e None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:23.304203 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184f3e24-a2f3-48d6-b930-4bdb388f999e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:23.305723 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184f3e24-a2f3-48d6-b930-4bdb388f999e None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:23.335122 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 24/46] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Oct 27 13:11:23 2022] POST /identity/v3/projects => generated 312 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:11:25.463110 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9645de-b14f-4a03-8e49-8cdef53e2986 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:25.463792 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9645de-b14f-4a03-8e49-8cdef53e2986 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:25.463792 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9645de-b14f-4a03-8e49-8cdef53e2986 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:25.465185 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 23/47] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:11:25.471584 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d844623-3d83-43ce-bf87-976da6a3bd86 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:25.472007 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d844623-3d83-43ce-bf87-976da6a3bd86 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:25.472194 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d844623-3d83-43ce-bf87-976da6a3bd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:25.501701 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-6d844623-3d83-43ce-bf87-976da6a3bd86 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:11:25.503509 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6d844623-3d83-43ce-bf87-976da6a3bd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:11:25.563702 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:25.580620 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 25/48] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:11:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 13:11:25.844248 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9645de-b14f-4a03-8e49-8cdef53e2986 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:25.959274 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9645de-b14f-4a03-8e49-8cdef53e2986 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:25.986134 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:25.995744 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1b067-2d2d-49a9-8c11-6de370404137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:25.996362 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1b067-2d2d-49a9-8c11-6de370404137 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:25.996634 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1b067-2d2d-49a9-8c11-6de370404137 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:25.996902 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1b067-2d2d-49a9-8c11-6de370404137 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:25.998069 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e1b067-2d2d-49a9-8c11-6de370404137 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:25.999514 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e1b067-2d2d-49a9-8c11-6de370404137 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:26.001059 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 24/49] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:11:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:26.009145 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d844623-3d83-43ce-bf87-976da6a3bd86 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:26.123058 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d844623-3d83-43ce-bf87-976da6a3bd86 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:26.157916 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1533b20c-96a5-4237-bdb1-2ef7f3947c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:26.158519 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533b20c-96a5-4237-bdb1-2ef7f3947c27 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:26.158794 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533b20c-96a5-4237-bdb1-2ef7f3947c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:26.159063 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533b20c-96a5-4237-bdb1-2ef7f3947c27 None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:26.159720 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1533b20c-96a5-4237-bdb1-2ef7f3947c27 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:26.161157 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1533b20c-96a5-4237-bdb1-2ef7f3947c27 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:26.189347 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 26/50] 10.222.0.52 () {60 vars in 1140 bytes} [Thu Oct 27 13:11:26 2022] POST /identity/v3/projects => generated 298 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:11:28.324256 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d1676-c065-41dd-bfb5-ad299aa76d6a None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:28.325100 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d1676-c065-41dd-bfb5-ad299aa76d6a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:28.325100 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d1676-c065-41dd-bfb5-ad299aa76d6a None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:28.327474 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 25/51] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:11:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:11:28.333899 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660c0e6-4e52-452d-81c4-50022738c4d1 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:28.334703 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660c0e6-4e52-452d-81c4-50022738c4d1 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:28.334835 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660c0e6-4e52-452d-81c4-50022738c4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:28.360393 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-d660c0e6-4e52-452d-81c4-50022738c4d1 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:11:28.361617 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d660c0e6-4e52-452d-81c4-50022738c4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:11:28.402234 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:28.438333 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 27/52] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:11:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:11:28.706226 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d1676-c065-41dd-bfb5-ad299aa76d6a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:28.834816 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d1676-c065-41dd-bfb5-ad299aa76d6a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:28.871982 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809f9d6-5dfa-4a1a-a611-ea24aaa7a175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:28.872606 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809f9d6-5dfa-4a1a-a611-ea24aaa7a175 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:28.872887 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809f9d6-5dfa-4a1a-a611-ea24aaa7a175 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:28.873157 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809f9d6-5dfa-4a1a-a611-ea24aaa7a175 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:28.874430 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f809f9d6-5dfa-4a1a-a611-ea24aaa7a175 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:28.875895 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f809f9d6-5dfa-4a1a-a611-ea24aaa7a175 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:28.877485 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 26/53] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:11:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:28.886556 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660c0e6-4e52-452d-81c4-50022738c4d1 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:28.992468 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660c0e6-4e52-452d-81c4-50022738c4d1 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:29.028790 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91529b44-4755-4586-a8b5-bc205a1436ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:29.029397 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91529b44-4755-4586-a8b5-bc205a1436ff None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:29.029704 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91529b44-4755-4586-a8b5-bc205a1436ff None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:29.029977 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91529b44-4755-4586-a8b5-bc205a1436ff None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:29.030619 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91529b44-4755-4586-a8b5-bc205a1436ff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:29.032078 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91529b44-4755-4586-a8b5-bc205a1436ff None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:29.061497 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 28/54] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Oct 27 13:11:28 2022] POST /identity/v3/users => generated 275 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:11:32.219722 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e3429-3549-4bf4-b3ff-49f54c18a639 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:32.220598 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e3429-3549-4bf4-b3ff-49f54c18a639 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:32.221005 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e3429-3549-4bf4-b3ff-49f54c18a639 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:32.222542 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 27/55] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:11:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:11:32.227702 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143b79b-1426-49a1-a328-f8da1c74ea79 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:32.228435 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143b79b-1426-49a1-a328-f8da1c74ea79 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:32.228874 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143b79b-1426-49a1-a328-f8da1c74ea79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:32.254520 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-3143b79b-1426-49a1-a328-f8da1c74ea79 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:11:32.256015 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3143b79b-1426-49a1-a328-f8da1c74ea79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:11:32.283764 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:32.348064 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 29/56] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:11:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:11:32.517497 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c5b34-7bc8-4497-ae5a-6056c878b18f None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:32.518135 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c5b34-7bc8-4497-ae5a-6056c878b18f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:32.518629 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c5b34-7bc8-4497-ae5a-6056c878b18f None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:32.520440 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 28/57] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:11:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:11:32.522462 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d10978-b29b-456b-a0f1-1224e8b3bd1e None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:32.522953 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d10978-b29b-456b-a0f1-1224e8b3bd1e None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:32.523432 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d10978-b29b-456b-a0f1-1224e8b3bd1e None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:32.524982 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff939e18-760b-439a-8a9b-e2f80cca5cc9 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:32.525446 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff939e18-760b-439a-8a9b-e2f80cca5cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:32.525914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff939e18-760b-439a-8a9b-e2f80cca5cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:32.533409 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 30/58] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:11:32 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:11:32.541899 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb58bfc-521b-421c-8a25-355bedfb6482 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:32.541899 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb58bfc-521b-421c-8a25-355bedfb6482 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:32.541899 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb58bfc-521b-421c-8a25-355bedfb6482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:32.554562 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-ff939e18-760b-439a-8a9b-e2f80cca5cc9 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:11:32.555736 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ff939e18-760b-439a-8a9b-e2f80cca5cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:11:32.559323 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-acb58bfc-521b-421c-8a25-355bedfb6482 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:11:32.560670 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-acb58bfc-521b-421c-8a25-355bedfb6482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:11:32.632233 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 31/59] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:11:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 13:11:32.680961 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:32.698883 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 29/60] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:11:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 13:11:32.747189 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be623a3-d775-41dd-8c6f-3f34faefa4a7 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:32.747900 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be623a3-d775-41dd-8c6f-3f34faefa4a7 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:32.748383 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be623a3-d775-41dd-8c6f-3f34faefa4a7 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:32.750038 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 32/61] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:11:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:11:32.755582 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bf9c8-f7aa-460c-b9fb-ab4c1634ef5e None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:32.755866 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bf9c8-f7aa-460c-b9fb-ab4c1634ef5e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:32.756142 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bf9c8-f7aa-460c-b9fb-ab4c1634ef5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:32.778930 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-fc0bf9c8-f7aa-460c-b9fb-ab4c1634ef5e None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:11:32.780013 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-fc0bf9c8-f7aa-460c-b9fb-ab4c1634ef5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:11:32.785021 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be623a3-d775-41dd-8c6f-3f34faefa4a7 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:32.852029 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 30/62] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:11:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:11:32.936618 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:32.957882 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be623a3-d775-41dd-8c6f-3f34faefa4a7 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:32.997356 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0bf9c8-f7aa-460c-b9fb-ab4c1634ef5e None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:33.007769 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb09f0-06f2-4f47-9045-bea187efe15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:33.008459 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb09f0-06f2-4f47-9045-bea187efe15f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:33.008738 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb09f0-06f2-4f47-9045-bea187efe15f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:33.009006 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb09f0-06f2-4f47-9045-bea187efe15f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:33.020526 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb09f0-06f2-4f47-9045-bea187efe15f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:11:33.027090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-b3bb09f0-06f2-4f47-9045-bea187efe15f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 13:11:33.027090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:11:33.027090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:11:33.027090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:11:33.027090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:11:33.027090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:11:33.027090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:11:33.027090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:11:33.027090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:11:33.027090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:11:33.027090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:11:33.027090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:11:33.027090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:11:33.027090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:11:33.027090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:11:33.027090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:11:33.027930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:11:33.027930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:11:33.027930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:11:33.027930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:11:33.027930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:11:33.027930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:11:33.027930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:11:33.027930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:11:33.027930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:11:33.027930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:11:33.027930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:11:33.027930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:11:33.027930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:11:33.027930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:11:33.027930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:11:33.027930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:11:33.028689 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:11:33.028689 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:11:33.028689 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:11:33.028689 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:11:33.028689 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:11:33.028689 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:11:33.028689 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:11:33.028689 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:11:33.028689 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:11:33.028689 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:11:33.028689 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 13:11:33.028689 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:11:33.028689 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 33/63] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Oct 27 13:11:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:11:33.034394 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb09f0-06f2-4f47-9045-bea187efe15f None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:33.130348 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0bf9c8-f7aa-460c-b9fb-ab4c1634ef5e None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:33.158079 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:33.165319 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb09f0-06f2-4f47-9045-bea187efe15f None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:33.172578 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4165ba-213e-4aae-96ca-bcc61410db8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:33.173899 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4165ba-213e-4aae-96ca-bcc61410db8a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:33.174319 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4165ba-213e-4aae-96ca-bcc61410db8a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:33.174891 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4165ba-213e-4aae-96ca-bcc61410db8a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:33.186925 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4165ba-213e-4aae-96ca-bcc61410db8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:11:33.191778 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-1c4165ba-213e-4aae-96ca-bcc61410db8a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:11:33.191778 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:11:33.191778 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:11:33.191778 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:11:33.191778 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:11:33.191778 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:11:33.191778 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:11:33.191778 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:11:33.191778 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:11:33.191778 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:11:33.191778 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:11:33.191778 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:11:33.191778 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:11:33.191778 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:11:33.191778 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:11:33.191778 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:11:33.192798 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:11:33.192798 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:11:33.192798 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:11:33.192798 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:11:33.192798 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:11:33.192798 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:11:33.192798 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:11:33.192798 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:11:33.192798 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:11:33.192798 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:11:33.192798 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:11:33.192798 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:11:33.192798 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:11:33.192798 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:11:33.192798 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:11:33.192798 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:11:33.193732 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:11:33.193732 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:11:33.193732 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:11:33.193732 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:11:33.193732 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:11:33.193732 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:11:33.193732 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:11:33.193732 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:11:33.193732 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:11:33.193732 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:11:33.193732 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:11:33.193732 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:11:33.193732 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 31/64] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Oct 27 13:11:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:11:33.193732 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4165ba-213e-4aae-96ca-bcc61410db8a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:33.207429 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8f701-d412-493c-9f62-8fd07f16fd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:33.208140 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8f701-d412-493c-9f62-8fd07f16fd0a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:33.208528 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8f701-d412-493c-9f62-8fd07f16fd0a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:33.208802 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8f701-d412-493c-9f62-8fd07f16fd0a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:33.218869 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb8f701-d412-493c-9f62-8fd07f16fd0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:11:33.223709 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-4eb8f701-d412-493c-9f62-8fd07f16fd0a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 13:11:33.223709 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:11:33.223709 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:11:33.223709 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:11:33.223709 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:11:33.223709 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:11:33.223709 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:11:33.223709 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:11:33.223709 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:11:33.223709 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:11:33.223709 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:11:33.223709 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:11:33.223709 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:11:33.223709 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:11:33.223709 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:11:33.223709 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:11:33.224661 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:11:33.224661 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:11:33.224661 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:11:33.224661 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:11:33.224661 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:11:33.224661 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:11:33.224661 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:11:33.224661 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:11:33.224661 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:11:33.224661 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:11:33.224661 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:11:33.224661 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:11:33.224661 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:11:33.224661 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:11:33.224661 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:11:33.224661 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:11:33.225395 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:11:33.225395 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:11:33.225395 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:11:33.225395 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:11:33.225395 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:11:33.225395 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:11:33.225395 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:11:33.225395 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:11:33.225395 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:11:33.225395 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:11:33.225395 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 13:11:33.225395 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:11:33.225395 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 34/65] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Oct 27 13:11:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:11:33.226048 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fed667-ceb7-4bf4-9e75-5c62e79c6143 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:33.226255 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fed667-ceb7-4bf4-9e75-5c62e79c6143 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:33.226474 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fed667-ceb7-4bf4-9e75-5c62e79c6143 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:33.228329 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 35/66] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:11:33.228940 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fed667-ceb7-4bf4-9e75-5c62e79c6143 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:33.239366 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:33.299874 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4165ba-213e-4aae-96ca-bcc61410db8a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:33.335201 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fed667-ceb7-4bf4-9e75-5c62e79c6143 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:33.373689 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507cdb3c-23ec-4443-acdb-7b800c2946cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:33.374338 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507cdb3c-23ec-4443-acdb-7b800c2946cf None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:33.374610 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507cdb3c-23ec-4443-acdb-7b800c2946cf None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:33.374880 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507cdb3c-23ec-4443-acdb-7b800c2946cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:33.386705 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507cdb3c-23ec-4443-acdb-7b800c2946cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:11:33.391659 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-507cdb3c-23ec-4443-acdb-7b800c2946cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 13:11:33.391659 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:11:33.391659 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:11:33.391659 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:11:33.391659 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:11:33.391659 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:11:33.391659 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:11:33.391659 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:11:33.391659 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:11:33.391659 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:11:33.391659 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:11:33.391659 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:11:33.391659 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:11:33.391659 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:11:33.391659 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:11:33.391659 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:11:33.392565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:11:33.392565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:11:33.392565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:11:33.392565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:11:33.392565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:11:33.392565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:11:33.392565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:11:33.392565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:11:33.392565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:11:33.392565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:11:33.392565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:11:33.392565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:11:33.392565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:11:33.392565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:11:33.392565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:11:33.392565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:11:33.393508 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:11:33.393508 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:11:33.393508 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:11:33.393508 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:11:33.393508 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:11:33.393508 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:11:33.393508 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:11:33.393508 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:11:33.393508 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:11:33.393508 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:11:33.393508 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 13:11:33.393508 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:11:33.393508 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 36/67] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Oct 27 13:11:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:11:33.394792 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507cdb3c-23ec-4443-acdb-7b800c2946cf None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:33.440788 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d6307-d853-438b-ba88-5e853b133893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:33.441398 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d6307-d853-438b-ba88-5e853b133893 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:33.441711 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d6307-d853-438b-ba88-5e853b133893 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:33.441987 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d6307-d853-438b-ba88-5e853b133893 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:33.442728 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d6307-d853-438b-ba88-5e853b133893 None admin] RBAC: Adding query filter params (name=member) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:11:33.443033 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d6307-d853-438b-ba88-5e853b133893 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:33.444424 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d6307-d853-438b-ba88-5e853b133893 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:33.452707 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 32/68] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Oct 27 13:11:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:33.453492 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d6307-d853-438b-ba88-5e853b133893 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:33.467148 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:33.497848 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:33.500924 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507cdb3c-23ec-4443-acdb-7b800c2946cf None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:33.536183 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f701238-60da-45d9-aff1-d5b480845942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:33.536951 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f701238-60da-45d9-aff1-d5b480845942 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:33.537232 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f701238-60da-45d9-aff1-d5b480845942 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:33.537507 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f701238-60da-45d9-aff1-d5b480845942 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:33.538202 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f701238-60da-45d9-aff1-d5b480845942 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:11:33.538506 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f701238-60da-45d9-aff1-d5b480845942 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:33.539960 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f701238-60da-45d9-aff1-d5b480845942 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:33.548262 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 37/69] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Oct 27 13:11:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:33.549399 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913620e7-55fd-4463-b9d0-cf4269b912c7 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:33.549687 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913620e7-55fd-4463-b9d0-cf4269b912c7 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:33.550024 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913620e7-55fd-4463-b9d0-cf4269b912c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:33.551691 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d6307-d853-438b-ba88-5e853b133893 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:33.567609 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-913620e7-55fd-4463-b9d0-cf4269b912c7 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:11:33.568930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-913620e7-55fd-4463-b9d0-cf4269b912c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:11:33.585464 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0afdc65-dac1-4623-935d-634a4f023980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:33.586077 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afdc65-dac1-4623-935d-634a4f023980 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:33.586376 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afdc65-dac1-4623-935d-634a4f023980 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:33.586643 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afdc65-dac1-4623-935d-634a4f023980 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:33.587297 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0afdc65-dac1-4623-935d-634a4f023980 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:11:33.587598 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0afdc65-dac1-4623-935d-634a4f023980 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:33.588944 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0afdc65-dac1-4623-935d-634a4f023980 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:33.597099 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 33/70] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Oct 27 13:11:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:33.597901 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0afdc65-dac1-4623-935d-634a4f023980 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:33.636255 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 38/71] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:11:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:11:33.637378 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913620e7-55fd-4463-b9d0-cf4269b912c7 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:33.705686 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0afdc65-dac1-4623-935d-634a4f023980 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:33.712812 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:33.717386 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:33.740286 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8467c-b72b-427e-9fa1-1c162210c80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:33.740905 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8467c-b72b-427e-9fa1-1c162210c80c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:33.741182 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8467c-b72b-427e-9fa1-1c162210c80c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:33.741433 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8467c-b72b-427e-9fa1-1c162210c80c None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:33.742155 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f8467c-b72b-427e-9fa1-1c162210c80c None admin] RBAC: Adding query filter params (name=member) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:11:33.742457 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f8467c-b72b-427e-9fa1-1c162210c80c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:33.743856 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f8467c-b72b-427e-9fa1-1c162210c80c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:33.756708 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 34/72] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Oct 27 13:11:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:33.756708 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8467c-b72b-427e-9fa1-1c162210c80c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:33.769991 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913620e7-55fd-4463-b9d0-cf4269b912c7 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:33.811731 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d85ea-e66e-472e-8a9d-fc61b952f15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:33.812426 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d85ea-e66e-472e-8a9d-fc61b952f15a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:33.812708 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d85ea-e66e-472e-8a9d-fc61b952f15a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:33.812977 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d85ea-e66e-472e-8a9d-fc61b952f15a None admin] PATH_INFO: `/v3/users/6ca43f74f2354a7c8dd7ef9c59bdc801` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:33.827913 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213d85ea-e66e-472e-8a9d-fc61b952f15a None admin] RBAC: Authorizing `identity:get_user(user_id=6ca43f74f2354a7c8dd7ef9c59bdc801)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:33.829924 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213d85ea-e66e-472e-8a9d-fc61b952f15a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:33.831799 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 39/73] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Oct 27 13:11:33 2022] GET /identity/v3/users/6ca43f74f2354a7c8dd7ef9c59bdc801 => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:33.832540 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d85ea-e66e-472e-8a9d-fc61b952f15a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:33.863814 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8467c-b72b-427e-9fa1-1c162210c80c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:33.902795 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c31400-442a-456b-bbc9-07032e3804ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:33.903707 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c31400-442a-456b-bbc9-07032e3804ef None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:33.903993 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c31400-442a-456b-bbc9-07032e3804ef None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:33.904270 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c31400-442a-456b-bbc9-07032e3804ef None admin] PATH_INFO: `/v3/users/cc57ef7f9089496cb07d829e5172cc92` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:33.905415 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c31400-442a-456b-bbc9-07032e3804ef None admin] RBAC: Authorizing `identity:get_user(user_id=cc57ef7f9089496cb07d829e5172cc92)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:33.906945 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c31400-442a-456b-bbc9-07032e3804ef None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:33.908539 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 35/74] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Oct 27 13:11:33 2022] GET /identity/v3/users/cc57ef7f9089496cb07d829e5172cc92 => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:33.909301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c31400-442a-456b-bbc9-07032e3804ef None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:33.935283 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d85ea-e66e-472e-8a9d-fc61b952f15a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:33.944828 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:33.953712 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:33.970101 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a877b4-1cf9-4353-84c5-baee4038fcc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:33.970738 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a877b4-1cf9-4353-84c5-baee4038fcc6 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:33.971021 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a877b4-1cf9-4353-84c5-baee4038fcc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:33.971295 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a877b4-1cf9-4353-84c5-baee4038fcc6 None admin] PATH_INFO: `/v3/users/6ca43f74f2354a7c8dd7ef9c59bdc801` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:33.972409 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a877b4-1cf9-4353-84c5-baee4038fcc6 None admin] RBAC: Authorizing `identity:get_user(user_id=6ca43f74f2354a7c8dd7ef9c59bdc801)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:33.973938 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a877b4-1cf9-4353-84c5-baee4038fcc6 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:33.975536 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 40/75] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Oct 27 13:11:33 2022] GET /identity/v3/users/6ca43f74f2354a7c8dd7ef9c59bdc801 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:33.976295 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a877b4-1cf9-4353-84c5-baee4038fcc6 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:34.012430 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c31400-442a-456b-bbc9-07032e3804ef None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:34.045287 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f05286-bddd-4f0a-bf37-8644c0f28f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:34.045947 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f05286-bddd-4f0a-bf37-8644c0f28f2d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:34.046226 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f05286-bddd-4f0a-bf37-8644c0f28f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:34.046505 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f05286-bddd-4f0a-bf37-8644c0f28f2d None admin] PATH_INFO: `/v3/users/6ca43f74f2354a7c8dd7ef9c59bdc801` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:34.047638 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f05286-bddd-4f0a-bf37-8644c0f28f2d None admin] RBAC: Authorizing `identity:get_user(user_id=6ca43f74f2354a7c8dd7ef9c59bdc801)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:34.049086 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f05286-bddd-4f0a-bf37-8644c0f28f2d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:34.050697 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 36/76] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Oct 27 13:11:33 2022] GET /identity/v3/users/6ca43f74f2354a7c8dd7ef9c59bdc801 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:34.051458 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f05286-bddd-4f0a-bf37-8644c0f28f2d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:34.080175 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a877b4-1cf9-4353-84c5-baee4038fcc6 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:34.113933 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca41294-8926-4e60-8453-9c94b57a7ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:34.114605 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca41294-8926-4e60-8453-9c94b57a7ccc None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:34.114884 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca41294-8926-4e60-8453-9c94b57a7ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:34.115153 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca41294-8926-4e60-8453-9c94b57a7ccc None admin] PATH_INFO: `/v3/projects/9a7e52ec5fb64c04a51ab3c08adf1d8b` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:34.116252 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca41294-8926-4e60-8453-9c94b57a7ccc None admin] RBAC: Authorizing `identity:get_project(project_id=9a7e52ec5fb64c04a51ab3c08adf1d8b)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:34.117774 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca41294-8926-4e60-8453-9c94b57a7ccc None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:34.119417 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 41/77] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Oct 27 13:11:33 2022] GET /identity/v3/projects/9a7e52ec5fb64c04a51ab3c08adf1d8b => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:34.120169 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca41294-8926-4e60-8453-9c94b57a7ccc None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:34.154709 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f05286-bddd-4f0a-bf37-8644c0f28f2d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:34.157124 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:34.175841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:34.191428 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6992df6-cb7a-4bb8-b5c7-dd0c3a7d173f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:34.192046 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6992df6-cb7a-4bb8-b5c7-dd0c3a7d173f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:34.192345 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6992df6-cb7a-4bb8-b5c7-dd0c3a7d173f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:34.192811 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6992df6-cb7a-4bb8-b5c7-dd0c3a7d173f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:34.193954 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6992df6-cb7a-4bb8-b5c7-dd0c3a7d173f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:34.195403 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6992df6-cb7a-4bb8-b5c7-dd0c3a7d173f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:34.201437 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 37/78] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:11:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:34.201437 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6992df6-cb7a-4bb8-b5c7-dd0c3a7d173f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:34.222216 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca41294-8926-4e60-8453-9c94b57a7ccc None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:34.257088 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b75594-0e47-4205-9cfa-7119e817ff0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:34.257799 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b75594-0e47-4205-9cfa-7119e817ff0e None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:34.258081 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b75594-0e47-4205-9cfa-7119e817ff0e None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:34.258369 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b75594-0e47-4205-9cfa-7119e817ff0e None admin] PATH_INFO: `/v3/projects/9a7e52ec5fb64c04a51ab3c08adf1d8b` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:34.259497 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b75594-0e47-4205-9cfa-7119e817ff0e None admin] RBAC: Authorizing `identity:get_project(project_id=9a7e52ec5fb64c04a51ab3c08adf1d8b)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:34.260981 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b75594-0e47-4205-9cfa-7119e817ff0e None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:34.262693 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 42/79] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Oct 27 13:11:34 2022] GET /identity/v3/projects/9a7e52ec5fb64c04a51ab3c08adf1d8b => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:34.263453 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b75594-0e47-4205-9cfa-7119e817ff0e None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:34.301456 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6992df6-cb7a-4bb8-b5c7-dd0c3a7d173f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:34.335518 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c473393c-198b-46cf-8738-152e17cb3f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:34.336086 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473393c-198b-46cf-8738-152e17cb3f58 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:34.336370 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473393c-198b-46cf-8738-152e17cb3f58 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:34.336644 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473393c-198b-46cf-8738-152e17cb3f58 None admin] PATH_INFO: `/v3/projects/9a7e52ec5fb64c04a51ab3c08adf1d8b` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:34.337816 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c473393c-198b-46cf-8738-152e17cb3f58 None admin] RBAC: Authorizing `identity:get_project(project_id=9a7e52ec5fb64c04a51ab3c08adf1d8b)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:34.339266 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c473393c-198b-46cf-8738-152e17cb3f58 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:34.340902 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 38/80] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Oct 27 13:11:34 2022] GET /identity/v3/projects/9a7e52ec5fb64c04a51ab3c08adf1d8b => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:34.342353 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c473393c-198b-46cf-8738-152e17cb3f58 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:34.365523 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b75594-0e47-4205-9cfa-7119e817ff0e None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:34.385874 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:34.390041 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:34.401923 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be58cb2-cc4e-49cf-991d-19c8d1474d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:34.402562 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be58cb2-cc4e-49cf-991d-19c8d1474d07 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:34.402851 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be58cb2-cc4e-49cf-991d-19c8d1474d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:34.403128 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be58cb2-cc4e-49cf-991d-19c8d1474d07 None admin] PATH_INFO: `/v3/projects/cb6937ae98284c6fa35433e11e2d1f93` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:34.404266 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be58cb2-cc4e-49cf-991d-19c8d1474d07 None admin] RBAC: Authorizing `identity:get_project(project_id=cb6937ae98284c6fa35433e11e2d1f93)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:34.405803 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be58cb2-cc4e-49cf-991d-19c8d1474d07 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:34.407470 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 43/81] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Oct 27 13:11:34 2022] GET /identity/v3/projects/cb6937ae98284c6fa35433e11e2d1f93 => generated 312 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:34.408206 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be58cb2-cc4e-49cf-991d-19c8d1474d07 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:34.447681 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c473393c-198b-46cf-8738-152e17cb3f58 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:34.480787 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26cfc61-2dc8-471a-9c83-554bb7074116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:34.481452 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cfc61-2dc8-471a-9c83-554bb7074116 None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:34.481766 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cfc61-2dc8-471a-9c83-554bb7074116 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:34.482043 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cfc61-2dc8-471a-9c83-554bb7074116 None admin] PATH_INFO: `/v3/projects/9a7e52ec5fb64c04a51ab3c08adf1d8b/users/6ca43f74f2354a7c8dd7ef9c59bdc801/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:34.484934 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26cfc61-2dc8-471a-9c83-554bb7074116 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a7e52ec5fb64c04a51ab3c08adf1d8b, user_id=6ca43f74f2354a7c8dd7ef9c59bdc801, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:34.486420 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26cfc61-2dc8-471a-9c83-554bb7074116 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:34.503099 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 39/82] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Oct 27 13:11:34 2022] PUT /identity/v3/projects/9a7e52ec5fb64c04a51ab3c08adf1d8b/users/6ca43f74f2354a7c8dd7ef9c59bdc801/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:11:34.503902 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26cfc61-2dc8-471a-9c83-554bb7074116 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:34.519990 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be58cb2-cc4e-49cf-991d-19c8d1474d07 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:34.562749 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223e366-5a3a-4ca9-bafe-6ae656702e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:34.563377 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223e366-5a3a-4ca9-bafe-6ae656702e0d None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:34.563636 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223e366-5a3a-4ca9-bafe-6ae656702e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:34.563925 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223e366-5a3a-4ca9-bafe-6ae656702e0d None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:34.564600 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3223e366-5a3a-4ca9-bafe-6ae656702e0d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:34.566169 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3223e366-5a3a-4ca9-bafe-6ae656702e0d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:34.589853 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 44/83] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Oct 27 13:11:34 2022] POST /identity/v3/users => generated 289 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:11:34.590417 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223e366-5a3a-4ca9-bafe-6ae656702e0d None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:34.651232 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:34.664404 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:34.667992 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26cfc61-2dc8-471a-9c83-554bb7074116 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:34.720241 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39c4bfb-7c8c-40d6-8cee-3d08343693a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:34.720932 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c4bfb-7c8c-40d6-8cee-3d08343693a3 None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:34.721210 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c4bfb-7c8c-40d6-8cee-3d08343693a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:34.721482 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c4bfb-7c8c-40d6-8cee-3d08343693a3 None admin] PATH_INFO: `/v3/projects/9a7e52ec5fb64c04a51ab3c08adf1d8b/users/cc57ef7f9089496cb07d829e5172cc92/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:34.721749 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223e366-5a3a-4ca9-bafe-6ae656702e0d None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:34.724119 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39c4bfb-7c8c-40d6-8cee-3d08343693a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a7e52ec5fb64c04a51ab3c08adf1d8b, user_id=cc57ef7f9089496cb07d829e5172cc92, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:34.726810 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39c4bfb-7c8c-40d6-8cee-3d08343693a3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:34.751001 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 40/84] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Oct 27 13:11:34 2022] PUT /identity/v3/projects/9a7e52ec5fb64c04a51ab3c08adf1d8b/users/cc57ef7f9089496cb07d829e5172cc92/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:11:34.751614 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39c4bfb-7c8c-40d6-8cee-3d08343693a3 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:34.800667 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248b22d-57bd-4821-85e5-afbef4154843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:34.800667 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248b22d-57bd-4821-85e5-afbef4154843 None admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:34.800667 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248b22d-57bd-4821-85e5-afbef4154843 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:34.800667 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248b22d-57bd-4821-85e5-afbef4154843 None admin] PATH_INFO: `/v3/projects/9a7e52ec5fb64c04a51ab3c08adf1d8b/users/6ca43f74f2354a7c8dd7ef9c59bdc801/roles/5db0b376b1b047f6bdc42dc784aa1ba9` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:34.802993 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248b22d-57bd-4821-85e5-afbef4154843 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a7e52ec5fb64c04a51ab3c08adf1d8b, user_id=6ca43f74f2354a7c8dd7ef9c59bdc801, role_id=5db0b376b1b047f6bdc42dc784aa1ba9)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:34.809562 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248b22d-57bd-4821-85e5-afbef4154843 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:34.828301 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 45/85] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Oct 27 13:11:34 2022] PUT /identity/v3/projects/9a7e52ec5fb64c04a51ab3c08adf1d8b/users/6ca43f74f2354a7c8dd7ef9c59bdc801/roles/5db0b376b1b047f6bdc42dc784aa1ba9 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:11:34.922137 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39c4bfb-7c8c-40d6-8cee-3d08343693a3 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:34.967511 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68783f70-629b-45a1-872d-ea6820ba31ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:34.968596 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68783f70-629b-45a1-872d-ea6820ba31ed None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:34.969070 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68783f70-629b-45a1-872d-ea6820ba31ed None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:34.969569 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68783f70-629b-45a1-872d-ea6820ba31ed None admin] PATH_INFO: `/v3/projects/cb6937ae98284c6fa35433e11e2d1f93/users/6ca43f74f2354a7c8dd7ef9c59bdc801/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:34.971860 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68783f70-629b-45a1-872d-ea6820ba31ed None admin] RBAC: Authorizing `identity:create_grant(project_id=cb6937ae98284c6fa35433e11e2d1f93, user_id=6ca43f74f2354a7c8dd7ef9c59bdc801, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:34.973608 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68783f70-629b-45a1-872d-ea6820ba31ed None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:34.988981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 41/86] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Oct 27 13:11:34 2022] PUT /identity/v3/projects/cb6937ae98284c6fa35433e11e2d1f93/users/6ca43f74f2354a7c8dd7ef9c59bdc801/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:11:37.169362 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7facee2-67c6-4281-bb22-18c8e0d4d11b None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:37.170358 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7facee2-67c6-4281-bb22-18c8e0d4d11b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:37.170834 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7facee2-67c6-4281-bb22-18c8e0d4d11b None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:37.172487 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 46/87] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:11:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:11:37.178073 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b899a9c-c9ba-4ad6-9c5b-78696c823fce None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:37.178880 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b899a9c-c9ba-4ad6-9c5b-78696c823fce None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:37.179345 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b899a9c-c9ba-4ad6-9c5b-78696c823fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:37.205870 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-4b899a9c-c9ba-4ad6-9c5b-78696c823fce None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:11:37.207392 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4b899a9c-c9ba-4ad6-9c5b-78696c823fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:11:37.224702 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:37.293768 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 42/88] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:11:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:11:37.829466 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7facee2-67c6-4281-bb22-18c8e0d4d11b None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:37.840925 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470989af-4ade-4756-bb77-dbb24cd5604b None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:37.843265 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470989af-4ade-4756-bb77-dbb24cd5604b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:37.843738 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470989af-4ade-4756-bb77-dbb24cd5604b None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:37.845312 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 43/89] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:11:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:11:37.852070 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772dde67-358a-4e03-b142-3393599580da None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:37.853284 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772dde67-358a-4e03-b142-3393599580da None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:37.853968 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772dde67-358a-4e03-b142-3393599580da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:37.890988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-772dde67-358a-4e03-b142-3393599580da None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:11:37.893295 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-772dde67-358a-4e03-b142-3393599580da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:11:38.046078 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7facee2-67c6-4281-bb22-18c8e0d4d11b None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:38.055806 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:38.088495 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 44/90] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:11:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:11:38.090215 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc96b3-abe5-412e-8c86-98d4f8986fb1 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:38.090318 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528dff03-6217-4ebe-888f-ee42aa14e30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:38.090826 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc96b3-abe5-412e-8c86-98d4f8986fb1 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:38.090923 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528dff03-6217-4ebe-888f-ee42aa14e30d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:38.091128 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528dff03-6217-4ebe-888f-ee42aa14e30d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:38.091400 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528dff03-6217-4ebe-888f-ee42aa14e30d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:38.091754 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc96b3-abe5-412e-8c86-98d4f8986fb1 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:38.093578 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 45/91] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:11:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:11:38.099197 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a440e-b1cf-474b-b3f0-7765c73b2999 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:38.099714 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a440e-b1cf-474b-b3f0-7765c73b2999 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:38.100157 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a440e-b1cf-474b-b3f0-7765c73b2999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:38.103080 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528dff03-6217-4ebe-888f-ee42aa14e30d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:11:38.108646 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-528dff03-6217-4ebe-888f-ee42aa14e30d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 13:11:38.108646 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:11:38.108646 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:11:38.108646 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:11:38.108646 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:11:38.108646 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:11:38.108646 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:11:38.108646 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:11:38.108646 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:11:38.108646 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:11:38.108646 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:11:38.108646 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:11:38.108646 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:11:38.108646 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:11:38.108646 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:11:38.108646 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:11:38.109526 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:11:38.109526 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:11:38.109526 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:11:38.109526 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:11:38.109526 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:11:38.109526 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:11:38.109526 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:11:38.109526 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:11:38.109526 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:11:38.109526 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:11:38.109526 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:11:38.109526 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:11:38.109526 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:11:38.109526 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:11:38.109526 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:11:38.109526 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:11:38.110320 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:11:38.110320 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:11:38.110320 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:11:38.110320 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:11:38.110320 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:11:38.110320 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:11:38.110320 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:11:38.110320 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:11:38.110320 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:11:38.110320 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:11:38.110320 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 13:11:38.110320 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:11:38.110320 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 47/92] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Oct 27 13:11:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:11:38.111479 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b20a61-8221-47f5-b84b-99e0aa5d1534 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:38.111678 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b20a61-8221-47f5-b84b-99e0aa5d1534 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:38.111954 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b20a61-8221-47f5-b84b-99e0aa5d1534 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:38.117569 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 48/93] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:11:38.117569 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b20a61-8221-47f5-b84b-99e0aa5d1534 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:38.129428 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d27a440e-b1cf-474b-b3f0-7765c73b2999 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:11:38.131091 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d27a440e-b1cf-474b-b3f0-7765c73b2999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:11:38.224186 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b20a61-8221-47f5-b84b-99e0aa5d1534 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:38.230666 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 46/94] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:11:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 13:11:38.232567 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348fa93-3e8f-4e40-9778-f4873f7b9e9d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:38.233078 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348fa93-3e8f-4e40-9778-f4873f7b9e9d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:38.233614 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348fa93-3e8f-4e40-9778-f4873f7b9e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:38.253077 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-3348fa93-3e8f-4e40-9778-f4873f7b9e9d None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:11:38.254806 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3348fa93-3e8f-4e40-9778-f4873f7b9e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:11:38.260010 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa0717-3bbb-4331-b0cb-eb58e0667b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:38.260716 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa0717-3bbb-4331-b0cb-eb58e0667b96 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:38.261002 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa0717-3bbb-4331-b0cb-eb58e0667b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:38.261276 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa0717-3bbb-4331-b0cb-eb58e0667b96 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:38.261974 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa0717-3bbb-4331-b0cb-eb58e0667b96 None admin] RBAC: Adding query filter params (name=member) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:11:38.262276 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa0717-3bbb-4331-b0cb-eb58e0667b96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:38.263726 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa0717-3bbb-4331-b0cb-eb58e0667b96 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:38.280629 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 49/95] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Oct 27 13:11:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:11:38.285875 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:38.286072 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5a15a-edc3-4f93-ae8b-9417b2d1595e None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:38.286072 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5a15a-edc3-4f93-ae8b-9417b2d1595e None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:38.286072 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5a15a-edc3-4f93-ae8b-9417b2d1595e None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:38.289817 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 50/96] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:11:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:11:38.295230 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5a15a-edc3-4f93-ae8b-9417b2d1595e None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:38.344143 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 47/97] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:11:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:11:38.345775 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2edb1-a2cf-4eb2-87b2-deb6aa2cf96d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:38.346280 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2edb1-a2cf-4eb2-87b2-deb6aa2cf96d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:38.346746 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2edb1-a2cf-4eb2-87b2-deb6aa2cf96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:38.351876 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:38.368876 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-92e2edb1-a2cf-4eb2-87b2-deb6aa2cf96d None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:11:38.370529 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-92e2edb1-a2cf-4eb2-87b2-deb6aa2cf96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:11:38.444803 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 48/98] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:11:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:11:38.446169 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2edb1-a2cf-4eb2-87b2-deb6aa2cf96d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:38.521065 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5a15a-edc3-4f93-ae8b-9417b2d1595e None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:38.555977 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6d6ed-c927-45d6-8c92-343e05e8fae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:38.556614 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6d6ed-c927-45d6-8c92-343e05e8fae7 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:38.556895 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6d6ed-c927-45d6-8c92-343e05e8fae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:38.557168 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6d6ed-c927-45d6-8c92-343e05e8fae7 None admin] PATH_INFO: `/v3/users/6ca43f74f2354a7c8dd7ef9c59bdc801` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:38.558795 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea6d6ed-c927-45d6-8c92-343e05e8fae7 None admin] RBAC: Authorizing `identity:get_user(user_id=6ca43f74f2354a7c8dd7ef9c59bdc801)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:38.560318 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea6d6ed-c927-45d6-8c92-343e05e8fae7 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:38.562152 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 51/99] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Oct 27 13:11:38 2022] GET /identity/v3/users/6ca43f74f2354a7c8dd7ef9c59bdc801 => generated 275 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:38.563332 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c6a80-f44b-4832-96cf-b2c28f5b0091 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:38.563615 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c6a80-f44b-4832-96cf-b2c28f5b0091 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:38.563894 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c6a80-f44b-4832-96cf-b2c28f5b0091 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:38.565108 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 52/100] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:11:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:11:38.570280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c6a80-f44b-4832-96cf-b2c28f5b0091 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:38.595973 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:38.643589 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2edb1-a2cf-4eb2-87b2-deb6aa2cf96d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:38.682985 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47563ea7-abae-49e5-83ab-02ec981956ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:38.683613 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47563ea7-abae-49e5-83ab-02ec981956ac None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:38.683933 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47563ea7-abae-49e5-83ab-02ec981956ac None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:38.684157 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47563ea7-abae-49e5-83ab-02ec981956ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:38.685250 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47563ea7-abae-49e5-83ab-02ec981956ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:38.686738 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47563ea7-abae-49e5-83ab-02ec981956ac None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:38.689688 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 49/101] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:11:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:38.689688 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb5a9e-b29f-4c2d-95ce-3ff0760a91c7 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:38.689688 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb5a9e-b29f-4c2d-95ce-3ff0760a91c7 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:38.689958 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb5a9e-b29f-4c2d-95ce-3ff0760a91c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:38.698435 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:38.706250 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c6a80-f44b-4832-96cf-b2c28f5b0091 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:38.709220 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-2ecb5a9e-b29f-4c2d-95ce-3ff0760a91c7 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:11:38.709787 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2ecb5a9e-b29f-4c2d-95ce-3ff0760a91c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:11:38.741731 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ef6b2-b0cb-46ac-aad1-87771a129568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:38.742338 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ef6b2-b0cb-46ac-aad1-87771a129568 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:38.742611 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ef6b2-b0cb-46ac-aad1-87771a129568 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:38.742933 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ef6b2-b0cb-46ac-aad1-87771a129568 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:38.776061 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 50/102] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:11:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:11:38.776899 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb5a9e-b29f-4c2d-95ce-3ff0760a91c7 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:38.819325 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ef6b2-b0cb-46ac-aad1-87771a129568 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:38.820902 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ef6b2-b0cb-46ac-aad1-87771a129568 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:38.852583 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:38.887505 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb5a9e-b29f-4c2d-95ce-3ff0760a91c7 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:38.921499 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:38.921719 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4013bcb-758d-4081-9a26-b2775fec4e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:38.922266 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4013bcb-758d-4081-9a26-b2775fec4e78 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:38.922553 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4013bcb-758d-4081-9a26-b2775fec4e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:38.922814 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4013bcb-758d-4081-9a26-b2775fec4e78 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:38.930610 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 53/103] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Oct 27 13:11:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 13:11:38.932022 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ef6b2-b0cb-46ac-aad1-87771a129568 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:38.934019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4013bcb-758d-4081-9a26-b2775fec4e78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:11:38.939150 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-b4013bcb-758d-4081-9a26-b2775fec4e78 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 13:11:38.939150 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:11:38.939150 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:11:38.939150 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:11:38.939150 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:11:38.939150 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:11:38.939150 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:11:38.939150 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:11:38.939150 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:11:38.939150 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:11:38.939150 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:11:38.939150 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:11:38.939150 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:11:38.939150 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:11:38.939150 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:11:38.939150 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:11:38.940276 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:11:38.940276 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:11:38.940276 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:11:38.940276 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:11:38.940276 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:11:38.940276 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:11:38.940276 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:11:38.940276 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:11:38.940276 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:11:38.940276 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:11:38.940276 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:11:38.940276 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:11:38.940276 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:11:38.940276 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:11:38.940276 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:11:38.940276 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:11:38.941018 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:11:38.941018 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:11:38.941018 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:11:38.941018 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:11:38.941018 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:11:38.941018 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:11:38.941018 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:11:38.941018 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:11:38.941018 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:11:38.941018 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:11:38.941018 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 13:11:38.941018 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:11:38.941018 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 51/104] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Oct 27 13:11:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:11:38.941018 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4013bcb-758d-4081-9a26-b2775fec4e78 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:39.039743 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ef6b2-b0cb-46ac-aad1-87771a129568 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:39.047750 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4013bcb-758d-4081-9a26-b2775fec4e78 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:39.073745 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af489756-7dae-4c03-aa3d-0d44519fa0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:39.074379 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af489756-7dae-4c03-aa3d-0d44519fa0ba None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:39.074478 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:39.074659 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af489756-7dae-4c03-aa3d-0d44519fa0ba None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:39.074940 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af489756-7dae-4c03-aa3d-0d44519fa0ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:39.082234 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5babc6-b23a-4482-b248-cb20e8bc7b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:39.082906 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5babc6-b23a-4482-b248-cb20e8bc7b1c None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:39.083273 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5babc6-b23a-4482-b248-cb20e8bc7b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:39.083553 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5babc6-b23a-4482-b248-cb20e8bc7b1c None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:39.084199 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5babc6-b23a-4482-b248-cb20e8bc7b1c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:39.085384 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af489756-7dae-4c03-aa3d-0d44519fa0ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:11:39.085693 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5babc6-b23a-4482-b248-cb20e8bc7b1c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:39.090291 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-af489756-7dae-4c03-aa3d-0d44519fa0ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:11:39.090291 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:11:39.090291 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:11:39.090291 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:11:39.090291 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:11:39.090291 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:11:39.090291 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:11:39.090291 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:11:39.090291 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:11:39.090291 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:11:39.090291 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:11:39.090291 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:11:39.090291 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:11:39.090291 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:11:39.090291 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:11:39.090291 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:11:39.091264 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:11:39.091264 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:11:39.091264 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:11:39.091264 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:11:39.091264 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:11:39.091264 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:11:39.091264 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:11:39.091264 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:11:39.091264 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:11:39.091264 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:11:39.091264 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:11:39.091264 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:11:39.091264 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:11:39.091264 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:11:39.091264 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:11:39.091264 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:11:39.093747 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:11:39.093747 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:11:39.093747 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:11:39.093747 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:11:39.093747 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:11:39.093747 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:11:39.093747 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:11:39.093747 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:11:39.093747 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:11:39.093747 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:11:39.093747 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:11:39.093747 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:11:39.093747 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 54/105] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Oct 27 13:11:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:11:39.093747 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af489756-7dae-4c03-aa3d-0d44519fa0ba None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:39.114109 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 52/106] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Oct 27 13:11:38 2022] POST /identity/v3/projects => generated 302 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:11:39.114940 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5babc6-b23a-4482-b248-cb20e8bc7b1c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:39.179485 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:39.224334 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5babc6-b23a-4482-b248-cb20e8bc7b1c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:39.235341 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af489756-7dae-4c03-aa3d-0d44519fa0ba None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:39.269789 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e057505-de81-4bee-b2aa-b7197a7ed8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:39.271415 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e057505-de81-4bee-b2aa-b7197a7ed8ac None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:39.271888 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e057505-de81-4bee-b2aa-b7197a7ed8ac None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:39.272348 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e057505-de81-4bee-b2aa-b7197a7ed8ac None admin] PATH_INFO: `/v3/projects/9a7e52ec5fb64c04a51ab3c08adf1d8b` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:39.273084 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929cc02-5a9b-480c-8f27-c7a29ddfea27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:39.273766 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929cc02-5a9b-480c-8f27-c7a29ddfea27 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:39.274038 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929cc02-5a9b-480c-8f27-c7a29ddfea27 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:39.274307 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929cc02-5a9b-480c-8f27-c7a29ddfea27 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:39.274610 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e057505-de81-4bee-b2aa-b7197a7ed8ac None admin] RBAC: Authorizing `identity:get_project(project_id=9a7e52ec5fb64c04a51ab3c08adf1d8b)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:39.276464 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e057505-de81-4bee-b2aa-b7197a7ed8ac None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:39.278863 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 53/107] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Oct 27 13:11:39 2022] GET /identity/v3/projects/9a7e52ec5fb64c04a51ab3c08adf1d8b => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:39.279900 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e057505-de81-4bee-b2aa-b7197a7ed8ac None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:39.291489 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929cc02-5a9b-480c-8f27-c7a29ddfea27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:11:39.296332 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-6929cc02-5a9b-480c-8f27-c7a29ddfea27 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 13:11:39.296332 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:11:39.296332 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:11:39.296332 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:11:39.296332 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:11:39.296332 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:11:39.296332 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:11:39.296332 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:11:39.296332 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:11:39.296332 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:11:39.296332 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:11:39.296332 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:11:39.296332 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:11:39.296332 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:11:39.296332 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:11:39.296332 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:11:39.297392 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:11:39.297392 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:11:39.297392 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:11:39.297392 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:11:39.297392 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:11:39.297392 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:11:39.297392 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:11:39.297392 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:11:39.297392 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:11:39.297392 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:11:39.297392 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:11:39.297392 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:11:39.297392 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:11:39.297392 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:11:39.297392 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:11:39.297392 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:11:39.298226 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:11:39.298226 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:11:39.298226 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:11:39.298226 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:11:39.298226 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:11:39.298226 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:11:39.298226 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:11:39.298226 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:11:39.298226 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:11:39.298226 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:11:39.298226 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 13:11:39.298226 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:11:39.298226 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 55/108] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Oct 27 13:11:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:11:39.298848 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929cc02-5a9b-480c-8f27-c7a29ddfea27 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:39.337879 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:39.392767 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e057505-de81-4bee-b2aa-b7197a7ed8ac None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:39.409514 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929cc02-5a9b-480c-8f27-c7a29ddfea27 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:39.426484 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:39.429136 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60f76a-bec1-450c-82b8-afbbdb203388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:39.429927 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60f76a-bec1-450c-82b8-afbbdb203388 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:39.430194 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60f76a-bec1-450c-82b8-afbbdb203388 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:39.430470 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60f76a-bec1-450c-82b8-afbbdb203388 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:39.431166 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a60f76a-bec1-450c-82b8-afbbdb203388 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:11:39.431434 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a60f76a-bec1-450c-82b8-afbbdb203388 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:39.433134 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a60f76a-bec1-450c-82b8-afbbdb203388 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:39.442351 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 54/109] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Oct 27 13:11:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:39.447026 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60f76a-bec1-450c-82b8-afbbdb203388 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:39.450072 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c15eff-2e4c-4d02-8995-3cad92d1d9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:39.450706 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c15eff-2e4c-4d02-8995-3cad92d1d9fe None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:39.450980 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c15eff-2e4c-4d02-8995-3cad92d1d9fe None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:39.451258 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c15eff-2e4c-4d02-8995-3cad92d1d9fe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:39.462000 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c15eff-2e4c-4d02-8995-3cad92d1d9fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:11:39.466869 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-37c15eff-2e4c-4d02-8995-3cad92d1d9fe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 13:11:39.466869 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:11:39.466869 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:11:39.466869 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:11:39.466869 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:11:39.466869 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:11:39.466869 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:11:39.466869 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:11:39.466869 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:11:39.466869 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:11:39.466869 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:11:39.466869 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:11:39.466869 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:11:39.466869 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:11:39.466869 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:11:39.466869 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:11:39.467731 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:11:39.467731 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:11:39.467731 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:11:39.467731 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:11:39.467731 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:11:39.467731 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:11:39.467731 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:11:39.467731 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:11:39.467731 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:11:39.467731 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:11:39.467731 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:11:39.467731 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:11:39.467731 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:11:39.467731 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:11:39.467731 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:11:39.467731 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:11:39.468506 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:11:39.468506 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:11:39.468506 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:11:39.468506 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:11:39.468506 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:11:39.468506 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:11:39.468506 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:11:39.468506 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:11:39.468506 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:11:39.468506 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:11:39.468506 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 13:11:39.468506 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:11:39.468506 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 56/110] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Oct 27 13:11:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:11:39.469128 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c15eff-2e4c-4d02-8995-3cad92d1d9fe None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:39.564249 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60f76a-bec1-450c-82b8-afbbdb203388 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:39.574970 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:39.579408 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c15eff-2e4c-4d02-8995-3cad92d1d9fe None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:39.599681 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da31f4c-ea37-4c99-a800-4aede3607bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:39.600300 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da31f4c-ea37-4c99-a800-4aede3607bb7 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:39.600577 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da31f4c-ea37-4c99-a800-4aede3607bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:39.600848 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da31f4c-ea37-4c99-a800-4aede3607bb7 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:39.601504 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da31f4c-ea37-4c99-a800-4aede3607bb7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:11:39.601831 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da31f4c-ea37-4c99-a800-4aede3607bb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:39.603213 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da31f4c-ea37-4c99-a800-4aede3607bb7 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:39.611740 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 55/111] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Oct 27 13:11:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:39.617159 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da31f4c-ea37-4c99-a800-4aede3607bb7 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:39.620095 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7918c7-bd56-4693-9bac-fc35d91e5dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:39.621350 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7918c7-bd56-4693-9bac-fc35d91e5dee None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:39.621350 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7918c7-bd56-4693-9bac-fc35d91e5dee None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:39.621350 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7918c7-bd56-4693-9bac-fc35d91e5dee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:39.622103 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7918c7-bd56-4693-9bac-fc35d91e5dee None admin] RBAC: Adding query filter params (role.id=3a0f9a2e42334ab59845114892813223, scope.project.id=9a7e52ec5fb64c04a51ab3c08adf1d8b, user.id=6ca43f74f2354a7c8dd7ef9c59bdc801) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:11:39.622416 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7918c7-bd56-4693-9bac-fc35d91e5dee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:39.623902 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7918c7-bd56-4693-9bac-fc35d91e5dee None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:39.631188 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 57/112] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Oct 27 13:11:39 2022] GET /identity/v3/role_assignments?user.id=6ca43f74f2354a7c8dd7ef9c59bdc801&scope.project.id=9a7e52ec5fb64c04a51ab3c08adf1d8b&role.id=3a0f9a2e42334ab59845114892813223 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:39.632111 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7918c7-bd56-4693-9bac-fc35d91e5dee None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:39.681090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:39.752249 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da31f4c-ea37-4c99-a800-4aede3607bb7 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:39.757086 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7918c7-bd56-4693-9bac-fc35d91e5dee None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:39.799851 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a9122-3db1-48de-b81e-d3d980cec9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:39.800856 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a9122-3db1-48de-b81e-d3d980cec9d8 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:39.801325 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a9122-3db1-48de-b81e-d3d980cec9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:39.801882 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a9122-3db1-48de-b81e-d3d980cec9d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:39.802747 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a9122-3db1-48de-b81e-d3d980cec9d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:11:39.803958 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a9122-3db1-48de-b81e-d3d980cec9d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:39.805958 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a9122-3db1-48de-b81e-d3d980cec9d8 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:39.806065 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406794f-7559-4cc8-af0f-464abded6846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:39.806708 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406794f-7559-4cc8-af0f-464abded6846 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:39.806986 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406794f-7559-4cc8-af0f-464abded6846 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:39.807258 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406794f-7559-4cc8-af0f-464abded6846 None admin] PATH_INFO: `/v3/users/91ce1c2e028b4ddbb5f5b529387b1735` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:39.823203 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 56/113] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Oct 27 13:11:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:39.824167 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a9122-3db1-48de-b81e-d3d980cec9d8 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:39.826654 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2406794f-7559-4cc8-af0f-464abded6846 None admin] RBAC: Authorizing `identity:get_user(user_id=91ce1c2e028b4ddbb5f5b529387b1735)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:39.829196 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2406794f-7559-4cc8-af0f-464abded6846 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:39.832310 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 58/114] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Oct 27 13:11:39 2022] GET /identity/v3/users/91ce1c2e028b4ddbb5f5b529387b1735 => generated 289 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:39.836955 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406794f-7559-4cc8-af0f-464abded6846 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:39.870886 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:39.946532 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a9122-3db1-48de-b81e-d3d980cec9d8 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:39.954149 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:39.958123 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406794f-7559-4cc8-af0f-464abded6846 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:39.984397 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6615e3-6d60-4097-ae9d-1b883f99b198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:39.985744 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6615e3-6d60-4097-ae9d-1b883f99b198 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:39.986197 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6615e3-6d60-4097-ae9d-1b883f99b198 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:39.986632 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6615e3-6d60-4097-ae9d-1b883f99b198 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:39.987491 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6615e3-6d60-4097-ae9d-1b883f99b198 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:11:39.987966 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6615e3-6d60-4097-ae9d-1b883f99b198 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:39.989876 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6615e3-6d60-4097-ae9d-1b883f99b198 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:39.994827 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57669178-5ad8-48fb-b89d-be26fb84dbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:39.995464 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57669178-5ad8-48fb-b89d-be26fb84dbfb None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:39.995746 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57669178-5ad8-48fb-b89d-be26fb84dbfb None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:39.996021 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57669178-5ad8-48fb-b89d-be26fb84dbfb None admin] PATH_INFO: `/v3/users/cc57ef7f9089496cb07d829e5172cc92` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:39.997151 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57669178-5ad8-48fb-b89d-be26fb84dbfb None admin] RBAC: Authorizing `identity:get_user(user_id=cc57ef7f9089496cb07d829e5172cc92)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:39.998660 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57669178-5ad8-48fb-b89d-be26fb84dbfb None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:40.000260 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 57/116] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Oct 27 13:11:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:40.000380 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 59/116] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Oct 27 13:11:39 2022] GET /identity/v3/users/cc57ef7f9089496cb07d829e5172cc92 => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:40.001031 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57669178-5ad8-48fb-b89d-be26fb84dbfb None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:40.001481 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6615e3-6d60-4097-ae9d-1b883f99b198 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:40.104934 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:40.110925 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6615e3-6d60-4097-ae9d-1b883f99b198 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:40.111411 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57669178-5ad8-48fb-b89d-be26fb84dbfb None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:40.145119 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845190c-7380-46b1-930b-62705e4d9d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:40.145888 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845190c-7380-46b1-930b-62705e4d9d6a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:40.146173 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845190c-7380-46b1-930b-62705e4d9d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:40.146452 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845190c-7380-46b1-930b-62705e4d9d6a None admin] PATH_INFO: `/v3/users/6ca43f74f2354a7c8dd7ef9c59bdc801` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:40.146694 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfc553-9672-461a-a0d4-fcf1db07f3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:40.147326 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfc553-9672-461a-a0d4-fcf1db07f3bc None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:40.147582 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845190c-7380-46b1-930b-62705e4d9d6a None admin] RBAC: Authorizing `identity:get_user(user_id=6ca43f74f2354a7c8dd7ef9c59bdc801)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:40.147671 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfc553-9672-461a-a0d4-fcf1db07f3bc None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:40.147874 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfc553-9672-461a-a0d4-fcf1db07f3bc None admin] PATH_INFO: `/v3/projects/9a7e52ec5fb64c04a51ab3c08adf1d8b` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:40.149003 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adfc553-9672-461a-a0d4-fcf1db07f3bc None admin] RBAC: Authorizing `identity:get_project(project_id=9a7e52ec5fb64c04a51ab3c08adf1d8b)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:40.149094 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845190c-7380-46b1-930b-62705e4d9d6a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:40.150468 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adfc553-9672-461a-a0d4-fcf1db07f3bc None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:40.150863 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 60/117] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Oct 27 13:11:40 2022] GET /identity/v3/users/6ca43f74f2354a7c8dd7ef9c59bdc801 => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:40.151429 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845190c-7380-46b1-930b-62705e4d9d6a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:40.161214 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 58/118] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Oct 27 13:11:40 2022] GET /identity/v3/projects/9a7e52ec5fb64c04a51ab3c08adf1d8b => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:40.161214 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfc553-9672-461a-a0d4-fcf1db07f3bc None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:40.188041 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:40.257245 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845190c-7380-46b1-930b-62705e4d9d6a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:40.262660 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfc553-9672-461a-a0d4-fcf1db07f3bc None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:40.292927 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af8199-8ebe-44b7-9b85-72182fa211ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:40.293583 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af8199-8ebe-44b7-9b85-72182fa211ce None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:40.293869 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af8199-8ebe-44b7-9b85-72182fa211ce None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:40.294145 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af8199-8ebe-44b7-9b85-72182fa211ce None admin] PATH_INFO: `/v3/users/6ca43f74f2354a7c8dd7ef9c59bdc801` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:40.295275 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af8199-8ebe-44b7-9b85-72182fa211ce None admin] RBAC: Authorizing `identity:get_user(user_id=6ca43f74f2354a7c8dd7ef9c59bdc801)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:40.296636 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f645758-750d-4ee7-9824-a000017a6140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:40.297080 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af8199-8ebe-44b7-9b85-72182fa211ce None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:40.297240 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f645758-750d-4ee7-9824-a000017a6140 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:40.297515 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f645758-750d-4ee7-9824-a000017a6140 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:40.297813 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f645758-750d-4ee7-9824-a000017a6140 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:40.298388 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 61/119] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Oct 27 13:11:40 2022] GET /identity/v3/users/6ca43f74f2354a7c8dd7ef9c59bdc801 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:40.299143 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af8199-8ebe-44b7-9b85-72182fa211ce None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:40.333174 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:40.374424 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f645758-750d-4ee7-9824-a000017a6140 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:40.375889 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f645758-750d-4ee7-9824-a000017a6140 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:40.406443 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af8199-8ebe-44b7-9b85-72182fa211ce None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:40.408413 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:40.446138 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88cfead-c96e-43c6-b7cb-24f153b39c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:40.446860 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88cfead-c96e-43c6-b7cb-24f153b39c11 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:40.447147 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88cfead-c96e-43c6-b7cb-24f153b39c11 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:40.447422 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88cfead-c96e-43c6-b7cb-24f153b39c11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:40.480124 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 59/120] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Oct 27 13:11:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 13:11:40.480762 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f645758-750d-4ee7-9824-a000017a6140 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:40.527250 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88cfead-c96e-43c6-b7cb-24f153b39c11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:40.528670 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88cfead-c96e-43c6-b7cb-24f153b39c11 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:40.547478 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:40.588263 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f645758-750d-4ee7-9824-a000017a6140 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:40.627152 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e92244-552c-4c89-b99e-000ea215555f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:40.627815 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e92244-552c-4c89-b99e-000ea215555f None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:40.628097 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e92244-552c-4c89-b99e-000ea215555f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:40.628373 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e92244-552c-4c89-b99e-000ea215555f None admin] PATH_INFO: `/v3/projects/9a7e52ec5fb64c04a51ab3c08adf1d8b/users/91ce1c2e028b4ddbb5f5b529387b1735/roles/55046f1a884449f4a429f1f572f53ec6` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:40.628883 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 62/121] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Oct 27 13:11:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 13:11:40.630345 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e92244-552c-4c89-b99e-000ea215555f None admin] RBAC: Authorizing `identity:create_grant(project_id=9a7e52ec5fb64c04a51ab3c08adf1d8b, user_id=91ce1c2e028b4ddbb5f5b529387b1735, role_id=55046f1a884449f4a429f1f572f53ec6)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:40.631805 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e92244-552c-4c89-b99e-000ea215555f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:40.634351 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88cfead-c96e-43c6-b7cb-24f153b39c11 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:40.636662 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:40.647141 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 60/122] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Oct 27 13:11:40 2022] PUT /identity/v3/projects/9a7e52ec5fb64c04a51ab3c08adf1d8b/users/91ce1c2e028b4ddbb5f5b529387b1735/roles/55046f1a884449f4a429f1f572f53ec6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:11:40.648477 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e92244-552c-4c89-b99e-000ea215555f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:40.744582 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88cfead-c96e-43c6-b7cb-24f153b39c11 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:40.782625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76214e8-ec28-4d84-bfe4-389a655c5f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:40.783219 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76214e8-ec28-4d84-bfe4-389a655c5f30 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:40.783477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76214e8-ec28-4d84-bfe4-389a655c5f30 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:40.783753 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76214e8-ec28-4d84-bfe4-389a655c5f30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:40.808479 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e92244-552c-4c89-b99e-000ea215555f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:40.843079 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:40.860358 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa824e23-5c96-41f8-9934-09e373f623e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:40.861562 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa824e23-5c96-41f8-9934-09e373f623e8 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:40.861855 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa824e23-5c96-41f8-9934-09e373f623e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:40.862909 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa824e23-5c96-41f8-9934-09e373f623e8 None admin] PATH_INFO: `/v3/projects/9a7e52ec5fb64c04a51ab3c08adf1d8b` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:40.864099 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa824e23-5c96-41f8-9934-09e373f623e8 None admin] RBAC: Authorizing `identity:get_project(project_id=9a7e52ec5fb64c04a51ab3c08adf1d8b)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:40.865939 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa824e23-5c96-41f8-9934-09e373f623e8 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:40.867968 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 61/123] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Oct 27 13:11:40 2022] GET /identity/v3/projects/9a7e52ec5fb64c04a51ab3c08adf1d8b => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:40.869203 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa824e23-5c96-41f8-9934-09e373f623e8 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:40.871191 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76214e8-ec28-4d84-bfe4-389a655c5f30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:40.873009 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76214e8-ec28-4d84-bfe4-389a655c5f30 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:40.876078 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:40.981057 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa824e23-5c96-41f8-9934-09e373f623e8 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:41.014636 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 63/124] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Oct 27 13:11:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 13:11:41.015493 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76214e8-ec28-4d84-bfe4-389a655c5f30 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:41.021752 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a85762-b3e6-4029-b122-16b6208c825b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:41.022401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a85762-b3e6-4029-b122-16b6208c825b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:41.022684 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a85762-b3e6-4029-b122-16b6208c825b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:41.022957 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a85762-b3e6-4029-b122-16b6208c825b None admin] PATH_INFO: `/v3/projects/cb6937ae98284c6fa35433e11e2d1f93` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:41.024103 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a85762-b3e6-4029-b122-16b6208c825b None admin] RBAC: Authorizing `identity:get_project(project_id=cb6937ae98284c6fa35433e11e2d1f93)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:41.025599 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a85762-b3e6-4029-b122-16b6208c825b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:41.027468 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 62/125] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Oct 27 13:11:40 2022] GET /identity/v3/projects/cb6937ae98284c6fa35433e11e2d1f93 => generated 312 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:41.028166 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a85762-b3e6-4029-b122-16b6208c825b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:41.098105 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:41.128697 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76214e8-ec28-4d84-bfe4-389a655c5f30 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:41.130439 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:41.151403 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a85762-b3e6-4029-b122-16b6208c825b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:41.166610 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daac7cb-ef86-40ed-a6e1-d34cb898cee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:41.167279 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daac7cb-ef86-40ed-a6e1-d34cb898cee8 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:41.167565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daac7cb-ef86-40ed-a6e1-d34cb898cee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:41.167842 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daac7cb-ef86-40ed-a6e1-d34cb898cee8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:41.168675 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daac7cb-ef86-40ed-a6e1-d34cb898cee8 None admin] RBAC: Adding query filter params (role.id=93bba834c17a4aa7afdc65c002a12975, scope.project.id=9a7e52ec5fb64c04a51ab3c08adf1d8b, user.id=cc57ef7f9089496cb07d829e5172cc92) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:11:41.168991 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daac7cb-ef86-40ed-a6e1-d34cb898cee8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:41.170581 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daac7cb-ef86-40ed-a6e1-d34cb898cee8 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:41.176839 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 64/126] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Oct 27 13:11:41 2022] GET /identity/v3/role_assignments?user.id=cc57ef7f9089496cb07d829e5172cc92&scope.project.id=9a7e52ec5fb64c04a51ab3c08adf1d8b&role.id=93bba834c17a4aa7afdc65c002a12975 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:41.185997 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daac7cb-ef86-40ed-a6e1-d34cb898cee8 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:41.193073 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e0599-d75a-4317-af06-61b354bd879d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:41.193824 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e0599-d75a-4317-af06-61b354bd879d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:41.194105 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e0599-d75a-4317-af06-61b354bd879d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:41.194379 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e0599-d75a-4317-af06-61b354bd879d None admin] PATH_INFO: `/v3/projects/9a7e52ec5fb64c04a51ab3c08adf1d8b` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:41.196940 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e0599-d75a-4317-af06-61b354bd879d None admin] RBAC: Authorizing `identity:get_project(project_id=9a7e52ec5fb64c04a51ab3c08adf1d8b)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:41.198514 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e0599-d75a-4317-af06-61b354bd879d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:41.200605 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 63/127] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Oct 27 13:11:41 2022] GET /identity/v3/projects/9a7e52ec5fb64c04a51ab3c08adf1d8b => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:41.208130 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e0599-d75a-4317-af06-61b354bd879d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:41.336569 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e0599-d75a-4317-af06-61b354bd879d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:41.371124 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:41.383251 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3cffac-5d0a-4b39-af67-0aaa83779611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:41.383876 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3cffac-5d0a-4b39-af67-0aaa83779611 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:41.384164 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3cffac-5d0a-4b39-af67-0aaa83779611 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:41.385056 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3cffac-5d0a-4b39-af67-0aaa83779611 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:41.385984 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3cffac-5d0a-4b39-af67-0aaa83779611 None admin] RBAC: Adding query filter params (role.id=5db0b376b1b047f6bdc42dc784aa1ba9, scope.project.id=9a7e52ec5fb64c04a51ab3c08adf1d8b, user.id=6ca43f74f2354a7c8dd7ef9c59bdc801) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:11:41.386422 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3cffac-5d0a-4b39-af67-0aaa83779611 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:41.388213 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3cffac-5d0a-4b39-af67-0aaa83779611 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:41.398838 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daac7cb-ef86-40ed-a6e1-d34cb898cee8 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:41.399910 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 64/128] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Oct 27 13:11:41 2022] GET /identity/v3/role_assignments?user.id=6ca43f74f2354a7c8dd7ef9c59bdc801&scope.project.id=9a7e52ec5fb64c04a51ab3c08adf1d8b&role.id=5db0b376b1b047f6bdc42dc784aa1ba9 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:11:41.411806 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba69917-525d-4d21-b8a0-50f2868e2239 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:41.412121 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba69917-525d-4d21-b8a0-50f2868e2239 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:41.412372 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba69917-525d-4d21-b8a0-50f2868e2239 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:41.413822 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 65/129] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:11:41 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:11:41.421430 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d20861-dbe5-4be0-b030-d4177de57f3d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:41.421881 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d20861-dbe5-4be0-b030-d4177de57f3d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:41.422169 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d20861-dbe5-4be0-b030-d4177de57f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:41.443265 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e6d20861-dbe5-4be0-b030-d4177de57f3d None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:11:41.444556 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e6d20861-dbe5-4be0-b030-d4177de57f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:11:41.453469 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59335907-dc16-4b78-8049-14b691ff0f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:41.454524 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59335907-dc16-4b78-8049-14b691ff0f09 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:41.455017 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59335907-dc16-4b78-8049-14b691ff0f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:41.455480 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59335907-dc16-4b78-8049-14b691ff0f09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:41.456453 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59335907-dc16-4b78-8049-14b691ff0f09 None admin] RBAC: Adding query filter params (role.id=3a0f9a2e42334ab59845114892813223, scope.project.id=cb6937ae98284c6fa35433e11e2d1f93, user.id=6ca43f74f2354a7c8dd7ef9c59bdc801) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:11:41.457069 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59335907-dc16-4b78-8049-14b691ff0f09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:41.459019 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59335907-dc16-4b78-8049-14b691ff0f09 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:41.465985 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 65/130] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Oct 27 13:11:41 2022] GET /identity/v3/role_assignments?user.id=6ca43f74f2354a7c8dd7ef9c59bdc801&scope.project.id=cb6937ae98284c6fa35433e11e2d1f93&role.id=3a0f9a2e42334ab59845114892813223 => generated 608 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:41.529093 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 66/131] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:11:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 13:11:41.806781 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59335907-dc16-4b78-8049-14b691ff0f09 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:41.839680 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:41.910345 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59335907-dc16-4b78-8049-14b691ff0f09 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:41.944712 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96ed9a-9488-401c-9d9b-8fc560cc2891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:41.945336 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96ed9a-9488-401c-9d9b-8fc560cc2891 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:41.945647 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96ed9a-9488-401c-9d9b-8fc560cc2891 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:41.945924 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96ed9a-9488-401c-9d9b-8fc560cc2891 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:41.947084 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96ed9a-9488-401c-9d9b-8fc560cc2891 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:41.948542 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96ed9a-9488-401c-9d9b-8fc560cc2891 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:41.950209 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 66/132] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:11:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:41.955782 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d20861-dbe5-4be0-b030-d4177de57f3d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:42.058751 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d20861-dbe5-4be0-b030-d4177de57f3d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:42.081401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:42.094005 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d1e62-22f4-4cfc-8c5c-b2f43f2f4008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:42.094617 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d1e62-22f4-4cfc-8c5c-b2f43f2f4008 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:42.094897 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d1e62-22f4-4cfc-8c5c-b2f43f2f4008 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:42.095175 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d1e62-22f4-4cfc-8c5c-b2f43f2f4008 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:42.095828 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d1e62-22f4-4cfc-8c5c-b2f43f2f4008 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:42.097297 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d1e62-22f4-4cfc-8c5c-b2f43f2f4008 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:42.125614 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 67/133] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Oct 27 13:11:41 2022] POST /identity/v3/users => generated 283 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:11:42.911391 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdce5e-f697-412a-843f-c4e89352f95b None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:42.912005 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdce5e-f697-412a-843f-c4e89352f95b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:42.912005 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdce5e-f697-412a-843f-c4e89352f95b None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:42.913618 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 67/134] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:11:42.919071 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9421b5-d127-4ffc-9c75-6d35120b08f1 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:42.919484 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9421b5-d127-4ffc-9c75-6d35120b08f1 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:42.919650 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9421b5-d127-4ffc-9c75-6d35120b08f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:42.938483 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-4f9421b5-d127-4ffc-9c75-6d35120b08f1 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:11:42.939660 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4f9421b5-d127-4ffc-9c75-6d35120b08f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:11:43.007647 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 68/135] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:11:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:11:43.271197 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffdce5e-f697-412a-843f-c4e89352f95b None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:43.367906 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:43.373077 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffdce5e-f697-412a-843f-c4e89352f95b None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:43.406761 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e5aafc-bfda-48d9-ac33-df17bbc6114e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:43.407446 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5aafc-bfda-48d9-ac33-df17bbc6114e None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:43.407726 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5aafc-bfda-48d9-ac33-df17bbc6114e None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:43.407996 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5aafc-bfda-48d9-ac33-df17bbc6114e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:43.418677 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e5aafc-bfda-48d9-ac33-df17bbc6114e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:11:43.423643 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-86e5aafc-bfda-48d9-ac33-df17bbc6114e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 13:11:43.423643 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:11:43.423643 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:11:43.423643 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:11:43.423643 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:11:43.423643 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:11:43.423643 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:11:43.423643 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:11:43.423643 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:11:43.423643 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:11:43.423643 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:11:43.423643 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:11:43.423643 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:11:43.423643 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:11:43.423643 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:11:43.423643 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:11:43.424477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:11:43.424477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:11:43.424477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:11:43.424477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:11:43.424477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:11:43.424477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:11:43.424477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:11:43.424477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:11:43.424477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:11:43.424477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:11:43.424477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:11:43.424477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:11:43.424477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:11:43.424477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:11:43.424477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:11:43.424477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:11:43.425225 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:11:43.425225 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:11:43.425225 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:11:43.425225 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:11:43.425225 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:11:43.425225 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:11:43.425225 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:11:43.425225 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:11:43.425225 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:11:43.425225 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:11:43.425225 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 13:11:43.425225 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:11:43.425225 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 68/136] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Oct 27 13:11:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:11:43.430901 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9421b5-d127-4ffc-9c75-6d35120b08f1 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:43.532571 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9421b5-d127-4ffc-9c75-6d35120b08f1 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:43.542438 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:43.574174 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32987575-b0a3-479f-ace5-6859b1ab26ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:43.574852 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32987575-b0a3-479f-ace5-6859b1ab26ac None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:43.575133 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32987575-b0a3-479f-ace5-6859b1ab26ac None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:43.575407 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32987575-b0a3-479f-ace5-6859b1ab26ac None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:43.576130 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32987575-b0a3-479f-ace5-6859b1ab26ac None admin] RBAC: Adding query filter params (name=reader) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:11:43.576437 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32987575-b0a3-479f-ace5-6859b1ab26ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:43.577887 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32987575-b0a3-479f-ace5-6859b1ab26ac None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:43.587260 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 69/137] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Oct 27 13:11:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:43.592656 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e5aafc-bfda-48d9-ac33-df17bbc6114e None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:43.696563 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e5aafc-bfda-48d9-ac33-df17bbc6114e None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:43.730606 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae22128-e5d3-4781-80d7-fa6f687024cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:43.731282 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae22128-e5d3-4781-80d7-fa6f687024cd None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:43.731560 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae22128-e5d3-4781-80d7-fa6f687024cd None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:43.731830 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae22128-e5d3-4781-80d7-fa6f687024cd None admin] PATH_INFO: `/v3/users/91ce1c2e028b4ddbb5f5b529387b1735` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:43.732950 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae22128-e5d3-4781-80d7-fa6f687024cd None admin] RBAC: Authorizing `identity:get_user(user_id=91ce1c2e028b4ddbb5f5b529387b1735)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:43.734574 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae22128-e5d3-4781-80d7-fa6f687024cd None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:43.736487 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 69/138] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Oct 27 13:11:43 2022] GET /identity/v3/users/91ce1c2e028b4ddbb5f5b529387b1735 => generated 289 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:43.741995 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32987575-b0a3-479f-ace5-6859b1ab26ac None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:43.841547 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32987575-b0a3-479f-ace5-6859b1ab26ac None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:43.875276 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e23ac-6122-4c4b-b7c2-10acc673939c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:43.875897 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e23ac-6122-4c4b-b7c2-10acc673939c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:43.876178 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e23ac-6122-4c4b-b7c2-10acc673939c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:43.876453 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e23ac-6122-4c4b-b7c2-10acc673939c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:43.918965 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:43.946013 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e23ac-6122-4c4b-b7c2-10acc673939c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:43.947502 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e23ac-6122-4c4b-b7c2-10acc673939c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:44.046243 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 70/139] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Oct 27 13:11:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 13:11:44.052568 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae22128-e5d3-4781-80d7-fa6f687024cd None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:44.082049 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:44.159173 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae22128-e5d3-4781-80d7-fa6f687024cd None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:44.195567 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809cce79-0c1e-4fd7-81f0-9a7aacf9f12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:44.196271 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cce79-0c1e-4fd7-81f0-9a7aacf9f12f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:44.196552 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cce79-0c1e-4fd7-81f0-9a7aacf9f12f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:44.196842 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cce79-0c1e-4fd7-81f0-9a7aacf9f12f None admin] PATH_INFO: `/v3/projects/9a7e52ec5fb64c04a51ab3c08adf1d8b` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:44.198069 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809cce79-0c1e-4fd7-81f0-9a7aacf9f12f None admin] RBAC: Authorizing `identity:get_project(project_id=9a7e52ec5fb64c04a51ab3c08adf1d8b)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:44.199536 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809cce79-0c1e-4fd7-81f0-9a7aacf9f12f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:44.201190 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 70/140] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Oct 27 13:11:44 2022] GET /identity/v3/projects/9a7e52ec5fb64c04a51ab3c08adf1d8b => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:44.207567 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e23ac-6122-4c4b-b7c2-10acc673939c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:44.277633 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:44.309880 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e23ac-6122-4c4b-b7c2-10acc673939c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:44.344414 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344c47a-8609-41cd-8750-7c2d4318c2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:44.345030 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344c47a-8609-41cd-8750-7c2d4318c2bd None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:44.345308 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344c47a-8609-41cd-8750-7c2d4318c2bd None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:44.345610 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344c47a-8609-41cd-8750-7c2d4318c2bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:44.346474 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5344c47a-8609-41cd-8750-7c2d4318c2bd None admin] RBAC: Adding query filter params (role.id=55046f1a884449f4a429f1f572f53ec6, scope.project.id=9a7e52ec5fb64c04a51ab3c08adf1d8b, user.id=91ce1c2e028b4ddbb5f5b529387b1735) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:11:44.346783 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5344c47a-8609-41cd-8750-7c2d4318c2bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:44.348305 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5344c47a-8609-41cd-8750-7c2d4318c2bd None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:44.354859 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 71/141] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Oct 27 13:11:44 2022] GET /identity/v3/role_assignments?user.id=91ce1c2e028b4ddbb5f5b529387b1735&scope.project.id=9a7e52ec5fb64c04a51ab3c08adf1d8b&role.id=55046f1a884449f4a429f1f572f53ec6 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:44.497192 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad194e3c-1049-4cfb-aeb1-572c1970a0bf None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:44.497925 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad194e3c-1049-4cfb-aeb1-572c1970a0bf None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:44.498403 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad194e3c-1049-4cfb-aeb1-572c1970a0bf None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:44.500042 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 71/142] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:11:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:11:44.506123 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f73d1-203a-4fe5-b112-30752669491f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:44.506433 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f73d1-203a-4fe5-b112-30752669491f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:44.506677 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f73d1-203a-4fe5-b112-30752669491f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:44.526934 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-f65f73d1-203a-4fe5-b112-30752669491f None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:11:44.528508 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f65f73d1-203a-4fe5-b112-30752669491f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:11:44.530886 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e732c1-4802-4904-9fa6-a7cfa8cbd19e None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:44.531465 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e732c1-4802-4904-9fa6-a7cfa8cbd19e None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:44.531954 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e732c1-4802-4904-9fa6-a7cfa8cbd19e None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:44.533574 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 72/143] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:11:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:11:44.539508 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f78895-6bbd-48c3-8417-33c9fc09f990 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:44.540082 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f78895-6bbd-48c3-8417-33c9fc09f990 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:44.540357 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f78895-6bbd-48c3-8417-33c9fc09f990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:44.566464 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-d4f78895-6bbd-48c3-8417-33c9fc09f990 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:11:44.567619 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d4f78895-6bbd-48c3-8417-33c9fc09f990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:11:44.604260 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 72/144] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:11:44.605916 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e401c8a-5cf6-41c1-be6c-ded5d0ea6ed6 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:44.606459 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e401c8a-5cf6-41c1-be6c-ded5d0ea6ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:44.606875 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e401c8a-5cf6-41c1-be6c-ded5d0ea6ed6 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:44.608329 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 73/145] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:11:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:11:44.613757 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c525a50-6961-41b7-a618-3c06d5faffd7 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:44.614106 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c525a50-6961-41b7-a618-3c06d5faffd7 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:44.614415 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c525a50-6961-41b7-a618-3c06d5faffd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:44.636835 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-2c525a50-6961-41b7-a618-3c06d5faffd7 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:11:44.638067 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2c525a50-6961-41b7-a618-3c06d5faffd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:11:44.645831 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 73/146] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:11:44.701220 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:44.710460 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 74/147] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 13:11:44.875923 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f78895-6bbd-48c3-8417-33c9fc09f990 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:44.902838 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:44.908464 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c525a50-6961-41b7-a618-3c06d5faffd7 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:44.986318 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f78895-6bbd-48c3-8417-33c9fc09f990 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:45.011330 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c525a50-6961-41b7-a618-3c06d5faffd7 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:45.021019 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ff109-7a3f-490a-81c5-9c52e8b23002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:45.021679 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ff109-7a3f-490a-81c5-9c52e8b23002 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:45.021963 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ff109-7a3f-490a-81c5-9c52e8b23002 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:45.022229 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ff109-7a3f-490a-81c5-9c52e8b23002 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:45.032236 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ff109-7a3f-490a-81c5-9c52e8b23002 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:11:45.037160 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-a14ff109-7a3f-490a-81c5-9c52e8b23002 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:11:45.037160 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:11:45.037160 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:11:45.037160 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:11:45.037160 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:11:45.037160 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:11:45.037160 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:11:45.037160 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:11:45.037160 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:11:45.037160 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:11:45.037160 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:11:45.037160 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:11:45.037160 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:11:45.037160 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:11:45.037160 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:11:45.037160 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:11:45.038206 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:11:45.038206 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:11:45.038206 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:11:45.038206 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:11:45.038206 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:11:45.038206 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:11:45.038206 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:11:45.038206 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:11:45.038206 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:11:45.038206 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:11:45.038206 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:11:45.038206 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:11:45.038206 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:11:45.038206 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:11:45.038206 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:11:45.038206 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:11:45.039495 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:11:45.039495 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:11:45.039495 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:11:45.039495 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:11:45.039495 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:11:45.039495 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:11:45.039495 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:11:45.039495 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:11:45.039495 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:11:45.039495 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:11:45.039495 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:11:45.039495 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:11:45.039495 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 74/148] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Oct 27 13:11:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:11:45.039495 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ff109-7a3f-490a-81c5-9c52e8b23002 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:45.047102 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf478c0-24e6-42a0-bcc9-28d5fec10ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:45.047738 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf478c0-24e6-42a0-bcc9-28d5fec10ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:45.048013 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf478c0-24e6-42a0-bcc9-28d5fec10ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:45.048281 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf478c0-24e6-42a0-bcc9-28d5fec10ad1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:45.059055 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf478c0-24e6-42a0-bcc9-28d5fec10ad1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:11:45.063882 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-4cf478c0-24e6-42a0-bcc9-28d5fec10ad1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 13:11:45.063882 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:11:45.063882 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:11:45.063882 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:11:45.063882 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:11:45.063882 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:11:45.063882 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:11:45.063882 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:11:45.063882 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:11:45.063882 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:11:45.063882 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:11:45.063882 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:11:45.063882 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:11:45.063882 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:11:45.063882 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:11:45.063882 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:11:45.064708 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:11:45.064708 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:11:45.064708 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:11:45.064708 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:11:45.064708 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:11:45.064708 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:11:45.064708 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:11:45.064708 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:11:45.064708 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:11:45.064708 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:11:45.064708 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:11:45.064708 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:11:45.064708 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:11:45.064708 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:11:45.064708 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:11:45.064708 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:11:45.065837 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:11:45.065837 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:11:45.065837 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:11:45.065837 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:11:45.065837 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:11:45.065837 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:11:45.065837 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:11:45.065837 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:11:45.065837 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:11:45.065837 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:11:45.065837 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 13:11:45.065837 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:11:45.065837 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 75/149] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Oct 27 13:11:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:11:45.066693 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf478c0-24e6-42a0-bcc9-28d5fec10ad1 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:45.120365 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:45.124242 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:45.140214 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ff109-7a3f-490a-81c5-9c52e8b23002 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:45.164825 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf478c0-24e6-42a0-bcc9-28d5fec10ad1 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:45.175487 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b213a96-eda5-4ef0-ae51-c71adcc007cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:45.176114 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b213a96-eda5-4ef0-ae51-c71adcc007cd None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:45.176466 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b213a96-eda5-4ef0-ae51-c71adcc007cd None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:45.176865 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b213a96-eda5-4ef0-ae51-c71adcc007cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:45.178023 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b213a96-eda5-4ef0-ae51-c71adcc007cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:45.179482 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b213a96-eda5-4ef0-ae51-c71adcc007cd None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:45.181074 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 75/150] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:11:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:45.181857 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b213a96-eda5-4ef0-ae51-c71adcc007cd None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:45.200429 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39dc82-8099-476e-ad24-d149c6edb581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:45.201030 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39dc82-8099-476e-ad24-d149c6edb581 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:45.201304 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39dc82-8099-476e-ad24-d149c6edb581 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:45.201581 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39dc82-8099-476e-ad24-d149c6edb581 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:45.202255 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b39dc82-8099-476e-ad24-d149c6edb581 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:11:45.202551 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b39dc82-8099-476e-ad24-d149c6edb581 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:45.203919 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b39dc82-8099-476e-ad24-d149c6edb581 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:45.212107 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 76/151] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Oct 27 13:11:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:45.212845 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39dc82-8099-476e-ad24-d149c6edb581 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:45.279760 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b213a96-eda5-4ef0-ae51-c71adcc007cd None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:45.313434 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39dc82-8099-476e-ad24-d149c6edb581 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:45.314361 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4cc2c1-5a0f-4364-844e-d2bf425f3e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:45.314976 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4cc2c1-5a0f-4364-844e-d2bf425f3e33 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:45.315247 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4cc2c1-5a0f-4364-844e-d2bf425f3e33 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:45.315519 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4cc2c1-5a0f-4364-844e-d2bf425f3e33 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:45.316196 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4cc2c1-5a0f-4364-844e-d2bf425f3e33 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:11:45.316479 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4cc2c1-5a0f-4364-844e-d2bf425f3e33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:45.318009 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4cc2c1-5a0f-4364-844e-d2bf425f3e33 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:45.326282 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 76/152] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Oct 27 13:11:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:45.327090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4cc2c1-5a0f-4364-844e-d2bf425f3e33 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:45.329820 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:45.345053 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:45.348079 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245c6b6-5228-4d21-9428-2de0157682c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:45.348927 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245c6b6-5228-4d21-9428-2de0157682c5 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:45.349508 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245c6b6-5228-4d21-9428-2de0157682c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:45.349815 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245c6b6-5228-4d21-9428-2de0157682c5 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:45.350468 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245c6b6-5228-4d21-9428-2de0157682c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:45.352393 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245c6b6-5228-4d21-9428-2de0157682c5 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:45.373494 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 77/153] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Oct 27 13:11:45 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:11:45.378615 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245c6b6-5228-4d21-9428-2de0157682c5 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:45.446284 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4cc2c1-5a0f-4364-844e-d2bf425f3e33 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:45.485239 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50738af7-ce7b-4aad-815d-b3ce2dc94fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:45.485916 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50738af7-ce7b-4aad-815d-b3ce2dc94fb0 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:45.486192 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50738af7-ce7b-4aad-815d-b3ce2dc94fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:45.486465 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50738af7-ce7b-4aad-815d-b3ce2dc94fb0 None admin] PATH_INFO: `/v3/users/1ab7b6ad80f844509baace19ee295262` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:45.494003 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245c6b6-5228-4d21-9428-2de0157682c5 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:45.502015 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50738af7-ce7b-4aad-815d-b3ce2dc94fb0 None admin] RBAC: Authorizing `identity:get_user(user_id=1ab7b6ad80f844509baace19ee295262)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:45.503534 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50738af7-ce7b-4aad-815d-b3ce2dc94fb0 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:45.505562 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 77/154] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Oct 27 13:11:45 2022] GET /identity/v3/users/1ab7b6ad80f844509baace19ee295262 => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:45.511045 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50738af7-ce7b-4aad-815d-b3ce2dc94fb0 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:45.531260 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8e149-80bd-4dd3-93fe-f09846d29bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:45.532028 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8e149-80bd-4dd3-93fe-f09846d29bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:45.532306 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8e149-80bd-4dd3-93fe-f09846d29bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:45.532574 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8e149-80bd-4dd3-93fe-f09846d29bc8 None admin] PATH_INFO: `/v3/users/1ab7b6ad80f844509baace19ee295262` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:45.533769 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb8e149-80bd-4dd3-93fe-f09846d29bc8 None admin] RBAC: Authorizing `identity:get_user(user_id=1ab7b6ad80f844509baace19ee295262)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:45.535259 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb8e149-80bd-4dd3-93fe-f09846d29bc8 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:45.537007 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 78/155] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Oct 27 13:11:45 2022] GET /identity/v3/users/1ab7b6ad80f844509baace19ee295262 => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:45.542649 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8e149-80bd-4dd3-93fe-f09846d29bc8 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:45.592036 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:45.593071 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:45.632632 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50738af7-ce7b-4aad-815d-b3ce2dc94fb0 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:45.671662 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8e149-80bd-4dd3-93fe-f09846d29bc8 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:45.674344 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3579b29-e96b-4e48-9bab-ead0fff286fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:45.675212 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3579b29-e96b-4e48-9bab-ead0fff286fa None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:45.675488 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3579b29-e96b-4e48-9bab-ead0fff286fa None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:45.675757 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3579b29-e96b-4e48-9bab-ead0fff286fa None admin] PATH_INFO: `/v3/projects/350b6dccdfa543e18bffdf3853710ebf` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:45.677578 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3579b29-e96b-4e48-9bab-ead0fff286fa None admin] RBAC: Authorizing `identity:get_project(project_id=350b6dccdfa543e18bffdf3853710ebf)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:45.679141 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3579b29-e96b-4e48-9bab-ead0fff286fa None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:45.680728 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 78/156] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Oct 27 13:11:45 2022] GET /identity/v3/projects/350b6dccdfa543e18bffdf3853710ebf => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:11:45.686786 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3579b29-e96b-4e48-9bab-ead0fff286fa None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:45.718136 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc61bf0e-3973-49d2-896d-20e0f380dec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:45.719383 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61bf0e-3973-49d2-896d-20e0f380dec2 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:45.719661 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61bf0e-3973-49d2-896d-20e0f380dec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:45.719928 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61bf0e-3973-49d2-896d-20e0f380dec2 None admin] PATH_INFO: `/v3/projects/350b6dccdfa543e18bffdf3853710ebf` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:45.721316 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc61bf0e-3973-49d2-896d-20e0f380dec2 None admin] RBAC: Authorizing `identity:get_project(project_id=350b6dccdfa543e18bffdf3853710ebf)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:45.722829 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc61bf0e-3973-49d2-896d-20e0f380dec2 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:45.724831 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 79/157] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Oct 27 13:11:45 2022] GET /identity/v3/projects/350b6dccdfa543e18bffdf3853710ebf => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:11:45.731174 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc61bf0e-3973-49d2-896d-20e0f380dec2 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:45.813896 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3579b29-e96b-4e48-9bab-ead0fff286fa None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:45.846159 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc61bf0e-3973-49d2-896d-20e0f380dec2 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:45.849418 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfb10d-f4ad-4580-be91-2ee3251549de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:45.850229 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfb10d-f4ad-4580-be91-2ee3251549de None admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:45.850602 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfb10d-f4ad-4580-be91-2ee3251549de None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:45.850968 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfb10d-f4ad-4580-be91-2ee3251549de None admin] PATH_INFO: `/v3/projects/350b6dccdfa543e18bffdf3853710ebf/users/1ab7b6ad80f844509baace19ee295262/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:45.853136 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adfb10d-f4ad-4580-be91-2ee3251549de None admin] RBAC: Authorizing `identity:create_grant(project_id=350b6dccdfa543e18bffdf3853710ebf, user_id=1ab7b6ad80f844509baace19ee295262, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:45.854753 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adfb10d-f4ad-4580-be91-2ee3251549de None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:45.856532 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:45.866359 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:45.872710 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 79/158] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Oct 27 13:11:45 2022] PUT /identity/v3/projects/350b6dccdfa543e18bffdf3853710ebf/users/1ab7b6ad80f844509baace19ee295262/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:11:45.889222 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbecf942-019c-458d-bb79-fba62905980b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:45.890085 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbecf942-019c-458d-bb79-fba62905980b None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:45.890377 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbecf942-019c-458d-bb79-fba62905980b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:45.890649 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbecf942-019c-458d-bb79-fba62905980b None admin] PATH_INFO: `/v3/projects/350b6dccdfa543e18bffdf3853710ebf/users/1ab7b6ad80f844509baace19ee295262/roles/5db0b376b1b047f6bdc42dc784aa1ba9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:45.893114 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbecf942-019c-458d-bb79-fba62905980b None admin] RBAC: Authorizing `identity:create_grant(project_id=350b6dccdfa543e18bffdf3853710ebf, user_id=1ab7b6ad80f844509baace19ee295262, role_id=5db0b376b1b047f6bdc42dc784aa1ba9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:45.894886 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbecf942-019c-458d-bb79-fba62905980b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:45.911039 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 80/159] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Oct 27 13:11:45 2022] PUT /identity/v3/projects/350b6dccdfa543e18bffdf3853710ebf/users/1ab7b6ad80f844509baace19ee295262/roles/5db0b376b1b047f6bdc42dc784aa1ba9 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:11:47.650748 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf3135-e1ca-420d-a3e6-8c7da317ad49 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:47.651306 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf3135-e1ca-420d-a3e6-8c7da317ad49 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:47.651306 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf3135-e1ca-420d-a3e6-8c7da317ad49 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:47.652709 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 80/160] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:11:47.658888 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95faa86-7029-4583-8dfc-1a4c7a1ac68b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:47.659431 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95faa86-7029-4583-8dfc-1a4c7a1ac68b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:47.659431 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95faa86-7029-4583-8dfc-1a4c7a1ac68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:47.680902 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-c95faa86-7029-4583-8dfc-1a4c7a1ac68b None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:11:47.682117 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c95faa86-7029-4583-8dfc-1a4c7a1ac68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:11:47.751104 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 81/161] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:11:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:11:47.779534 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76aa63f-4a7b-4411-bfa7-c45cd0d62655 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:47.779865 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76aa63f-4a7b-4411-bfa7-c45cd0d62655 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:47.780113 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76aa63f-4a7b-4411-bfa7-c45cd0d62655 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:47.781493 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 81/162] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:11:47.787212 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a481cab-3a14-4c0c-8ebe-7293273a724f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:47.787491 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a481cab-3a14-4c0c-8ebe-7293273a724f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:47.787764 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a481cab-3a14-4c0c-8ebe-7293273a724f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:47.806565 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-4a481cab-3a14-4c0c-8ebe-7293273a724f None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:11:47.808048 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4a481cab-3a14-4c0c-8ebe-7293273a724f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:11:47.874517 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 82/163] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:11:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:11:48.027932 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76aa63f-4a7b-4411-bfa7-c45cd0d62655 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:48.054287 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8a5ba-1535-4670-bfc3-f757c9539c09 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:48.054617 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8a5ba-1535-4670-bfc3-f757c9539c09 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:48.054828 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8a5ba-1535-4670-bfc3-f757c9539c09 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:48.056181 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 83/164] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 13:11:48.061723 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a9b16-8043-4735-80c2-a4000d1ac903 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:48.062010 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a9b16-8043-4735-80c2-a4000d1ac903 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:48.062279 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a9b16-8043-4735-80c2-a4000d1ac903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:48.081487 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-f27a9b16-8043-4735-80c2-a4000d1ac903 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:11:48.082985 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f27a9b16-8043-4735-80c2-a4000d1ac903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:11:48.106981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:48.136325 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76aa63f-4a7b-4411-bfa7-c45cd0d62655 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:48.155003 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 84/165] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:11:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 13:11:48.156539 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e2873-c5ac-4255-a190-43760e7955bf None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:48.157175 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e2873-c5ac-4255-a190-43760e7955bf None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:48.157175 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e2873-c5ac-4255-a190-43760e7955bf None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:48.158482 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 85/166] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:11:48.161027 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e2873-c5ac-4255-a190-43760e7955bf None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:48.171216 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f89dd2-cade-473e-bdfb-0577d999c60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:48.171895 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f89dd2-cade-473e-bdfb-0577d999c60b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:48.172169 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f89dd2-cade-473e-bdfb-0577d999c60b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:48.172433 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f89dd2-cade-473e-bdfb-0577d999c60b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:48.184044 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f89dd2-cade-473e-bdfb-0577d999c60b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:11:48.188908 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-89f89dd2-cade-473e-bdfb-0577d999c60b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 13:11:48.188908 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:11:48.188908 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:11:48.188908 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:11:48.188908 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:11:48.188908 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:11:48.188908 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:11:48.188908 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:11:48.188908 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:11:48.188908 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:11:48.188908 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:11:48.188908 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:11:48.188908 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:11:48.188908 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:11:48.188908 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:11:48.188908 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:11:48.189861 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:11:48.189861 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:11:48.189861 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:11:48.189861 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:11:48.189861 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:11:48.189861 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:11:48.189861 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:11:48.189861 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:11:48.189861 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:11:48.189861 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:11:48.189861 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:11:48.189861 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:11:48.189861 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:11:48.189861 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:11:48.189861 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:11:48.189861 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:11:48.191450 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:11:48.191450 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:11:48.191450 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:11:48.191450 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:11:48.191450 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:11:48.191450 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:11:48.191450 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:11:48.191450 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:11:48.191450 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:11:48.191450 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:11:48.191450 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 13:11:48.191450 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:11:48.191450 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 82/167] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Oct 27 13:11:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:11:48.195936 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c9c65-3c91-4def-9cc4-b7a10c1dbd28 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:48.196216 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c9c65-3c91-4def-9cc4-b7a10c1dbd28 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:48.196471 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c9c65-3c91-4def-9cc4-b7a10c1dbd28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:48.214571 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-a85c9c65-3c91-4def-9cc4-b7a10c1dbd28 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:11:48.215791 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a85c9c65-3c91-4def-9cc4-b7a10c1dbd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:11:48.269033 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e2873-c5ac-4255-a190-43760e7955bf None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:48.274327 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:48.286240 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 83/168] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:11:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:11:48.286993 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c9c65-3c91-4def-9cc4-b7a10c1dbd28 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:48.315458 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85d426-a407-4cf6-ae87-4d5561de0e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:48.316685 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85d426-a407-4cf6-ae87-4d5561de0e92 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:48.317195 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85d426-a407-4cf6-ae87-4d5561de0e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:48.317650 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85d426-a407-4cf6-ae87-4d5561de0e92 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:48.318916 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85d426-a407-4cf6-ae87-4d5561de0e92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:48.320418 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85d426-a407-4cf6-ae87-4d5561de0e92 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:48.322197 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 86/169] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:11:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:48.327712 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85d426-a407-4cf6-ae87-4d5561de0e92 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:48.359195 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:48.400338 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c9c65-3c91-4def-9cc4-b7a10c1dbd28 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:48.436719 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85d426-a407-4cf6-ae87-4d5561de0e92 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:48.442144 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa9b36-65d6-40e2-a886-bab8137e10a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:48.442767 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa9b36-65d6-40e2-a886-bab8137e10a1 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:48.443102 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa9b36-65d6-40e2-a886-bab8137e10a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:48.443374 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa9b36-65d6-40e2-a886-bab8137e10a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:48.444090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa9b36-65d6-40e2-a886-bab8137e10a1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:11:48.444396 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa9b36-65d6-40e2-a886-bab8137e10a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:48.445933 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa9b36-65d6-40e2-a886-bab8137e10a1 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:48.455416 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 84/170] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Oct 27 13:11:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:48.456045 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa9b36-65d6-40e2-a886-bab8137e10a1 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:48.482761 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b9641-c165-477a-a655-bb75b63e89f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:48.483386 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b9641-c165-477a-a655-bb75b63e89f2 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:48.483659 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b9641-c165-477a-a655-bb75b63e89f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:48.483927 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b9641-c165-477a-a655-bb75b63e89f2 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:48.484577 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b9641-c165-477a-a655-bb75b63e89f2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:48.486070 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b9641-c165-477a-a655-bb75b63e89f2 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:48.514449 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 87/171] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Oct 27 13:11:48 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:11:48.515771 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b9641-c165-477a-a655-bb75b63e89f2 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:48.518308 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:48.573181 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa9b36-65d6-40e2-a886-bab8137e10a1 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:48.614672 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ceb79-086d-4915-a11f-366a943af995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:48.615398 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ceb79-086d-4915-a11f-366a943af995 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:48.615670 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ceb79-086d-4915-a11f-366a943af995 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:48.615938 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ceb79-086d-4915-a11f-366a943af995 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:48.627297 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ceb79-086d-4915-a11f-366a943af995 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:11:48.632602 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-363ceb79-086d-4915-a11f-366a943af995 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 13:11:48.632602 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:11:48.632602 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:11:48.632602 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:11:48.632602 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:11:48.632602 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:11:48.632602 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:11:48.632602 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:11:48.632602 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:11:48.632602 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:11:48.632602 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:11:48.632602 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:11:48.632602 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:11:48.632602 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:11:48.632602 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:11:48.632602 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:11:48.633523 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:11:48.633523 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:11:48.633523 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:11:48.633523 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:11:48.633523 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:11:48.633523 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:11:48.633523 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:11:48.633523 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:11:48.633523 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:11:48.633523 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:11:48.633523 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:11:48.633523 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:11:48.633523 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:11:48.633523 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:11:48.633523 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:11:48.633523 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:11:48.634361 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:11:48.634361 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:11:48.634361 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:11:48.634361 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:11:48.634361 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:11:48.634361 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:11:48.634361 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:11:48.634361 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:11:48.634361 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:11:48.634361 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:11:48.634361 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 13:11:48.634361 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:11:48.634361 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 85/172] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Oct 27 13:11:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:11:48.637330 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ceb79-086d-4915-a11f-366a943af995 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:48.640148 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:48.663664 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b9641-c165-477a-a655-bb75b63e89f2 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:48.700867 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fd18e-7611-4ecc-906b-f1f8dbf5d85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:48.701506 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fd18e-7611-4ecc-906b-f1f8dbf5d85f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:48.701825 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fd18e-7611-4ecc-906b-f1f8dbf5d85f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:48.702099 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fd18e-7611-4ecc-906b-f1f8dbf5d85f None admin] PATH_INFO: `/v3/users/038bf32824994dd2a6c29ea24be5cc9b` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:48.719506 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86fd18e-7611-4ecc-906b-f1f8dbf5d85f None admin] RBAC: Authorizing `identity:get_user(user_id=038bf32824994dd2a6c29ea24be5cc9b)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:48.720980 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86fd18e-7611-4ecc-906b-f1f8dbf5d85f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:48.722814 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 88/173] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Oct 27 13:11:48 2022] GET /identity/v3/users/038bf32824994dd2a6c29ea24be5cc9b => generated 297 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:48.723777 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fd18e-7611-4ecc-906b-f1f8dbf5d85f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:48.760933 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ceb79-086d-4915-a11f-366a943af995 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:48.775234 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:48.808242 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703aeea-5bde-4907-bfe2-36bcccca570a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:48.808242 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703aeea-5bde-4907-bfe2-36bcccca570a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:48.808462 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703aeea-5bde-4907-bfe2-36bcccca570a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:48.808650 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703aeea-5bde-4907-bfe2-36bcccca570a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:48.821095 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0703aeea-5bde-4907-bfe2-36bcccca570a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:11:48.827307 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-0703aeea-5bde-4907-bfe2-36bcccca570a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:11:48.827307 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:11:48.827307 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:11:48.827307 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:11:48.827307 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:11:48.827307 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:11:48.827307 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:11:48.827307 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:11:48.827307 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:11:48.827307 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:11:48.827307 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:11:48.827307 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:11:48.827307 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:11:48.827307 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:11:48.827307 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:11:48.827307 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:11:48.828171 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:11:48.828171 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:11:48.828171 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:11:48.828171 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:11:48.828171 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:11:48.828171 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:11:48.828171 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:11:48.828171 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:11:48.828171 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:11:48.828171 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:11:48.828171 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:11:48.828171 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:11:48.828171 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:11:48.828171 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:11:48.828171 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:11:48.828171 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:11:48.828951 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:11:48.828951 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:11:48.828951 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:11:48.828951 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:11:48.828951 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:11:48.828951 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:11:48.828951 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:11:48.828951 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:11:48.828951 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:11:48.828951 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:11:48.828951 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:11:48.828951 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:11:48.828951 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 86/174] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Oct 27 13:11:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:11:48.829665 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703aeea-5bde-4907-bfe2-36bcccca570a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:48.857947 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fd18e-7611-4ecc-906b-f1f8dbf5d85f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:48.906357 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d6793-767c-4907-8625-1e61d1e97fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:48.907059 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d6793-767c-4907-8625-1e61d1e97fce None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:48.907300 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d6793-767c-4907-8625-1e61d1e97fce None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:48.907519 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d6793-767c-4907-8625-1e61d1e97fce None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:48.908183 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d6793-767c-4907-8625-1e61d1e97fce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:11:48.908489 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d6793-767c-4907-8625-1e61d1e97fce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:48.910500 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d6793-767c-4907-8625-1e61d1e97fce None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:48.919620 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 89/175] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Oct 27 13:11:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:48.924276 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d6793-767c-4907-8625-1e61d1e97fce None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:48.924276 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:48.943264 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703aeea-5bde-4907-bfe2-36bcccca570a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:48.988594 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b27797-6ce2-4cc9-a47f-6e88a8d95edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:48.990566 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b27797-6ce2-4cc9-a47f-6e88a8d95edd None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:48.991511 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b27797-6ce2-4cc9-a47f-6e88a8d95edd None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:48.992222 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b27797-6ce2-4cc9-a47f-6e88a8d95edd None admin] PATH_INFO: `/v3/projects/350b6dccdfa543e18bffdf3853710ebf` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:48.994282 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b27797-6ce2-4cc9-a47f-6e88a8d95edd None admin] RBAC: Authorizing `identity:get_project(project_id=350b6dccdfa543e18bffdf3853710ebf)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:48.996919 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b27797-6ce2-4cc9-a47f-6e88a8d95edd None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:48.999063 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 87/176] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Oct 27 13:11:48 2022] GET /identity/v3/projects/350b6dccdfa543e18bffdf3853710ebf => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:49.000357 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b27797-6ce2-4cc9-a47f-6e88a8d95edd None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:49.036538 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d6793-767c-4907-8625-1e61d1e97fce None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:49.051867 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:49.072702 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07241cb6-5da6-45f8-b932-950fc9625573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:49.073290 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07241cb6-5da6-45f8-b932-950fc9625573 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:49.073591 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07241cb6-5da6-45f8-b932-950fc9625573 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:49.073864 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07241cb6-5da6-45f8-b932-950fc9625573 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:49.074526 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07241cb6-5da6-45f8-b932-950fc9625573 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:11:49.074824 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07241cb6-5da6-45f8-b932-950fc9625573 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:49.077089 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07241cb6-5da6-45f8-b932-950fc9625573 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:49.086926 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 90/177] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Oct 27 13:11:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:49.091661 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07241cb6-5da6-45f8-b932-950fc9625573 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:49.124430 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b27797-6ce2-4cc9-a47f-6e88a8d95edd None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:49.157150 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:49.165884 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909853c5-348f-47de-9949-f423c14d080f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:49.166902 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909853c5-348f-47de-9949-f423c14d080f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:49.167399 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909853c5-348f-47de-9949-f423c14d080f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:49.167873 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909853c5-348f-47de-9949-f423c14d080f None admin] PATH_INFO: `/v3/users/1ab7b6ad80f844509baace19ee295262` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:49.169239 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909853c5-348f-47de-9949-f423c14d080f None admin] RBAC: Authorizing `identity:get_user(user_id=1ab7b6ad80f844509baace19ee295262)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:49.171059 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909853c5-348f-47de-9949-f423c14d080f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:49.172948 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 88/178] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Oct 27 13:11:48 2022] GET /identity/v3/users/1ab7b6ad80f844509baace19ee295262 => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:49.174023 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909853c5-348f-47de-9949-f423c14d080f None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:49.211215 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07241cb6-5da6-45f8-b932-950fc9625573 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:49.249617 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d1f89-9d20-4d35-92bb-7299f2890d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:49.250436 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d1f89-9d20-4d35-92bb-7299f2890d36 None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:49.250711 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d1f89-9d20-4d35-92bb-7299f2890d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:49.250978 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d1f89-9d20-4d35-92bb-7299f2890d36 None admin] PATH_INFO: `/v3/projects/350b6dccdfa543e18bffdf3853710ebf/users/038bf32824994dd2a6c29ea24be5cc9b/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:49.253750 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d1f89-9d20-4d35-92bb-7299f2890d36 None admin] RBAC: Authorizing `identity:create_grant(project_id=350b6dccdfa543e18bffdf3853710ebf, user_id=038bf32824994dd2a6c29ea24be5cc9b, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:49.255665 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d1f89-9d20-4d35-92bb-7299f2890d36 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:49.271195 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 91/179] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Oct 27 13:11:49 2022] PUT /identity/v3/projects/350b6dccdfa543e18bffdf3853710ebf/users/038bf32824994dd2a6c29ea24be5cc9b/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:11:49.272151 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d1f89-9d20-4d35-92bb-7299f2890d36 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:49.310682 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909853c5-348f-47de-9949-f423c14d080f None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:49.332200 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:49.391873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d1f89-9d20-4d35-92bb-7299f2890d36 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:49.398420 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daed381-fc31-4c35-ba5a-1b58ae38446e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:49.399076 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daed381-fc31-4c35-ba5a-1b58ae38446e None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:49.399351 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daed381-fc31-4c35-ba5a-1b58ae38446e None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:49.399620 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daed381-fc31-4c35-ba5a-1b58ae38446e None admin] PATH_INFO: `/v3/users/1ab7b6ad80f844509baace19ee295262` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:49.406621 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daed381-fc31-4c35-ba5a-1b58ae38446e None admin] RBAC: Authorizing `identity:get_user(user_id=1ab7b6ad80f844509baace19ee295262)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:49.408123 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daed381-fc31-4c35-ba5a-1b58ae38446e None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:49.410516 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 89/180] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Oct 27 13:11:49 2022] GET /identity/v3/users/1ab7b6ad80f844509baace19ee295262 => generated 283 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:49.415710 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daed381-fc31-4c35-ba5a-1b58ae38446e None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:49.421682 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:49.438709 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3816a2-0f33-4afd-b13a-5e1afa795d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:49.440946 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3816a2-0f33-4afd-b13a-5e1afa795d90 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:49.441719 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3816a2-0f33-4afd-b13a-5e1afa795d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:49.443129 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3816a2-0f33-4afd-b13a-5e1afa795d90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:49.568965 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3816a2-0f33-4afd-b13a-5e1afa795d90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:49.571894 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3816a2-0f33-4afd-b13a-5e1afa795d90 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:49.594972 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daed381-fc31-4c35-ba5a-1b58ae38446e None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:49.644262 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6fb2b-2732-4e35-8923-a601baee620d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:49.644580 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6fb2b-2732-4e35-8923-a601baee620d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:49.644785 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6fb2b-2732-4e35-8923-a601baee620d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:49.645090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6fb2b-2732-4e35-8923-a601baee620d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:49.705139 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:49.705488 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 92/181] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Oct 27 13:11:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 13:11:49.712831 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3816a2-0f33-4afd-b13a-5e1afa795d90 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:49.759840 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea6fb2b-2732-4e35-8923-a601baee620d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:49.761346 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea6fb2b-2732-4e35-8923-a601baee620d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:49.765308 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:49.919286 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3816a2-0f33-4afd-b13a-5e1afa795d90 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:49.963229 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 90/182] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Oct 27 13:11:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 27 13:11:49.970564 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6fb2b-2732-4e35-8923-a601baee620d None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:49.988028 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61e140-8fed-4d34-8698-3e17d2c86fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:49.988672 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61e140-8fed-4d34-8698-3e17d2c86fff None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:49.989188 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61e140-8fed-4d34-8698-3e17d2c86fff None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:49.989309 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61e140-8fed-4d34-8698-3e17d2c86fff None admin] PATH_INFO: `/v3/projects/350b6dccdfa543e18bffdf3853710ebf` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:49.991196 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c61e140-8fed-4d34-8698-3e17d2c86fff None admin] RBAC: Authorizing `identity:get_project(project_id=350b6dccdfa543e18bffdf3853710ebf)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:49.992657 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c61e140-8fed-4d34-8698-3e17d2c86fff None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:49.998960 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 93/183] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Oct 27 13:11:49 2022] GET /identity/v3/projects/350b6dccdfa543e18bffdf3853710ebf => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:50.005250 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61e140-8fed-4d34-8698-3e17d2c86fff None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:50.099492 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:50.175536 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6fb2b-2732-4e35-8923-a601baee620d None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:50.297909 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d22f42-23bd-4c89-80a3-9a7b19b3e03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:50.298947 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d22f42-23bd-4c89-80a3-9a7b19b3e03b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:50.299453 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d22f42-23bd-4c89-80a3-9a7b19b3e03b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:50.299923 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d22f42-23bd-4c89-80a3-9a7b19b3e03b None admin] PATH_INFO: `/v3/projects/350b6dccdfa543e18bffdf3853710ebf` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:50.301392 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d22f42-23bd-4c89-80a3-9a7b19b3e03b None admin] RBAC: Authorizing `identity:get_project(project_id=350b6dccdfa543e18bffdf3853710ebf)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:50.304422 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d22f42-23bd-4c89-80a3-9a7b19b3e03b None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:50.312567 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:50.314990 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 91/184] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Oct 27 13:11:49 2022] GET /identity/v3/projects/350b6dccdfa543e18bffdf3853710ebf => generated 302 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:50.320126 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d22f42-23bd-4c89-80a3-9a7b19b3e03b None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:50.361952 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61e140-8fed-4d34-8698-3e17d2c86fff None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:50.426275 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af8cc2-a889-443e-87ed-68c99c98d21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:50.427431 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af8cc2-a889-443e-87ed-68c99c98d21f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:50.427922 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af8cc2-a889-443e-87ed-68c99c98d21f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:50.428386 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af8cc2-a889-443e-87ed-68c99c98d21f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:50.429329 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3af8cc2-a889-443e-87ed-68c99c98d21f None admin] RBAC: Adding query filter params (role.id=5db0b376b1b047f6bdc42dc784aa1ba9, scope.project.id=350b6dccdfa543e18bffdf3853710ebf, user.id=1ab7b6ad80f844509baace19ee295262) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:11:50.434887 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3af8cc2-a889-443e-87ed-68c99c98d21f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:50.437165 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3af8cc2-a889-443e-87ed-68c99c98d21f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:50.454484 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 94/185] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Oct 27 13:11:50 2022] GET /identity/v3/role_assignments?user.id=1ab7b6ad80f844509baace19ee295262&scope.project.id=350b6dccdfa543e18bffdf3853710ebf&role.id=5db0b376b1b047f6bdc42dc784aa1ba9 => generated 608 bytes in 450 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:50.669857 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d22f42-23bd-4c89-80a3-9a7b19b3e03b None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:50.731863 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410472bc-9b6c-4ae7-ac74-d414bd647692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:50.732932 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410472bc-9b6c-4ae7-ac74-d414bd647692 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:50.733411 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410472bc-9b6c-4ae7-ac74-d414bd647692 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:50.733928 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410472bc-9b6c-4ae7-ac74-d414bd647692 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:50.734894 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410472bc-9b6c-4ae7-ac74-d414bd647692 None admin] RBAC: Adding query filter params (role.id=93bba834c17a4aa7afdc65c002a12975, scope.project.id=350b6dccdfa543e18bffdf3853710ebf, user.id=1ab7b6ad80f844509baace19ee295262) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:11:50.735425 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410472bc-9b6c-4ae7-ac74-d414bd647692 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:50.737114 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410472bc-9b6c-4ae7-ac74-d414bd647692 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:50.746022 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 92/186] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Oct 27 13:11:50 2022] GET /identity/v3/role_assignments?user.id=1ab7b6ad80f844509baace19ee295262&scope.project.id=350b6dccdfa543e18bffdf3853710ebf&role.id=93bba834c17a4aa7afdc65c002a12975 => generated 608 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:51.001383 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c372a08-1411-4226-9bae-5240b73b7dbf None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:51.002258 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c372a08-1411-4226-9bae-5240b73b7dbf None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:51.002536 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c372a08-1411-4226-9bae-5240b73b7dbf None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:51.004123 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 95/187] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:11:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:11:51.009875 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4f6c4-b4c8-483b-8827-3e2d3eac5426 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:51.010731 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4f6c4-b4c8-483b-8827-3e2d3eac5426 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:51.011217 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4f6c4-b4c8-483b-8827-3e2d3eac5426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:51.030817 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-bcf4f6c4-b4c8-483b-8827-3e2d3eac5426 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:11:51.032387 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-bcf4f6c4-b4c8-483b-8827-3e2d3eac5426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:11:51.034994 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:51.056510 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d06727-5c4b-4160-8682-439b5a702383 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:51.057145 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d06727-5c4b-4160-8682-439b5a702383 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:51.057972 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d06727-5c4b-4160-8682-439b5a702383 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:51.062902 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 96/188] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:11:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 13:11:51.067348 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59523a70-d52b-4410-80e2-4e4ab403c7da None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:51.067851 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59523a70-d52b-4410-80e2-4e4ab403c7da None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:51.068346 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59523a70-d52b-4410-80e2-4e4ab403c7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:51.088842 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-59523a70-d52b-4410-80e2-4e4ab403c7da None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:11:51.090038 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-59523a70-d52b-4410-80e2-4e4ab403c7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:11:51.112471 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 93/189] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:11:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:11:51.158747 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 97/190] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:11:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:11:51.386028 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4f6c4-b4c8-483b-8827-3e2d3eac5426 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:51.419726 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59523a70-d52b-4410-80e2-4e4ab403c7da None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:51.494282 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4f6c4-b4c8-483b-8827-3e2d3eac5426 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:51.516006 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:51.530411 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0344a11-7596-4f21-a281-b0038b563868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:51.531049 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0344a11-7596-4f21-a281-b0038b563868 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:51.531325 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0344a11-7596-4f21-a281-b0038b563868 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:51.531592 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0344a11-7596-4f21-a281-b0038b563868 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:51.532769 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59523a70-d52b-4410-80e2-4e4ab403c7da None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:51.538984 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:51.543555 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0344a11-7596-4f21-a281-b0038b563868 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:11:51.548480 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-d0344a11-7596-4f21-a281-b0038b563868 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 13:11:51.548480 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:11:51.548480 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:11:51.548480 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:11:51.548480 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:11:51.548480 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:11:51.548480 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:11:51.548480 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:11:51.548480 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:11:51.548480 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:11:51.548480 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:11:51.548480 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:11:51.548480 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:11:51.548480 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:11:51.548480 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:11:51.548480 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:11:51.549352 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:11:51.549352 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:11:51.549352 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:11:51.549352 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:11:51.549352 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:11:51.549352 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:11:51.549352 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:11:51.549352 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:11:51.549352 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:11:51.549352 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:11:51.549352 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:11:51.549352 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:11:51.549352 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:11:51.549352 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:11:51.549352 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:11:51.549352 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:11:51.554517 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:11:51.554517 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:11:51.554517 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:11:51.554517 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:11:51.554517 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:11:51.554517 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:11:51.554517 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:11:51.554517 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:11:51.554517 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:11:51.554517 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:11:51.554517 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 13:11:51.554517 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:11:51.554517 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 94/191] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Oct 27 13:11:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:11:51.556091 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0344a11-7596-4f21-a281-b0038b563868 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:51.578811 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718ba2d-7b58-46b4-8dd2-823cde7e2737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:51.579446 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718ba2d-7b58-46b4-8dd2-823cde7e2737 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:51.580133 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718ba2d-7b58-46b4-8dd2-823cde7e2737 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:51.580418 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718ba2d-7b58-46b4-8dd2-823cde7e2737 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:51.581515 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e718ba2d-7b58-46b4-8dd2-823cde7e2737 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:51.583019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e718ba2d-7b58-46b4-8dd2-823cde7e2737 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:51.584582 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 98/192] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:11:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:11:51.590121 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718ba2d-7b58-46b4-8dd2-823cde7e2737 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:51.661867 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0344a11-7596-4f21-a281-b0038b563868 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:51.697060 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718ba2d-7b58-46b4-8dd2-823cde7e2737 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:51.698046 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200548f4-72e6-4121-8828-8a36287105f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:51.698662 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200548f4-72e6-4121-8828-8a36287105f4 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:51.698936 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200548f4-72e6-4121-8828-8a36287105f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:51.699202 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200548f4-72e6-4121-8828-8a36287105f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:51.700080 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200548f4-72e6-4121-8828-8a36287105f4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:11:51.700183 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200548f4-72e6-4121-8828-8a36287105f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:51.701564 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200548f4-72e6-4121-8828-8a36287105f4 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:51.710204 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 95/193] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Oct 27 13:11:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:51.715630 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200548f4-72e6-4121-8828-8a36287105f4 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:51.742299 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d9ab9-421b-4bd9-8272-a9186038cee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:51.742926 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d9ab9-421b-4bd9-8272-a9186038cee0 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:51.743202 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d9ab9-421b-4bd9-8272-a9186038cee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:51.743471 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d9ab9-421b-4bd9-8272-a9186038cee0 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:51.744140 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d9ab9-421b-4bd9-8272-a9186038cee0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:51.745685 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d9ab9-421b-4bd9-8272-a9186038cee0 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:51.770562 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 99/194] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Oct 27 13:11:51 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:11:51.789457 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:51.842954 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200548f4-72e6-4121-8828-8a36287105f4 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:51.849027 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d4d20-a8e2-48c7-84ea-c095877f58b9 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:51.849416 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d4d20-a8e2-48c7-84ea-c095877f58b9 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:51.849725 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d4d20-a8e2-48c7-84ea-c095877f58b9 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:51.851837 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 100/195] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:11:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:11:51.857109 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984e654-1336-4657-9ab7-24e31683e405 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:51.857398 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984e654-1336-4657-9ab7-24e31683e405 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:51.857710 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984e654-1336-4657-9ab7-24e31683e405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:51.879182 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e984e654-1336-4657-9ab7-24e31683e405 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:11:51.880462 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e984e654-1336-4657-9ab7-24e31683e405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:11:51.881353 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338747a7-607b-4868-8d51-d0a366b9fbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:51.882058 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338747a7-607b-4868-8d51-d0a366b9fbdc None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:51.882392 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338747a7-607b-4868-8d51-d0a366b9fbdc None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:51.882785 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338747a7-607b-4868-8d51-d0a366b9fbdc None admin] PATH_INFO: `/v3/users/84afce831f6d4995bce1c2f5c897b31d` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:51.884755 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:51.900858 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338747a7-607b-4868-8d51-d0a366b9fbdc None admin] RBAC: Authorizing `identity:get_user(user_id=84afce831f6d4995bce1c2f5c897b31d)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:51.902575 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338747a7-607b-4868-8d51-d0a366b9fbdc None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:51.904572 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 96/196] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Oct 27 13:11:51 2022] GET /identity/v3/users/84afce831f6d4995bce1c2f5c897b31d => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:51.911094 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338747a7-607b-4868-8d51-d0a366b9fbdc None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:51.964521 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 101/197] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:11:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 13:11:52.028355 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338747a7-607b-4868-8d51-d0a366b9fbdc None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:52.047164 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:52.066159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9f486-64e4-4572-8e25-91c7fed0df1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:52.066834 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9f486-64e4-4572-8e25-91c7fed0df1c None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:52.067115 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9f486-64e4-4572-8e25-91c7fed0df1c None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:52.067380 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9f486-64e4-4572-8e25-91c7fed0df1c None admin] PATH_INFO: `/v3/projects/350b6dccdfa543e18bffdf3853710ebf` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:52.069185 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa9f486-64e4-4572-8e25-91c7fed0df1c None admin] RBAC: Authorizing `identity:get_project(project_id=350b6dccdfa543e18bffdf3853710ebf)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:52.070701 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa9f486-64e4-4572-8e25-91c7fed0df1c None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:52.072684 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 97/198] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Oct 27 13:11:51 2022] GET /identity/v3/projects/350b6dccdfa543e18bffdf3853710ebf => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:11:52.078410 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984e654-1336-4657-9ab7-24e31683e405 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:52.183587 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984e654-1336-4657-9ab7-24e31683e405 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:52.218000 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1bc34-72d5-4f36-8c45-2ab224d3ecc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:52.218584 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1bc34-72d5-4f36-8c45-2ab224d3ecc9 None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:52.218860 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1bc34-72d5-4f36-8c45-2ab224d3ecc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:52.219131 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1bc34-72d5-4f36-8c45-2ab224d3ecc9 None admin] PATH_INFO: `/v3/projects/350b6dccdfa543e18bffdf3853710ebf/users/84afce831f6d4995bce1c2f5c897b31d/roles/55046f1a884449f4a429f1f572f53ec6` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:52.221033 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d1bc34-72d5-4f36-8c45-2ab224d3ecc9 None admin] RBAC: Authorizing `identity:create_grant(project_id=350b6dccdfa543e18bffdf3853710ebf, user_id=84afce831f6d4995bce1c2f5c897b31d, role_id=55046f1a884449f4a429f1f572f53ec6)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:52.222515 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d1bc34-72d5-4f36-8c45-2ab224d3ecc9 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:52.232873 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9f486-64e4-4572-8e25-91c7fed0df1c None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:52.234118 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:52.238606 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 102/199] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Oct 27 13:11:52 2022] PUT /identity/v3/projects/350b6dccdfa543e18bffdf3853710ebf/users/84afce831f6d4995bce1c2f5c897b31d/roles/55046f1a884449f4a429f1f572f53ec6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:11:52.351191 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9f486-64e4-4572-8e25-91c7fed0df1c None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:52.389266 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058cb07-6938-4f56-a0b8-cf7a8a36d9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:52.389955 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058cb07-6938-4f56-a0b8-cf7a8a36d9b0 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:52.390230 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058cb07-6938-4f56-a0b8-cf7a8a36d9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:52.390497 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058cb07-6938-4f56-a0b8-cf7a8a36d9b0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:52.402983 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e058cb07-6938-4f56-a0b8-cf7a8a36d9b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:11:52.408023 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-e058cb07-6938-4f56-a0b8-cf7a8a36d9b0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 13:11:52.408023 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:11:52.408023 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:11:52.408023 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:11:52.408023 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:11:52.408023 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:11:52.408023 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:11:52.408023 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:11:52.408023 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:11:52.408023 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:11:52.408023 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:11:52.408023 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:11:52.408023 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:11:52.408023 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:11:52.408023 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:11:52.408023 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:11:52.408930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:11:52.408930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:11:52.408930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:11:52.408930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:11:52.408930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:11:52.408930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:11:52.408930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:11:52.408930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:11:52.408930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:11:52.408930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:11:52.408930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:11:52.408930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:11:52.408930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:11:52.408930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:11:52.408930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:11:52.408930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:11:52.409760 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:11:52.409760 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:11:52.409760 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:11:52.409760 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:11:52.409760 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:11:52.409760 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:11:52.409760 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:11:52.409760 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:11:52.409760 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:11:52.409760 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:11:52.409760 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 13:11:52.409760 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:11:52.409760 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 98/200] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Oct 27 13:11:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:11:52.415322 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1bc34-72d5-4f36-8c45-2ab224d3ecc9 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:52.527145 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1bc34-72d5-4f36-8c45-2ab224d3ecc9 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:52.562598 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc00f6-a9be-456f-8824-ef26232872d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:52.563205 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc00f6-a9be-456f-8824-ef26232872d7 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:52.563480 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc00f6-a9be-456f-8824-ef26232872d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:52.563744 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc00f6-a9be-456f-8824-ef26232872d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:52.564398 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cc00f6-a9be-456f-8824-ef26232872d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:11:52.564691 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cc00f6-a9be-456f-8824-ef26232872d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:52.566096 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cc00f6-a9be-456f-8824-ef26232872d7 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:52.574795 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 103/201] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Oct 27 13:11:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:52.580579 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058cb07-6938-4f56-a0b8-cf7a8a36d9b0 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:52.631369 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:52.686826 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058cb07-6938-4f56-a0b8-cf7a8a36d9b0 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:52.722401 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b01be0-51fb-4cfa-849e-29dab3a1e930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:52.723108 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b01be0-51fb-4cfa-849e-29dab3a1e930 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:52.723439 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b01be0-51fb-4cfa-849e-29dab3a1e930 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:52.723705 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b01be0-51fb-4cfa-849e-29dab3a1e930 None admin] PATH_INFO: `/v3/users/038bf32824994dd2a6c29ea24be5cc9b` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:52.724830 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b01be0-51fb-4cfa-849e-29dab3a1e930 None admin] RBAC: Authorizing `identity:get_user(user_id=038bf32824994dd2a6c29ea24be5cc9b)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:52.726313 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b01be0-51fb-4cfa-849e-29dab3a1e930 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:52.728205 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 99/202] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Oct 27 13:11:52 2022] GET /identity/v3/users/038bf32824994dd2a6c29ea24be5cc9b => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:52.733958 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc00f6-a9be-456f-8824-ef26232872d7 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:52.800310 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:52.841317 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc00f6-a9be-456f-8824-ef26232872d7 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:52.880114 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86056e-89b8-4acc-9154-ce6c611a31fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:52.880739 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86056e-89b8-4acc-9154-ce6c611a31fa None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:52.881012 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86056e-89b8-4acc-9154-ce6c611a31fa None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:52.881277 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86056e-89b8-4acc-9154-ce6c611a31fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:52.956895 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a86056e-89b8-4acc-9154-ce6c611a31fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:52.958556 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a86056e-89b8-4acc-9154-ce6c611a31fa None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:53.021280 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:53.070337 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 104/203] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Oct 27 13:11:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 13:11:53.075643 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b01be0-51fb-4cfa-849e-29dab3a1e930 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:53.184761 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b01be0-51fb-4cfa-849e-29dab3a1e930 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:53.201574 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:53.228278 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a327c56-5c5b-4d8e-a12f-82ce7ade8c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:53.228929 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a327c56-5c5b-4d8e-a12f-82ce7ade8c5f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:53.229199 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a327c56-5c5b-4d8e-a12f-82ce7ade8c5f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:53.229468 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a327c56-5c5b-4d8e-a12f-82ce7ade8c5f None admin] PATH_INFO: `/v3/projects/350b6dccdfa543e18bffdf3853710ebf` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:53.230635 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a327c56-5c5b-4d8e-a12f-82ce7ade8c5f None admin] RBAC: Authorizing `identity:get_project(project_id=350b6dccdfa543e18bffdf3853710ebf)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:53.232104 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a327c56-5c5b-4d8e-a12f-82ce7ade8c5f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:53.233820 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 100/204] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Oct 27 13:11:53 2022] GET /identity/v3/projects/350b6dccdfa543e18bffdf3853710ebf => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:53.240306 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86056e-89b8-4acc-9154-ce6c611a31fa None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:53.369815 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86056e-89b8-4acc-9154-ce6c611a31fa None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:53.407927 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a3190-20aa-44d7-ae77-a3526c2e54fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:53.408906 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a3190-20aa-44d7-ae77-a3526c2e54fd None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:53.409403 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a3190-20aa-44d7-ae77-a3526c2e54fd None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:53.409918 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a3190-20aa-44d7-ae77-a3526c2e54fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:53.410974 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a3190-20aa-44d7-ae77-a3526c2e54fd None admin] RBAC: Adding query filter params (role.id=3a0f9a2e42334ab59845114892813223, scope.project.id=350b6dccdfa543e18bffdf3853710ebf, user.id=038bf32824994dd2a6c29ea24be5cc9b) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:11:53.411482 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a3190-20aa-44d7-ae77-a3526c2e54fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:53.413152 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a3190-20aa-44d7-ae77-a3526c2e54fd None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:53.420943 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 105/205] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Oct 27 13:11:53 2022] GET /identity/v3/role_assignments?user.id=038bf32824994dd2a6c29ea24be5cc9b&scope.project.id=350b6dccdfa543e18bffdf3853710ebf&role.id=3a0f9a2e42334ab59845114892813223 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:11:54.236537 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3c166-e6e3-4bf6-a341-32ccf8e55a35 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:54.237071 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3c166-e6e3-4bf6-a341-32ccf8e55a35 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:54.237071 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3c166-e6e3-4bf6-a341-32ccf8e55a35 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:54.238713 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 101/206] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:11:54.244166 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709dfb4-92bd-4886-9f11-6f9989141400 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:54.244581 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709dfb4-92bd-4886-9f11-6f9989141400 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:54.244751 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709dfb4-92bd-4886-9f11-6f9989141400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:54.263195 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e709dfb4-92bd-4886-9f11-6f9989141400 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:11:54.264355 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e709dfb4-92bd-4886-9f11-6f9989141400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:11:54.285863 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:54.294098 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc465d-4c56-441a-8982-47c850d8bb5a None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:54.294381 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc465d-4c56-441a-8982-47c850d8bb5a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:54.294668 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc465d-4c56-441a-8982-47c850d8bb5a None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:54.296157 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 102/207] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 13:11:54.301113 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11a7be-d244-4586-8a7d-598b6358ad2a None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:54.301426 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11a7be-d244-4586-8a7d-598b6358ad2a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:54.301805 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11a7be-d244-4586-8a7d-598b6358ad2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:54.321204 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-8a11a7be-d244-4586-8a7d-598b6358ad2a None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:11:54.322426 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8a11a7be-d244-4586-8a7d-598b6358ad2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:11:54.336509 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 106/208] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:11:54.397584 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 103/209] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 13:11:54.600507 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709dfb4-92bd-4886-9f11-6f9989141400 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:54.627951 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca145d7-4e4d-47b9-abb3-e9a97171151a None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:54.628231 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca145d7-4e4d-47b9-abb3-e9a97171151a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:54.628541 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca145d7-4e4d-47b9-abb3-e9a97171151a None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:54.630130 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 104/210] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:11:54.635587 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06c946-cf4f-4095-a9bf-46760d1adf19 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:54.635893 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06c946-cf4f-4095-a9bf-46760d1adf19 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:54.636129 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06c946-cf4f-4095-a9bf-46760d1adf19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:54.655371 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-2a06c946-cf4f-4095-a9bf-46760d1adf19 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:11:54.656551 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2a06c946-cf4f-4095-a9bf-46760d1adf19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:11:54.708764 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709dfb4-92bd-4886-9f11-6f9989141400 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:54.722805 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 105/211] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 13:11:54.723894 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06c946-cf4f-4095-a9bf-46760d1adf19 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:54.745136 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13af51e-fc12-424f-ac79-06dad573f5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:54.745794 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13af51e-fc12-424f-ac79-06dad573f5f4 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:54.746073 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13af51e-fc12-424f-ac79-06dad573f5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:54.746342 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13af51e-fc12-424f-ac79-06dad573f5f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:54.756947 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13af51e-fc12-424f-ac79-06dad573f5f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:11:54.761871 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-c13af51e-fc12-424f-ac79-06dad573f5f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 13:11:54.761871 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:11:54.761871 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:11:54.761871 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:11:54.761871 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:11:54.761871 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:11:54.761871 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:11:54.761871 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:11:54.761871 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:11:54.761871 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:11:54.761871 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:11:54.761871 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:11:54.761871 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:11:54.761871 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:11:54.761871 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:11:54.761871 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:11:54.762854 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:11:54.762854 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:11:54.762854 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:11:54.762854 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:11:54.762854 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:11:54.762854 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:11:54.762854 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:11:54.762854 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:11:54.762854 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:11:54.762854 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:11:54.762854 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:11:54.762854 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:11:54.762854 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:11:54.762854 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:11:54.762854 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:11:54.762854 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:11:54.763658 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:11:54.763658 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:11:54.763658 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:11:54.763658 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:11:54.763658 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:11:54.763658 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:11:54.763658 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:11:54.763658 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:11:54.763658 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:11:54.763658 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:11:54.763658 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 13:11:54.763658 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:11:54.763658 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 107/212] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Oct 27 13:11:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:11:54.767017 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:54.770777 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13af51e-fc12-424f-ac79-06dad573f5f4 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:54.791474 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:54.830124 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06c946-cf4f-4095-a9bf-46760d1adf19 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:54.865294 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c514b95-4aaf-4c8d-83ce-8558603cd22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:54.865962 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c514b95-4aaf-4c8d-83ce-8558603cd22f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:54.866238 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c514b95-4aaf-4c8d-83ce-8558603cd22f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:54.866505 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c514b95-4aaf-4c8d-83ce-8558603cd22f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:54.867728 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c514b95-4aaf-4c8d-83ce-8558603cd22f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:54.869184 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c514b95-4aaf-4c8d-83ce-8558603cd22f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:54.871045 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 106/213] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:11:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:54.876562 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c514b95-4aaf-4c8d-83ce-8558603cd22f None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:54.878949 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13af51e-fc12-424f-ac79-06dad573f5f4 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:54.914174 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0bae9-6fa0-4382-9871-14b2cdd44f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:54.914802 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0bae9-6fa0-4382-9871-14b2cdd44f68 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:54.915077 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0bae9-6fa0-4382-9871-14b2cdd44f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:54.915344 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0bae9-6fa0-4382-9871-14b2cdd44f68 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:54.915998 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e0bae9-6fa0-4382-9871-14b2cdd44f68 None admin] RBAC: Adding query filter params (name=member) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:11:54.916316 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e0bae9-6fa0-4382-9871-14b2cdd44f68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:54.917733 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e0bae9-6fa0-4382-9871-14b2cdd44f68 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:54.931469 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 108/214] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Oct 27 13:11:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:11:54.932339 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0bae9-6fa0-4382-9871-14b2cdd44f68 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:54.978507 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c514b95-4aaf-4c8d-83ce-8558603cd22f None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:54.989301 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:55.010829 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:55.013025 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6038a-4565-4203-a9cf-9a7aaffa04e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:55.013665 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6038a-4565-4203-a9cf-9a7aaffa04e3 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:55.014014 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6038a-4565-4203-a9cf-9a7aaffa04e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:55.014271 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6038a-4565-4203-a9cf-9a7aaffa04e3 None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:55.014916 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f6038a-4565-4203-a9cf-9a7aaffa04e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:55.016436 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f6038a-4565-4203-a9cf-9a7aaffa04e3 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:55.032276 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0bae9-6fa0-4382-9871-14b2cdd44f68 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:55.038991 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 107/215] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Oct 27 13:11:54 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:11:55.039791 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6038a-4565-4203-a9cf-9a7aaffa04e3 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:55.079689 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c3dd6-a06f-45e1-910b-4f90f2b38c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:55.080360 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c3dd6-a06f-45e1-910b-4f90f2b38c47 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:55.080616 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c3dd6-a06f-45e1-910b-4f90f2b38c47 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:55.080894 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c3dd6-a06f-45e1-910b-4f90f2b38c47 None admin] PATH_INFO: `/v3/users/6c164b623a6e450fa4730dd4d7ee1423` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:55.096705 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c3dd6-a06f-45e1-910b-4f90f2b38c47 None admin] RBAC: Authorizing `identity:get_user(user_id=6c164b623a6e450fa4730dd4d7ee1423)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:55.098331 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c3dd6-a06f-45e1-910b-4f90f2b38c47 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:55.100364 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 109/216] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Oct 27 13:11:54 2022] GET /identity/v3/users/6c164b623a6e450fa4730dd4d7ee1423 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:55.106522 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c3dd6-a06f-45e1-910b-4f90f2b38c47 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:55.152688 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6038a-4565-4203-a9cf-9a7aaffa04e3 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:55.191027 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe8471-874f-4c65-9cd4-9a8e702fb315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:55.192060 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe8471-874f-4c65-9cd4-9a8e702fb315 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:55.192478 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe8471-874f-4c65-9cd4-9a8e702fb315 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:55.192899 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe8471-874f-4c65-9cd4-9a8e702fb315 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:55.204397 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe8471-874f-4c65-9cd4-9a8e702fb315 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:11:55.210159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-8cbe8471-874f-4c65-9cd4-9a8e702fb315 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 13:11:55.210159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:11:55.210159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:11:55.210159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:11:55.210159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:11:55.210159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:11:55.210159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:11:55.210159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:11:55.210159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:11:55.210159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:11:55.210159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:11:55.210159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:11:55.210159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:11:55.210159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:11:55.210159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:11:55.210159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:11:55.211059 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:11:55.211059 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:11:55.211059 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:11:55.211059 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:11:55.211059 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:11:55.211059 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:11:55.211059 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:11:55.211059 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:11:55.211059 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:11:55.211059 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:11:55.211059 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:11:55.211059 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:11:55.211059 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:11:55.211059 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:11:55.211059 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:11:55.211059 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:11:55.211841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:11:55.211841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:11:55.211841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:11:55.211841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:11:55.211841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:11:55.211841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:11:55.211841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:11:55.211841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:11:55.211841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:11:55.211841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:11:55.211841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 13:11:55.211841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:11:55.211841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 108/217] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Oct 27 13:11:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:11:55.217817 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe8471-874f-4c65-9cd4-9a8e702fb315 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:55.228248 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c3dd6-a06f-45e1-910b-4f90f2b38c47 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:55.251426 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:55.277359 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0814d05f-c5d2-4a4b-b703-e31a62b326d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:55.278075 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814d05f-c5d2-4a4b-b703-e31a62b326d1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:55.278293 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814d05f-c5d2-4a4b-b703-e31a62b326d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:55.278557 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814d05f-c5d2-4a4b-b703-e31a62b326d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:55.279283 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0814d05f-c5d2-4a4b-b703-e31a62b326d1 None admin] RBAC: Adding query filter params (role.id=3a0f9a2e42334ab59845114892813223, user.id=6c164b623a6e450fa4730dd4d7ee1423, scope.system=all) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:11:55.279586 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0814d05f-c5d2-4a4b-b703-e31a62b326d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:55.281045 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0814d05f-c5d2-4a4b-b703-e31a62b326d1 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:55.285043 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:55.289568 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 110/218] 10.222.0.52 () {56 vars in 1308 bytes} [Thu Oct 27 13:11:55 2022] GET /identity/v3/role_assignments?user.id=6c164b623a6e450fa4730dd4d7ee1423&scope.system=all&role.id=3a0f9a2e42334ab59845114892813223 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:11:55.350039 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe8471-874f-4c65-9cd4-9a8e702fb315 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:55.392420 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a946d-3e94-44a5-b1f9-322b6d0650a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:55.393047 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a946d-3e94-44a5-b1f9-322b6d0650a4 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:55.393318 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a946d-3e94-44a5-b1f9-322b6d0650a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:55.393617 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a946d-3e94-44a5-b1f9-322b6d0650a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:55.394324 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a946d-3e94-44a5-b1f9-322b6d0650a4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:11:55.394634 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a946d-3e94-44a5-b1f9-322b6d0650a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:55.396135 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a946d-3e94-44a5-b1f9-322b6d0650a4 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:55.406270 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 109/219] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Oct 27 13:11:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:55.411733 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0814d05f-c5d2-4a4b-b703-e31a62b326d1 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:55.522183 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0814d05f-c5d2-4a4b-b703-e31a62b326d1 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:55.556614 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89ded7-daf3-46e8-9fbb-e3657361f30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:55.557295 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89ded7-daf3-46e8-9fbb-e3657361f30b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:55.557902 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89ded7-daf3-46e8-9fbb-e3657361f30b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:55.558173 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89ded7-daf3-46e8-9fbb-e3657361f30b None admin] PATH_INFO: `/v3/users/84afce831f6d4995bce1c2f5c897b31d` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:55.559384 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89ded7-daf3-46e8-9fbb-e3657361f30b None admin] RBAC: Authorizing `identity:get_user(user_id=84afce831f6d4995bce1c2f5c897b31d)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:55.560840 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89ded7-daf3-46e8-9fbb-e3657361f30b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:55.562472 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 111/220] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Oct 27 13:11:55 2022] GET /identity/v3/users/84afce831f6d4995bce1c2f5c897b31d => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:11:55.568195 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a946d-3e94-44a5-b1f9-322b6d0650a4 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:55.666688 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:55.681493 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a946d-3e94-44a5-b1f9-322b6d0650a4 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:55.717787 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4157143-024a-489a-855f-bc8a678165e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:55.718778 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4157143-024a-489a-855f-bc8a678165e4 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:55.719291 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4157143-024a-489a-855f-bc8a678165e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:55.719758 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4157143-024a-489a-855f-bc8a678165e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:55.806871 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4157143-024a-489a-855f-bc8a678165e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:55.808748 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4157143-024a-489a-855f-bc8a678165e4 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:55.901319 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:55.915579 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 110/221] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Oct 27 13:11:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 13:11:55.921377 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89ded7-daf3-46e8-9fbb-e3657361f30b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:55.993389 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:56.028815 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89ded7-daf3-46e8-9fbb-e3657361f30b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:56.064850 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2fc47-f23c-4ba8-a7c1-78dd8931b98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:56.065504 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2fc47-f23c-4ba8-a7c1-78dd8931b98e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:56.065811 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2fc47-f23c-4ba8-a7c1-78dd8931b98e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:56.066085 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2fc47-f23c-4ba8-a7c1-78dd8931b98e None admin] PATH_INFO: `/v3/projects/350b6dccdfa543e18bffdf3853710ebf` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:56.067369 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2fc47-f23c-4ba8-a7c1-78dd8931b98e None admin] RBAC: Authorizing `identity:get_project(project_id=350b6dccdfa543e18bffdf3853710ebf)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:56.068857 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2fc47-f23c-4ba8-a7c1-78dd8931b98e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:56.071018 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 112/222] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Oct 27 13:11:55 2022] GET /identity/v3/projects/350b6dccdfa543e18bffdf3853710ebf => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:56.076811 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4157143-024a-489a-855f-bc8a678165e4 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:56.184394 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4157143-024a-489a-855f-bc8a678165e4 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:56.222252 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca708af-9e82-40a3-bd68-dd95bccac743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:56.222883 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca708af-9e82-40a3-bd68-dd95bccac743 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:56.223261 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca708af-9e82-40a3-bd68-dd95bccac743 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:56.223511 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca708af-9e82-40a3-bd68-dd95bccac743 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:56.224237 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca708af-9e82-40a3-bd68-dd95bccac743 None admin] RBAC: Adding query filter params (role.id=55046f1a884449f4a429f1f572f53ec6, scope.project.id=350b6dccdfa543e18bffdf3853710ebf, user.id=84afce831f6d4995bce1c2f5c897b31d) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:11:56.224544 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca708af-9e82-40a3-bd68-dd95bccac743 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:56.226047 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca708af-9e82-40a3-bd68-dd95bccac743 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:56.237679 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 111/223] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Oct 27 13:11:56 2022] GET /identity/v3/role_assignments?user.id=84afce831f6d4995bce1c2f5c897b31d&scope.project.id=350b6dccdfa543e18bffdf3853710ebf&role.id=55046f1a884449f4a429f1f572f53ec6 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:57.324805 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910b93a-60ab-41e5-85a9-df90c8ca209d None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:57.325388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910b93a-60ab-41e5-85a9-df90c8ca209d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:57.325388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910b93a-60ab-41e5-85a9-df90c8ca209d None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:57.327017 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 113/224] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:11:57.333015 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f784447-58ae-4075-be6b-04ac00225f67 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:57.333598 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f784447-58ae-4075-be6b-04ac00225f67 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:57.333598 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f784447-58ae-4075-be6b-04ac00225f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:57.353739 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-0f784447-58ae-4075-be6b-04ac00225f67 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:11:57.354942 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0f784447-58ae-4075-be6b-04ac00225f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:11:57.407784 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:57.427047 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03296c-b588-4c2f-b34b-678d02344acf None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:57.427362 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03296c-b588-4c2f-b34b-678d02344acf None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:57.427622 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03296c-b588-4c2f-b34b-678d02344acf None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:57.429084 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 114/225] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 13:11:57.433580 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 112/226] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:11:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:11:57.434441 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8dffb-917b-4536-bc0e-741b2f50ba22 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:57.434715 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8dffb-917b-4536-bc0e-741b2f50ba22 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:57.434977 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8dffb-917b-4536-bc0e-741b2f50ba22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:57.452818 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f412ef8-c9ec-4da8-89c7-8eea4288bd28 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:57.453101 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f412ef8-c9ec-4da8-89c7-8eea4288bd28 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:57.453361 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f412ef8-c9ec-4da8-89c7-8eea4288bd28 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:57.453517 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-05a8dffb-917b-4536-bc0e-741b2f50ba22 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:11:57.454873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-05a8dffb-917b-4536-bc0e-741b2f50ba22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:11:57.454973 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 113/227] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 13:11:57.459962 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec02e9-2b36-4990-9bb3-cd61505ac276 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:57.460223 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec02e9-2b36-4990-9bb3-cd61505ac276 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:57.460459 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec02e9-2b36-4990-9bb3-cd61505ac276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:57.479380 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-4bec02e9-2b36-4990-9bb3-cd61505ac276 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:11:57.480555 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-4bec02e9-2b36-4990-9bb3-cd61505ac276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:11:57.525592 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 115/228] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:11:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 13:11:57.549929 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 114/229] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:11:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 13:11:57.700385 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8dffb-917b-4536-bc0e-741b2f50ba22 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:57.767847 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:57.789876 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec02e9-2b36-4990-9bb3-cd61505ac276 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:57.809932 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8dffb-917b-4536-bc0e-741b2f50ba22 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:57.847183 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d91a4-04e7-4950-823c-c5b8ffd7e6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:57.847806 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d91a4-04e7-4950-823c-c5b8ffd7e6b8 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:57.848120 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d91a4-04e7-4950-823c-c5b8ffd7e6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:57.848444 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d91a4-04e7-4950-823c-c5b8ffd7e6b8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:57.858640 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d91a4-04e7-4950-823c-c5b8ffd7e6b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:11:57.863497 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-316d91a4-04e7-4950-823c-c5b8ffd7e6b8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 13:11:57.863497 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:11:57.863497 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:11:57.863497 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:11:57.863497 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:11:57.863497 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:11:57.863497 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:11:57.863497 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:11:57.863497 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:11:57.863497 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:11:57.863497 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:11:57.863497 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:11:57.863497 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:11:57.863497 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:11:57.863497 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:11:57.863497 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:11:57.864578 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:11:57.864578 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:11:57.864578 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:11:57.864578 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:11:57.864578 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:11:57.864578 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:11:57.864578 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:11:57.864578 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:11:57.864578 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:11:57.864578 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:11:57.864578 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:11:57.864578 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:11:57.864578 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:11:57.864578 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:11:57.864578 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:11:57.864578 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:11:57.865352 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:11:57.865352 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:11:57.865352 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:11:57.865352 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:11:57.865352 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:11:57.865352 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:11:57.865352 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:11:57.865352 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:11:57.865352 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:11:57.865352 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:11:57.865352 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 13:11:57.865352 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:11:57.865352 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 116/230] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Oct 27 13:11:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:11:57.866046 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d91a4-04e7-4950-823c-c5b8ffd7e6b8 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:57.893209 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec02e9-2b36-4990-9bb3-cd61505ac276 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:57.906639 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:57.927603 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c5e45-11ef-45e2-ad88-fb8a1669d96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:57.928239 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c5e45-11ef-45e2-ad88-fb8a1669d96b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:57.928514 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c5e45-11ef-45e2-ad88-fb8a1669d96b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:57.928779 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c5e45-11ef-45e2-ad88-fb8a1669d96b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:57.929897 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c5e45-11ef-45e2-ad88-fb8a1669d96b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:57.931363 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c5e45-11ef-45e2-ad88-fb8a1669d96b None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:57.934351 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 115/231] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:11:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:11:57.934351 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c5e45-11ef-45e2-ad88-fb8a1669d96b None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:57.968080 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d91a4-04e7-4950-823c-c5b8ffd7e6b8 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:57.994789 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:58.003892 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c3807-a89e-4821-b392-a63892d14e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:58.004536 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c3807-a89e-4821-b392-a63892d14e12 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:58.004811 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c3807-a89e-4821-b392-a63892d14e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:58.005076 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c3807-a89e-4821-b392-a63892d14e12 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:58.015103 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c3807-a89e-4821-b392-a63892d14e12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:11:58.020008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-c59c3807-a89e-4821-b392-a63892d14e12 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 13:11:58.020008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:11:58.020008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:11:58.020008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:11:58.020008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:11:58.020008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:11:58.020008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:11:58.020008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:11:58.020008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:11:58.020008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:11:58.020008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:11:58.020008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:11:58.020008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:11:58.020008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:11:58.020008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:11:58.020008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:11:58.020873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:11:58.020873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:11:58.020873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:11:58.020873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:11:58.020873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:11:58.020873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:11:58.020873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:11:58.020873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:11:58.020873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:11:58.020873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:11:58.020873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:11:58.020873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:11:58.020873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:11:58.020873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:11:58.020873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:11:58.020873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:11:58.021996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:11:58.021996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:11:58.021996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:11:58.021996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:11:58.021996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:11:58.021996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:11:58.021996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:11:58.021996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:11:58.021996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:11:58.021996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:11:58.021996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 13:11:58.021996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:11:58.021996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 117/232] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Oct 27 13:11:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:11:58.021996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c3807-a89e-4821-b392-a63892d14e12 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:58.035453 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c5e45-11ef-45e2-ad88-fb8a1669d96b None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:58.070162 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b1743-83c6-45c8-9586-0479bf9875a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:58.070750 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b1743-83c6-45c8-9586-0479bf9875a7 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:58.071027 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b1743-83c6-45c8-9586-0479bf9875a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:58.071292 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b1743-83c6-45c8-9586-0479bf9875a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:58.071952 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083b1743-83c6-45c8-9586-0479bf9875a7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:11:58.072250 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083b1743-83c6-45c8-9586-0479bf9875a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:58.073660 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083b1743-83c6-45c8-9586-0479bf9875a7 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:58.081763 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 116/233] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Oct 27 13:11:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:58.082733 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b1743-83c6-45c8-9586-0479bf9875a7 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:58.119060 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c3807-a89e-4821-b392-a63892d14e12 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:58.125355 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:58.153146 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc78f2-dfef-4cc9-91a8-adf97b80dc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:58.153775 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc78f2-dfef-4cc9-91a8-adf97b80dc12 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:58.154052 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc78f2-dfef-4cc9-91a8-adf97b80dc12 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:58.154321 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc78f2-dfef-4cc9-91a8-adf97b80dc12 None admin] PATH_INFO: `/v3/groups` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:58.154940 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc78f2-dfef-4cc9-91a8-adf97b80dc12 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:58.156412 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc78f2-dfef-4cc9-91a8-adf97b80dc12 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:58.172626 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 118/234] 10.222.0.52 () {60 vars in 1134 bytes} [Thu Oct 27 13:11:58 2022] POST /identity/v3/groups => generated 229 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:11:58.173438 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc78f2-dfef-4cc9-91a8-adf97b80dc12 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:58.187820 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b1743-83c6-45c8-9586-0479bf9875a7 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:58.227639 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558d03d-cad6-4d0b-8169-e8eeee6036f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:58.228143 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558d03d-cad6-4d0b-8169-e8eeee6036f6 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:58.228421 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558d03d-cad6-4d0b-8169-e8eeee6036f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:58.228719 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558d03d-cad6-4d0b-8169-e8eeee6036f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:58.229424 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9558d03d-cad6-4d0b-8169-e8eeee6036f6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:11:58.229752 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9558d03d-cad6-4d0b-8169-e8eeee6036f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:58.231196 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9558d03d-cad6-4d0b-8169-e8eeee6036f6 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:58.232810 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:58.242505 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 117/235] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Oct 27 13:11:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:58.248506 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558d03d-cad6-4d0b-8169-e8eeee6036f6 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:58.301906 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc78f2-dfef-4cc9-91a8-adf97b80dc12 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:58.339875 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e3232-a91b-416c-a8cf-211c38021595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:58.340682 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e3232-a91b-416c-a8cf-211c38021595 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:58.340964 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e3232-a91b-416c-a8cf-211c38021595 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:58.341240 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e3232-a91b-416c-a8cf-211c38021595 None admin] PATH_INFO: `/v3/users/58e79db8667e418cac7f545d2e161892` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:58.356760 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452e3232-a91b-416c-a8cf-211c38021595 None admin] RBAC: Authorizing `identity:get_user(user_id=58e79db8667e418cac7f545d2e161892)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:58.358828 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452e3232-a91b-416c-a8cf-211c38021595 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:58.360336 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 119/236] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Oct 27 13:11:58 2022] GET /identity/v3/users/58e79db8667e418cac7f545d2e161892 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:58.362495 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558d03d-cad6-4d0b-8169-e8eeee6036f6 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:58.365405 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:58.366028 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e3232-a91b-416c-a8cf-211c38021595 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:58.405339 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101ae20-66f5-4b91-8e6e-2261fdb356f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:58.406041 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101ae20-66f5-4b91-8e6e-2261fdb356f0 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:58.406321 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101ae20-66f5-4b91-8e6e-2261fdb356f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:58.406577 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101ae20-66f5-4b91-8e6e-2261fdb356f0 None admin] PATH_INFO: `/v3/users/6c164b623a6e450fa4730dd4d7ee1423` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:58.407791 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b101ae20-66f5-4b91-8e6e-2261fdb356f0 None admin] RBAC: Authorizing `identity:get_user(user_id=6c164b623a6e450fa4730dd4d7ee1423)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:58.409320 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b101ae20-66f5-4b91-8e6e-2261fdb356f0 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:58.411176 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 118/237] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Oct 27 13:11:58 2022] GET /identity/v3/users/6c164b623a6e450fa4730dd4d7ee1423 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:11:58.416664 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101ae20-66f5-4b91-8e6e-2261fdb356f0 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:11:58.477412 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e3232-a91b-416c-a8cf-211c38021595 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:58.480068 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:11:58.517983 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d3adf-7100-4ff4-9746-2295d2fb822b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:58.518622 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d3adf-7100-4ff4-9746-2295d2fb822b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:58.518900 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d3adf-7100-4ff4-9746-2295d2fb822b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:58.519170 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d3adf-7100-4ff4-9746-2295d2fb822b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:58.519917 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d3adf-7100-4ff4-9746-2295d2fb822b None admin] RBAC: Adding query filter params (role.id=55046f1a884449f4a429f1f572f53ec6, user.id=58e79db8667e418cac7f545d2e161892, scope.system=all) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:11:58.520223 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d3adf-7100-4ff4-9746-2295d2fb822b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:58.521703 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d3adf-7100-4ff4-9746-2295d2fb822b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:58.526313 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101ae20-66f5-4b91-8e6e-2261fdb356f0 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:11:58.526671 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 120/238] 10.222.0.52 () {56 vars in 1308 bytes} [Thu Oct 27 13:11:58 2022] GET /identity/v3/role_assignments?user.id=58e79db8667e418cac7f545d2e161892&scope.system=all&role.id=55046f1a884449f4a429f1f572f53ec6 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:11:58.575512 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c34204-48d2-4376-b965-c944fe971075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:11:58.576183 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c34204-48d2-4376-b965-c944fe971075 None admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:11:58.576461 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c34204-48d2-4376-b965-c944fe971075 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:11:58.576730 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c34204-48d2-4376-b965-c944fe971075 None admin] PATH_INFO: `/v3/system/users/6c164b623a6e450fa4730dd4d7ee1423/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:11:58.578185 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c34204-48d2-4376-b965-c944fe971075 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6c164b623a6e450fa4730dd4d7ee1423, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:11:58.579603 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c34204-48d2-4376-b965-c944fe971075 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:11:58.596280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 119/239] 10.222.0.52 () {58 vars in 1334 bytes} [Thu Oct 27 13:11:58 2022] PUT /identity/v3/system/users/6c164b623a6e450fa4730dd4d7ee1423/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:12:00.340297 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13cc57-8989-4b11-bb00-cccf35e657f3 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:00.340815 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13cc57-8989-4b11-bb00-cccf35e657f3 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:00.340815 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13cc57-8989-4b11-bb00-cccf35e657f3 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:00.342229 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 121/240] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:00.347565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1610891-56dd-409f-b5a8-72b2b6d79cef None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:00.348100 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1610891-56dd-409f-b5a8-72b2b6d79cef None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:00.348419 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1610891-56dd-409f-b5a8-72b2b6d79cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:00.367165 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-e1610891-56dd-409f-b5a8-72b2b6d79cef None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:00.368333 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e1610891-56dd-409f-b5a8-72b2b6d79cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:00.398862 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:00.442218 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 120/241] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:12:00.650569 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb6cc3-fafa-4188-b0ba-70d5a1f04d50 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:00.650769 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb6cc3-fafa-4188-b0ba-70d5a1f04d50 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:00.651041 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb6cc3-fafa-4188-b0ba-70d5a1f04d50 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:00.652346 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 122/242] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:00.657763 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558f792-91cc-4dfe-930f-1f8999e1c285 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:00.658020 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558f792-91cc-4dfe-930f-1f8999e1c285 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:00.658317 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558f792-91cc-4dfe-930f-1f8999e1c285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:00.677097 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-c558f792-91cc-4dfe-930f-1f8999e1c285 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:00.678301 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c558f792-91cc-4dfe-930f-1f8999e1c285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:00.698269 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aee722-b437-4fc5-a22b-f21d7d6a8b15 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:00.698553 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aee722-b437-4fc5-a22b-f21d7d6a8b15 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:00.698834 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aee722-b437-4fc5-a22b-f21d7d6a8b15 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:00.700197 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 123/243] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 13:12:00.706406 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427af105-be57-4a89-9af5-3df3ff9123ed None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:00.706659 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427af105-be57-4a89-9af5-3df3ff9123ed None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:00.706966 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427af105-be57-4a89-9af5-3df3ff9123ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:00.724855 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-427af105-be57-4a89-9af5-3df3ff9123ed None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:00.726047 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-427af105-be57-4a89-9af5-3df3ff9123ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:00.752186 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 121/244] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:12:00.753036 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558f792-91cc-4dfe-930f-1f8999e1c285 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:00.798388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 124/245] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 13:12:00.865929 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:00.872040 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558f792-91cc-4dfe-930f-1f8999e1c285 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:00.907355 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f1e6d-080f-409c-b4ef-1e298a94dc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:00.907897 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f1e6d-080f-409c-b4ef-1e298a94dc47 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:00.908167 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f1e6d-080f-409c-b4ef-1e298a94dc47 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:00.908432 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f1e6d-080f-409c-b4ef-1e298a94dc47 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:00.909519 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f1e6d-080f-409c-b4ef-1e298a94dc47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:00.911148 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f1e6d-080f-409c-b4ef-1e298a94dc47 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:00.912891 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 122/246] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:12:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:00.918443 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427af105-be57-4a89-9af5-3df3ff9123ed None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:01.013787 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f1e6d-080f-409c-b4ef-1e298a94dc47 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:01.015367 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:01.020578 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427af105-be57-4a89-9af5-3df3ff9123ed None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:01.057801 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3afb04-bcb4-4d26-b4af-a68bfeb9d139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:01.058432 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3afb04-bcb4-4d26-b4af-a68bfeb9d139 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:01.058711 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3afb04-bcb4-4d26-b4af-a68bfeb9d139 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:01.058980 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3afb04-bcb4-4d26-b4af-a68bfeb9d139 None admin] PATH_INFO: `/v3/groups` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:01.059614 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3afb04-bcb4-4d26-b4af-a68bfeb9d139 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:01.061074 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3afb04-bcb4-4d26-b4af-a68bfeb9d139 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:01.076425 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 125/247] 10.222.0.52 () {60 vars in 1134 bytes} [Thu Oct 27 13:12:00 2022] POST /identity/v3/groups => generated 226 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:12:01.077222 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3afb04-bcb4-4d26-b4af-a68bfeb9d139 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:01.124122 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f1e6d-080f-409c-b4ef-1e298a94dc47 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:01.160856 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b978925-f73f-43ca-a10c-86978d107e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:01.161421 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b978925-f73f-43ca-a10c-86978d107e2a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:01.161729 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b978925-f73f-43ca-a10c-86978d107e2a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:01.161998 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b978925-f73f-43ca-a10c-86978d107e2a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:01.173266 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b978925-f73f-43ca-a10c-86978d107e2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:12:01.178545 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-5b978925-f73f-43ca-a10c-86978d107e2a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 13:12:01.178545 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:01.178545 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:01.178545 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:01.178545 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:01.178545 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:01.178545 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:01.178545 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:01.178545 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:01.178545 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:01.178545 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:01.178545 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:01.178545 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:12:01.178545 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:12:01.178545 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:12:01.178545 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:12:01.179485 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:12:01.179485 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:12:01.179485 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:12:01.179485 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:12:01.179485 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:01.179485 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:01.179485 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:01.179485 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:01.179485 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:01.179485 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:01.179485 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:01.179485 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:01.179485 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:01.179485 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:01.179485 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:01.179485 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:01.180282 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:01.180282 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:01.180282 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:01.180282 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:01.180282 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:12:01.180282 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:12:01.180282 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:12:01.180282 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:12:01.180282 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:12:01.180282 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:12:01.180282 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 13:12:01.180282 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:01.180282 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 123/248] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Oct 27 13:12:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:12:01.186146 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b978925-f73f-43ca-a10c-86978d107e2a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:01.192562 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3afb04-bcb4-4d26-b4af-a68bfeb9d139 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:01.216812 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:01.232709 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b686bc5-5cba-42f3-80c2-dd5c5e771591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:01.233348 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b686bc5-5cba-42f3-80c2-dd5c5e771591 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:01.233731 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b686bc5-5cba-42f3-80c2-dd5c5e771591 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:01.233999 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b686bc5-5cba-42f3-80c2-dd5c5e771591 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:01.245352 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b686bc5-5cba-42f3-80c2-dd5c5e771591 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:12:01.251409 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-9b686bc5-5cba-42f3-80c2-dd5c5e771591 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 13:12:01.251409 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:01.251409 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:01.251409 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:01.251409 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:01.251409 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:01.251409 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:01.251409 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:01.251409 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:01.251409 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:01.251409 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:01.251409 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:01.251409 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:12:01.251409 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:12:01.251409 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:12:01.251409 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:12:01.252317 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:12:01.252317 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:12:01.252317 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:12:01.252317 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:12:01.252317 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:01.252317 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:01.252317 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:01.252317 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:01.252317 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:01.252317 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:01.252317 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:01.252317 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:01.252317 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:01.252317 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:01.252317 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:01.252317 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:01.253102 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:01.253102 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:01.253102 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:01.253102 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:01.253102 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:12:01.253102 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:12:01.253102 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:12:01.253102 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:12:01.253102 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:12:01.253102 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:12:01.253102 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 13:12:01.253102 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:01.253775 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 126/249] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Oct 27 13:12:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:01.259267 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b686bc5-5cba-42f3-80c2-dd5c5e771591 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:01.279032 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:01.311629 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b978925-f73f-43ca-a10c-86978d107e2a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:01.349362 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1adec-f4c2-449b-99ab-577bb3f5ff9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:01.350030 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1adec-f4c2-449b-99ab-577bb3f5ff9b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:01.350265 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1adec-f4c2-449b-99ab-577bb3f5ff9b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:01.350427 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1adec-f4c2-449b-99ab-577bb3f5ff9b None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:01.351840 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d1adec-f4c2-449b-99ab-577bb3f5ff9b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:01.351840 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d1adec-f4c2-449b-99ab-577bb3f5ff9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:01.354129 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d1adec-f4c2-449b-99ab-577bb3f5ff9b None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:01.362032 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 124/250] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Oct 27 13:12:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:12:01.368246 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1adec-f4c2-449b-99ab-577bb3f5ff9b None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:01.372380 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b686bc5-5cba-42f3-80c2-dd5c5e771591 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:01.413381 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69910ce-3499-47d2-91e2-81ccdd0dff6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:01.413910 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69910ce-3499-47d2-91e2-81ccdd0dff6a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:01.414186 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69910ce-3499-47d2-91e2-81ccdd0dff6a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:01.414456 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69910ce-3499-47d2-91e2-81ccdd0dff6a None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:01.415121 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69910ce-3499-47d2-91e2-81ccdd0dff6a None admin] RBAC: Adding query filter params (name=member) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:01.415421 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69910ce-3499-47d2-91e2-81ccdd0dff6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:01.417275 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69910ce-3499-47d2-91e2-81ccdd0dff6a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:01.427270 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 127/251] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Oct 27 13:12:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:12:01.433246 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69910ce-3499-47d2-91e2-81ccdd0dff6a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:01.478502 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:01.498987 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1adec-f4c2-449b-99ab-577bb3f5ff9b None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:01.547298 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21db13b-afda-4f0b-9e26-55fe04248295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:01.547936 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21db13b-afda-4f0b-9e26-55fe04248295 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:01.548211 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21db13b-afda-4f0b-9e26-55fe04248295 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:01.548480 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21db13b-afda-4f0b-9e26-55fe04248295 None admin] PATH_INFO: `/v3/users/58e79db8667e418cac7f545d2e161892` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:01.549749 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21db13b-afda-4f0b-9e26-55fe04248295 None admin] RBAC: Authorizing `identity:get_user(user_id=58e79db8667e418cac7f545d2e161892)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:01.551798 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21db13b-afda-4f0b-9e26-55fe04248295 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:01.553988 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 125/252] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Oct 27 13:12:01 2022] GET /identity/v3/users/58e79db8667e418cac7f545d2e161892 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:12:01.555385 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:01.561149 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21db13b-afda-4f0b-9e26-55fe04248295 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:01.568897 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69910ce-3499-47d2-91e2-81ccdd0dff6a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:01.610524 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2646e1-a376-47fa-a40f-fe8fc8a209a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:01.612009 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2646e1-a376-47fa-a40f-fe8fc8a209a3 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:01.612512 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2646e1-a376-47fa-a40f-fe8fc8a209a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:01.612978 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2646e1-a376-47fa-a40f-fe8fc8a209a3 None admin] PATH_INFO: `/v3/users/6c164b623a6e450fa4730dd4d7ee1423` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:01.615100 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2646e1-a376-47fa-a40f-fe8fc8a209a3 None admin] RBAC: Authorizing `identity:get_user(user_id=6c164b623a6e450fa4730dd4d7ee1423)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:01.617362 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2646e1-a376-47fa-a40f-fe8fc8a209a3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:01.619501 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 128/253] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Oct 27 13:12:01 2022] GET /identity/v3/users/6c164b623a6e450fa4730dd4d7ee1423 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:12:01.624741 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2646e1-a376-47fa-a40f-fe8fc8a209a3 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:01.689049 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21db13b-afda-4f0b-9e26-55fe04248295 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:01.725667 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0403883-d80f-4ffb-a855-92e7811e9a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:01.726821 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0403883-d80f-4ffb-a855-92e7811e9a65 None admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:01.727605 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0403883-d80f-4ffb-a855-92e7811e9a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:01.728074 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0403883-d80f-4ffb-a855-92e7811e9a65 None admin] PATH_INFO: `/v3/system/users/58e79db8667e418cac7f545d2e161892/roles/55046f1a884449f4a429f1f572f53ec6` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:01.729735 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0403883-d80f-4ffb-a855-92e7811e9a65 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=58e79db8667e418cac7f545d2e161892, role_id=55046f1a884449f4a429f1f572f53ec6)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:01.731591 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0403883-d80f-4ffb-a855-92e7811e9a65 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:01.741723 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 126/254] 10.222.0.52 () {58 vars in 1334 bytes} [Thu Oct 27 13:12:01 2022] PUT /identity/v3/system/users/58e79db8667e418cac7f545d2e161892/roles/55046f1a884449f4a429f1f572f53ec6 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:12:01.791383 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2646e1-a376-47fa-a40f-fe8fc8a209a3 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:01.831437 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a3ff01-ddf3-4116-b2ba-9741a060e030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:01.832537 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3ff01-ddf3-4116-b2ba-9741a060e030 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:01.833141 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3ff01-ddf3-4116-b2ba-9741a060e030 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:01.833649 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3ff01-ddf3-4116-b2ba-9741a060e030 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:01.834738 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a3ff01-ddf3-4116-b2ba-9741a060e030 None admin] RBAC: Adding query filter params (role.id=3a0f9a2e42334ab59845114892813223, user.id=6c164b623a6e450fa4730dd4d7ee1423, scope.system=all) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:01.835285 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a3ff01-ddf3-4116-b2ba-9741a060e030 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:01.837198 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a3ff01-ddf3-4116-b2ba-9741a060e030 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:01.851971 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 129/255] 10.222.0.52 () {56 vars in 1308 bytes} [Thu Oct 27 13:12:01 2022] GET /identity/v3/role_assignments?user.id=6c164b623a6e450fa4730dd4d7ee1423&scope.system=all&role.id=3a0f9a2e42334ab59845114892813223 => generated 510 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:12:03.470321 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5340671a-fe6f-410a-8365-b4cccc14ba39 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:03.471369 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5340671a-fe6f-410a-8365-b4cccc14ba39 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:03.471845 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5340671a-fe6f-410a-8365-b4cccc14ba39 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:03.473925 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 127/256] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:03.479041 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612988a1-21fd-4f1c-b5b4-f9435e490379 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:03.479861 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612988a1-21fd-4f1c-b5b4-f9435e490379 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:03.480333 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612988a1-21fd-4f1c-b5b4-f9435e490379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:03.495882 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:03.502827 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-612988a1-21fd-4f1c-b5b4-f9435e490379 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:03.504551 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-612988a1-21fd-4f1c-b5b4-f9435e490379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:03.581317 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 130/257] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 27 13:12:03.903813 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5340671a-fe6f-410a-8365-b4cccc14ba39 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:03.921986 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5340671a-fe6f-410a-8365-b4cccc14ba39 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:03.926702 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00d137-66a1-42ff-b65d-8ca7daea369c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:03.927692 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00d137-66a1-42ff-b65d-8ca7daea369c admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:03.928197 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00d137-66a1-42ff-b65d-8ca7daea369c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:03.928656 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00d137-66a1-42ff-b65d-8ca7daea369c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:03.946419 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00d137-66a1-42ff-b65d-8ca7daea369c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:12:03.951658 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-fe00d137-66a1-42ff-b65d-8ca7daea369c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 13:12:03.951658 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:03.951658 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:03.951658 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:03.951658 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:03.951658 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:03.951658 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:03.951658 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:03.951658 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:03.951658 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:03.951658 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:03.951658 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:03.951658 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:12:03.951658 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:12:03.951658 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:12:03.951658 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:12:03.952517 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:12:03.952517 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:12:03.952517 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:12:03.952517 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:12:03.952517 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:03.952517 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:03.952517 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:03.952517 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:03.952517 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:03.952517 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:03.952517 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:03.952517 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:03.952517 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:03.952517 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:03.952517 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:03.952517 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:03.953349 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:03.953349 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:03.953349 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:03.953349 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:03.953349 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:12:03.953349 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:12:03.953349 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:12:03.953349 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:12:03.953349 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:12:03.953349 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:12:03.953349 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 13:12:03.953349 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:03.956008 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 128/258] 10.222.0.52 () {56 vars in 1120 bytes} [Thu Oct 27 13:12:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:03.961775 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612988a1-21fd-4f1c-b5b4-f9435e490379 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:03.971471 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612988a1-21fd-4f1c-b5b4-f9435e490379 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:03.976262 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672008e-baed-440c-9e90-e5e615decf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:03.977106 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672008e-baed-440c-9e90-e5e615decf5c admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:03.977608 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672008e-baed-440c-9e90-e5e615decf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:03.978076 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672008e-baed-440c-9e90-e5e615decf5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:03.978939 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672008e-baed-440c-9e90-e5e615decf5c admin admin] RBAC: Adding query filter params (name=member) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:03.979471 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672008e-baed-440c-9e90-e5e615decf5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:03.981468 dv-cinder-862432-3-smb devstack@keystone.service[81481]: WARNING py.warnings [None req-9672008e-baed-440c-9e90-e5e615decf5c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:12:03.981468 dv-cinder-862432-3-smb devstack@keystone.service[81481]: warnings.warn(msg) Oct 27 13:12:03.981468 dv-cinder-862432-3-smb devstack@keystone.service[81481]: Oct 27 13:12:03.982730 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672008e-baed-440c-9e90-e5e615decf5c admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:03.997228 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 131/259] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Oct 27 13:12:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:04.002839 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00d137-66a1-42ff-b65d-8ca7daea369c admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:04.013699 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00d137-66a1-42ff-b65d-8ca7daea369c admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:04.018391 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2b9de-63f5-4754-9e16-e8e1e66fd2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:04.019245 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2b9de-63f5-4754-9e16-e8e1e66fd2eb admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:04.019904 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2b9de-63f5-4754-9e16-e8e1e66fd2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:04.020372 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2b9de-63f5-4754-9e16-e8e1e66fd2eb admin admin] PATH_INFO: `/v3/groups/9c4eec6dae5b45d185c5afdaf338a033` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:04.022851 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:04.031414 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac2b9de-63f5-4754-9e16-e8e1e66fd2eb admin admin] RBAC: Authorizing `identity:get_group(group_id=9c4eec6dae5b45d185c5afdaf338a033)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:04.033312 dv-cinder-862432-3-smb devstack@keystone.service[81482]: WARNING py.warnings [None req-9ac2b9de-63f5-4754-9e16-e8e1e66fd2eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:12:04.033312 dv-cinder-862432-3-smb devstack@keystone.service[81482]: warnings.warn(msg) Oct 27 13:12:04.033312 dv-cinder-862432-3-smb devstack@keystone.service[81482]: Oct 27 13:12:04.034702 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac2b9de-63f5-4754-9e16-e8e1e66fd2eb admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:04.037551 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 129/260] 10.222.0.52 () {56 vars in 1201 bytes} [Thu Oct 27 13:12:04 2022] GET /identity/v3/groups/9c4eec6dae5b45d185c5afdaf338a033 => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:04.043526 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672008e-baed-440c-9e90-e5e615decf5c admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:04.055528 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672008e-baed-440c-9e90-e5e615decf5c admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:04.060535 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d2cce-9d6b-4b19-931b-b2d0e38e16d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:04.061207 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d2cce-9d6b-4b19-931b-b2d0e38e16d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:04.061525 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d2cce-9d6b-4b19-931b-b2d0e38e16d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:04.061825 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d2cce-9d6b-4b19-931b-b2d0e38e16d0 admin admin] PATH_INFO: `/v3/projects/9a7e52ec5fb64c04a51ab3c08adf1d8b` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:04.063011 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d2cce-9d6b-4b19-931b-b2d0e38e16d0 admin admin] RBAC: Authorizing `identity:get_project(project_id=9a7e52ec5fb64c04a51ab3c08adf1d8b)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:04.065131 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d2cce-9d6b-4b19-931b-b2d0e38e16d0 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:04.067231 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 132/261] 10.222.0.52 () {56 vars in 1207 bytes} [Thu Oct 27 13:12:04 2022] GET /identity/v3/projects/9a7e52ec5fb64c04a51ab3c08adf1d8b => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:04.073099 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2b9de-63f5-4754-9e16-e8e1e66fd2eb admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:04.083585 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2b9de-63f5-4754-9e16-e8e1e66fd2eb admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:04.088053 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3b8a8-49e3-47b7-bdd7-7561bbd4a6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:04.088771 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3b8a8-49e3-47b7-bdd7-7561bbd4a6c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:04.089050 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3b8a8-49e3-47b7-bdd7-7561bbd4a6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:04.089376 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3b8a8-49e3-47b7-bdd7-7561bbd4a6c6 admin admin] PATH_INFO: `/v3/projects/9a7e52ec5fb64c04a51ab3c08adf1d8b/groups/9c4eec6dae5b45d185c5afdaf338a033/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:04.095490 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3b8a8-49e3-47b7-bdd7-7561bbd4a6c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a7e52ec5fb64c04a51ab3c08adf1d8b, group_id=9c4eec6dae5b45d185c5afdaf338a033, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:04.096594 dv-cinder-862432-3-smb devstack@keystone.service[81482]: WARNING py.warnings [None req-50b3b8a8-49e3-47b7-bdd7-7561bbd4a6c6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:12:04.096594 dv-cinder-862432-3-smb devstack@keystone.service[81482]: warnings.warn(msg) Oct 27 13:12:04.096594 dv-cinder-862432-3-smb devstack@keystone.service[81482]: Oct 27 13:12:04.098896 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3b8a8-49e3-47b7-bdd7-7561bbd4a6c6 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:04.121852 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 130/262] 10.222.0.52 () {58 vars in 1463 bytes} [Thu Oct 27 13:12:04 2022] PUT /identity/v3/projects/9a7e52ec5fb64c04a51ab3c08adf1d8b/groups/9c4eec6dae5b45d185c5afdaf338a033/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:12:04.332517 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83048234-51e1-4318-ac87-780bfaec2e50 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:04.332689 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83048234-51e1-4318-ac87-780bfaec2e50 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:04.332968 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83048234-51e1-4318-ac87-780bfaec2e50 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:04.334628 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 133/263] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:04.339893 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b4aef-24a2-43da-b35a-ffd5f2a59b8d None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:04.340171 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b4aef-24a2-43da-b35a-ffd5f2a59b8d None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:04.340448 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b4aef-24a2-43da-b35a-ffd5f2a59b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:04.366631 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-d50b4aef-24a2-43da-b35a-ffd5f2a59b8d None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:04.367881 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d50b4aef-24a2-43da-b35a-ffd5f2a59b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:04.375695 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeaf7af-34cf-47c9-887e-3f9359ebf109 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:04.375984 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeaf7af-34cf-47c9-887e-3f9359ebf109 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:04.376250 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeaf7af-34cf-47c9-887e-3f9359ebf109 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:04.377848 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 134/264] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 13:12:04.403822 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b0097-2b4c-4ad5-893d-21b4b2efbdb4 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:04.404133 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b0097-2b4c-4ad5-893d-21b4b2efbdb4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:04.404379 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b0097-2b4c-4ad5-893d-21b4b2efbdb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:04.453495 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-c37b0097-2b4c-4ad5-893d-21b4b2efbdb4 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:04.456836 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c37b0097-2b4c-4ad5-893d-21b4b2efbdb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:04.492898 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 131/265] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 27 13:12:04.553872 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 135/266] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:12:04.620065 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9ac67-be69-40e6-8135-959eee431f4c None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:04.620676 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9ac67-be69-40e6-8135-959eee431f4c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:04.621242 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9ac67-be69-40e6-8135-959eee431f4c None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:04.623173 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 132/267] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:04.629296 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f1c0a-6624-499d-ab68-de0fe8318553 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:04.630000 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f1c0a-6624-499d-ab68-de0fe8318553 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:04.630575 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f1c0a-6624-499d-ab68-de0fe8318553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:04.652665 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e14f1c0a-6624-499d-ab68-de0fe8318553 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:04.654250 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e14f1c0a-6624-499d-ab68-de0fe8318553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:04.664271 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 136/268] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 27 13:12:04.802219 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9ac67-be69-40e6-8135-959eee431f4c None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:04.819679 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9ac67-be69-40e6-8135-959eee431f4c None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:04.826796 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb54f21-d140-418e-af45-986f43c39dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:04.827659 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb54f21-d140-418e-af45-986f43c39dbb admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:04.828130 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb54f21-d140-418e-af45-986f43c39dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:04.828593 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb54f21-d140-418e-af45-986f43c39dbb admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:04.846829 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb54f21-d140-418e-af45-986f43c39dbb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:12:04.852261 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-eeb54f21-d140-418e-af45-986f43c39dbb admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 13:12:04.852261 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:04.852261 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:04.852261 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:04.852261 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:04.852261 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:04.852261 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:04.852261 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:04.852261 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:04.852261 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:04.852261 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:04.852261 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:04.852261 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:12:04.852261 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:12:04.852261 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:12:04.852261 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:12:04.853106 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:12:04.853106 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:12:04.853106 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:12:04.853106 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:12:04.853106 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:04.853106 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:04.853106 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:04.853106 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:04.853106 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:04.853106 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:04.853106 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:04.853106 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:04.853106 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:04.853106 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:04.853106 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:04.853106 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:04.853949 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:04.853949 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:04.853949 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:04.853949 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:04.853949 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:12:04.853949 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:12:04.853949 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:12:04.853949 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:12:04.853949 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:12:04.853949 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:12:04.853949 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 13:12:04.853949 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:04.856297 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 133/269] 10.222.0.52 () {56 vars in 1120 bytes} [Thu Oct 27 13:12:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:04.861989 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f1c0a-6624-499d-ab68-de0fe8318553 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:04.872271 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f1c0a-6624-499d-ab68-de0fe8318553 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:04.879433 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf2e78-94b6-4a43-85e6-b830fe2ccabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:04.880283 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf2e78-94b6-4a43-85e6-b830fe2ccabb admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:04.880787 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf2e78-94b6-4a43-85e6-b830fe2ccabb admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:04.881247 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf2e78-94b6-4a43-85e6-b830fe2ccabb admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:04.882154 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf2e78-94b6-4a43-85e6-b830fe2ccabb admin admin] RBAC: Adding query filter params (name=member) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:04.882681 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf2e78-94b6-4a43-85e6-b830fe2ccabb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:04.884605 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf2e78-94b6-4a43-85e6-b830fe2ccabb admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:04.894883 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 137/270] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Oct 27 13:12:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:04.900971 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb54f21-d140-418e-af45-986f43c39dbb admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:04.913870 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb54f21-d140-418e-af45-986f43c39dbb admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:04.918710 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb5902-b5fe-46e8-8f55-adabed7e8a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:04.919612 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb5902-b5fe-46e8-8f55-adabed7e8a60 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:04.920124 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb5902-b5fe-46e8-8f55-adabed7e8a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:04.920633 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb5902-b5fe-46e8-8f55-adabed7e8a60 admin admin] PATH_INFO: `/v3/groups/9c4eec6dae5b45d185c5afdaf338a033` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:04.922978 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb5902-b5fe-46e8-8f55-adabed7e8a60 admin admin] RBAC: Authorizing `identity:get_group(group_id=9c4eec6dae5b45d185c5afdaf338a033)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:04.925215 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb5902-b5fe-46e8-8f55-adabed7e8a60 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:04.927259 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 134/271] 10.222.0.52 () {56 vars in 1201 bytes} [Thu Oct 27 13:12:04 2022] GET /identity/v3/groups/9c4eec6dae5b45d185c5afdaf338a033 => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:04.933060 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf2e78-94b6-4a43-85e6-b830fe2ccabb admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:04.944431 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf2e78-94b6-4a43-85e6-b830fe2ccabb admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:04.949395 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5453591e-c3e5-4dfc-ba24-7048acd6e294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:04.950365 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453591e-c3e5-4dfc-ba24-7048acd6e294 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:04.950893 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453591e-c3e5-4dfc-ba24-7048acd6e294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:04.951378 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453591e-c3e5-4dfc-ba24-7048acd6e294 admin admin] PATH_INFO: `/v3/projects/350b6dccdfa543e18bffdf3853710ebf` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:04.953325 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5453591e-c3e5-4dfc-ba24-7048acd6e294 admin admin] RBAC: Authorizing `identity:get_project(project_id=350b6dccdfa543e18bffdf3853710ebf)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:04.955678 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5453591e-c3e5-4dfc-ba24-7048acd6e294 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:04.958243 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 138/272] 10.222.0.52 () {56 vars in 1207 bytes} [Thu Oct 27 13:12:04 2022] GET /identity/v3/projects/350b6dccdfa543e18bffdf3853710ebf => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:04.963898 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb5902-b5fe-46e8-8f55-adabed7e8a60 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:04.974986 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb5902-b5fe-46e8-8f55-adabed7e8a60 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:04.981399 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3bc35-d552-4d43-b9f7-9f781e4fc1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:04.982397 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3bc35-d552-4d43-b9f7-9f781e4fc1a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:04.982885 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3bc35-d552-4d43-b9f7-9f781e4fc1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:04.983348 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3bc35-d552-4d43-b9f7-9f781e4fc1a0 admin admin] PATH_INFO: `/v3/projects/350b6dccdfa543e18bffdf3853710ebf/groups/9c4eec6dae5b45d185c5afdaf338a033/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:04.985643 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc3bc35-d552-4d43-b9f7-9f781e4fc1a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=350b6dccdfa543e18bffdf3853710ebf, group_id=9c4eec6dae5b45d185c5afdaf338a033, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:04.988993 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc3bc35-d552-4d43-b9f7-9f781e4fc1a0 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:05.008799 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 135/273] 10.222.0.52 () {58 vars in 1463 bytes} [Thu Oct 27 13:12:04 2022] PUT /identity/v3/projects/350b6dccdfa543e18bffdf3853710ebf/groups/9c4eec6dae5b45d185c5afdaf338a033/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:12:05.199126 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5453591e-c3e5-4dfc-ba24-7048acd6e294 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:05.215751 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3bc35-d552-4d43-b9f7-9f781e4fc1a0 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:05.298339 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:05.323793 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3bc35-d552-4d43-b9f7-9f781e4fc1a0 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:05.331812 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d39f96-e020-4174-a23f-5a9d388e2ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:05.332850 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d39f96-e020-4174-a23f-5a9d388e2ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:05.333326 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d39f96-e020-4174-a23f-5a9d388e2ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:05.333815 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d39f96-e020-4174-a23f-5a9d388e2ce7 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:05.352430 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d39f96-e020-4174-a23f-5a9d388e2ce7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:12:05.357930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-55d39f96-e020-4174-a23f-5a9d388e2ce7 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 13:12:05.357930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:05.357930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:05.357930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:05.357930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:05.357930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:05.357930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:05.357930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:05.357930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:05.357930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:05.357930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:05.357930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:05.357930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:12:05.357930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:12:05.357930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:12:05.357930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:12:05.358808 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:12:05.358808 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:12:05.358808 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:12:05.358808 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:12:05.358808 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:05.358808 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:05.358808 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:05.358808 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:05.358808 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:05.358808 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:05.358808 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:05.358808 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:05.358808 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:05.358808 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:05.358808 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:05.358808 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:05.359591 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:05.359591 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:05.359591 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:05.359591 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:05.359591 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:12:05.359591 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:12:05.359591 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:12:05.359591 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:12:05.359591 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:12:05.359591 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:12:05.359591 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 13:12:05.359591 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:05.359591 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 136/274] 10.222.0.52 () {56 vars in 1135 bytes} [Thu Oct 27 13:12:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:12:05.366236 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d39f96-e020-4174-a23f-5a9d388e2ce7 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:05.378238 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d39f96-e020-4174-a23f-5a9d388e2ce7 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:05.384044 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f869403-4f91-4cfb-89ec-2bbf279d0710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:05.384618 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f869403-4f91-4cfb-89ec-2bbf279d0710 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:05.384890 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f869403-4f91-4cfb-89ec-2bbf279d0710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:05.385150 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f869403-4f91-4cfb-89ec-2bbf279d0710 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:05.385854 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f869403-4f91-4cfb-89ec-2bbf279d0710 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:05.386155 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f869403-4f91-4cfb-89ec-2bbf279d0710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:05.387935 dv-cinder-862432-3-smb devstack@keystone.service[81482]: WARNING py.warnings [None req-4f869403-4f91-4cfb-89ec-2bbf279d0710 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:12:05.387935 dv-cinder-862432-3-smb devstack@keystone.service[81482]: warnings.warn(msg) Oct 27 13:12:05.387935 dv-cinder-862432-3-smb devstack@keystone.service[81482]: Oct 27 13:12:05.389139 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f869403-4f91-4cfb-89ec-2bbf279d0710 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:05.395142 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5453591e-c3e5-4dfc-ba24-7048acd6e294 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:05.401900 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 137/275] 10.222.0.52 () {56 vars in 1132 bytes} [Thu Oct 27 13:12:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:12:05.408741 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f869403-4f91-4cfb-89ec-2bbf279d0710 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:05.433286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f869403-4f91-4cfb-89ec-2bbf279d0710 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:05.440223 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43186509-03f1-4e6d-a58b-fde66dc9d873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:05.440866 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43186509-03f1-4e6d-a58b-fde66dc9d873 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:05.441142 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43186509-03f1-4e6d-a58b-fde66dc9d873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:05.441412 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43186509-03f1-4e6d-a58b-fde66dc9d873 admin admin] PATH_INFO: `/v3/groups/9c4eec6dae5b45d185c5afdaf338a033` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:05.443814 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43186509-03f1-4e6d-a58b-fde66dc9d873 admin admin] RBAC: Authorizing `identity:get_group(group_id=9c4eec6dae5b45d185c5afdaf338a033)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:05.445783 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43186509-03f1-4e6d-a58b-fde66dc9d873 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:05.448675 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 138/276] 10.222.0.52 () {56 vars in 1201 bytes} [Thu Oct 27 13:12:05 2022] GET /identity/v3/groups/9c4eec6dae5b45d185c5afdaf338a033 => generated 226 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:05.453454 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43186509-03f1-4e6d-a58b-fde66dc9d873 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:05.459754 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b382b-4872-4f22-8881-4ba292042926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:05.460416 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b382b-4872-4f22-8881-4ba292042926 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:05.460693 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b382b-4872-4f22-8881-4ba292042926 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:05.460967 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b382b-4872-4f22-8881-4ba292042926 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:05.467214 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43186509-03f1-4e6d-a58b-fde66dc9d873 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:05.480223 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714104a-23b4-43f9-a335-7f802002a26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:05.480873 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714104a-23b4-43f9-a335-7f802002a26c admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:05.481148 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714104a-23b4-43f9-a335-7f802002a26c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:05.481415 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714104a-23b4-43f9-a335-7f802002a26c admin admin] PATH_INFO: `/v3/projects/9a7e52ec5fb64c04a51ab3c08adf1d8b` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:05.482760 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72b382b-4872-4f22-8881-4ba292042926 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:12:05.488149 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-d72b382b-4872-4f22-8881-4ba292042926 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 13:12:05.488149 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:05.488149 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:05.488149 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:05.488149 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:05.488149 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:05.488149 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:05.488149 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:05.488149 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:05.488149 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:05.488149 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:05.488149 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:05.488149 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:12:05.488149 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:12:05.488149 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:12:05.488149 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:12:05.489104 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:12:05.489104 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:12:05.489104 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:12:05.489104 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:12:05.489104 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:05.489104 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:05.489104 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:05.489104 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:05.489104 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:05.489104 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:05.489104 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:05.489104 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:05.489104 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:05.489104 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:05.489104 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:05.489104 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:05.489920 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:05.489920 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:05.489920 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:05.489920 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:05.489920 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:12:05.489920 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:12:05.489920 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:12:05.489920 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:12:05.489920 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:12:05.489920 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:12:05.489920 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 13:12:05.489920 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:05.489920 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 139/277] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Oct 27 13:12:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:05.494242 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714104a-23b4-43f9-a335-7f802002a26c admin admin] RBAC: Authorizing `identity:get_project(project_id=9a7e52ec5fb64c04a51ab3c08adf1d8b)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:05.496363 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714104a-23b4-43f9-a335-7f802002a26c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:05.498399 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 139/278] 10.222.0.52 () {56 vars in 1207 bytes} [Thu Oct 27 13:12:05 2022] GET /identity/v3/projects/9a7e52ec5fb64c04a51ab3c08adf1d8b => generated 298 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:05.505157 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714104a-23b4-43f9-a335-7f802002a26c admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:05.505432 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b382b-4872-4f22-8881-4ba292042926 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:05.516958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714104a-23b4-43f9-a335-7f802002a26c admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:05.530207 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03158cc1-9923-4e4e-a372-e67d008bea49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:05.530886 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03158cc1-9923-4e4e-a372-e67d008bea49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:05.531165 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03158cc1-9923-4e4e-a372-e67d008bea49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:05.531433 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03158cc1-9923-4e4e-a372-e67d008bea49 admin admin] PATH_INFO: `/v3/projects/9a7e52ec5fb64c04a51ab3c08adf1d8b/groups/9c4eec6dae5b45d185c5afdaf338a033/roles/5db0b376b1b047f6bdc42dc784aa1ba9` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:05.535973 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03158cc1-9923-4e4e-a372-e67d008bea49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a7e52ec5fb64c04a51ab3c08adf1d8b, group_id=9c4eec6dae5b45d185c5afdaf338a033, role_id=5db0b376b1b047f6bdc42dc784aa1ba9)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:05.538695 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03158cc1-9923-4e4e-a372-e67d008bea49 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:05.570183 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 140/279] 10.222.0.52 () {58 vars in 1463 bytes} [Thu Oct 27 13:12:05 2022] PUT /identity/v3/projects/9a7e52ec5fb64c04a51ab3c08adf1d8b/groups/9c4eec6dae5b45d185c5afdaf338a033/roles/5db0b376b1b047f6bdc42dc784aa1ba9 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:12:05.640976 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b382b-4872-4f22-8881-4ba292042926 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:05.654047 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:05.689069 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc2b4d-3902-4ff3-8de2-7a1cf0d7e1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:05.689737 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc2b4d-3902-4ff3-8de2-7a1cf0d7e1af None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:05.690016 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc2b4d-3902-4ff3-8de2-7a1cf0d7e1af None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:05.690290 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc2b4d-3902-4ff3-8de2-7a1cf0d7e1af None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:05.690978 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc2b4d-3902-4ff3-8de2-7a1cf0d7e1af None admin] RBAC: Adding query filter params (name=reader) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:05.691283 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc2b4d-3902-4ff3-8de2-7a1cf0d7e1af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:05.692955 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc2b4d-3902-4ff3-8de2-7a1cf0d7e1af None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:05.707506 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 140/280] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Oct 27 13:12:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:05.708893 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03158cc1-9923-4e4e-a372-e67d008bea49 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:05.739781 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:05.870213 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03158cc1-9923-4e4e-a372-e67d008bea49 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:05.916785 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57eb117-2f40-4157-b84b-2e3b476a2ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:05.917427 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57eb117-2f40-4157-b84b-2e3b476a2ebc None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:05.917739 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57eb117-2f40-4157-b84b-2e3b476a2ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:05.918009 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57eb117-2f40-4157-b84b-2e3b476a2ebc None admin] PATH_INFO: `/v3/users/58e79db8667e418cac7f545d2e161892` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:05.922228 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57eb117-2f40-4157-b84b-2e3b476a2ebc None admin] RBAC: Authorizing `identity:get_user(user_id=58e79db8667e418cac7f545d2e161892)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:05.923712 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57eb117-2f40-4157-b84b-2e3b476a2ebc None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:05.925892 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 141/281] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Oct 27 13:12:05 2022] GET /identity/v3/users/58e79db8667e418cac7f545d2e161892 => generated 293 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:05.931792 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc2b4d-3902-4ff3-8de2-7a1cf0d7e1af None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:06.038446 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc2b4d-3902-4ff3-8de2-7a1cf0d7e1af None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:06.069094 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a11ab-9604-4d33-a448-e6352dc4abfe None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:06.069401 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a11ab-9604-4d33-a448-e6352dc4abfe None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:06.069661 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a11ab-9604-4d33-a448-e6352dc4abfe None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:06.071302 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 142/282] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:06.076039 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a5adf-1f77-4960-be7d-774c470f0c47 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:06.076319 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a5adf-1f77-4960-be7d-774c470f0c47 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:06.076592 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a5adf-1f77-4960-be7d-774c470f0c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:06.099630 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691447ae-9b9b-4035-8262-398c1447bb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:06.100637 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691447ae-9b9b-4035-8262-398c1447bb39 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:06.101107 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691447ae-9b9b-4035-8262-398c1447bb39 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:06.101718 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691447ae-9b9b-4035-8262-398c1447bb39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:06.102671 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691447ae-9b9b-4035-8262-398c1447bb39 None admin] RBAC: Adding query filter params (role.id=55046f1a884449f4a429f1f572f53ec6, user.id=58e79db8667e418cac7f545d2e161892, scope.system=all) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:06.103243 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691447ae-9b9b-4035-8262-398c1447bb39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:06.105298 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691447ae-9b9b-4035-8262-398c1447bb39 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:06.111834 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-304a5adf-1f77-4960-be7d-774c470f0c47 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:06.116825 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-304a5adf-1f77-4960-be7d-774c470f0c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:06.131890 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 141/283] 10.222.0.52 () {56 vars in 1308 bytes} [Thu Oct 27 13:12:05 2022] GET /identity/v3/role_assignments?user.id=58e79db8667e418cac7f545d2e161892&scope.system=all&role.id=55046f1a884449f4a429f1f572f53ec6 => generated 510 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:06.200384 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 143/284] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 27 13:12:06.613990 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691447ae-9b9b-4035-8262-398c1447bb39 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:06.625393 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691447ae-9b9b-4035-8262-398c1447bb39 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:06.630748 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29cb54-c63e-462e-87e1-175cc15de43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:06.631388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29cb54-c63e-462e-87e1-175cc15de43a admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:06.631945 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29cb54-c63e-462e-87e1-175cc15de43a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:06.632223 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29cb54-c63e-462e-87e1-175cc15de43a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:06.646701 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e29cb54-c63e-462e-87e1-175cc15de43a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:12:06.652004 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-4e29cb54-c63e-462e-87e1-175cc15de43a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 13:12:06.652004 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:06.652004 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:06.652004 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:06.652004 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:06.652004 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:06.652004 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:06.652004 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:06.652004 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:06.652004 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:06.652004 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:06.652004 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:06.652004 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:12:06.652004 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:12:06.652004 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:12:06.652004 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:12:06.652867 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:12:06.652867 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:12:06.652867 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:12:06.652867 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:12:06.652867 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:06.652867 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:06.652867 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:06.652867 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:06.652867 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:06.652867 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:06.652867 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:06.652867 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:06.652867 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:06.652867 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:06.652867 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:06.652867 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:06.653685 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:06.653685 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:06.653685 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:06.653685 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:06.653685 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:12:06.653685 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:12:06.653685 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:12:06.653685 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:12:06.653685 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:12:06.653685 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:12:06.653685 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 13:12:06.653685 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:06.653685 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 142/285] 10.222.0.52 () {56 vars in 1135 bytes} [Thu Oct 27 13:12:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:06.659374 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a5adf-1f77-4960-be7d-774c470f0c47 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:06.673420 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a5adf-1f77-4960-be7d-774c470f0c47 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:06.681165 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5450a3e-f0e4-459a-8cc6-b8ba94803926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:06.682076 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5450a3e-f0e4-459a-8cc6-b8ba94803926 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:06.682885 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5450a3e-f0e4-459a-8cc6-b8ba94803926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:06.683344 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5450a3e-f0e4-459a-8cc6-b8ba94803926 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:06.684215 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5450a3e-f0e4-459a-8cc6-b8ba94803926 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:06.684708 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5450a3e-f0e4-459a-8cc6-b8ba94803926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:06.686553 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5450a3e-f0e4-459a-8cc6-b8ba94803926 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:06.701008 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 144/286] 10.222.0.52 () {56 vars in 1132 bytes} [Thu Oct 27 13:12:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:06.706219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29cb54-c63e-462e-87e1-175cc15de43a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:06.721056 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29cb54-c63e-462e-87e1-175cc15de43a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:06.728809 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53344dbc-8b54-4ecb-a78f-ca70f2de7160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:06.729461 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53344dbc-8b54-4ecb-a78f-ca70f2de7160 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:06.729758 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53344dbc-8b54-4ecb-a78f-ca70f2de7160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:06.730025 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53344dbc-8b54-4ecb-a78f-ca70f2de7160 admin admin] PATH_INFO: `/v3/groups/9c4eec6dae5b45d185c5afdaf338a033` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:06.731133 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53344dbc-8b54-4ecb-a78f-ca70f2de7160 admin admin] RBAC: Authorizing `identity:get_group(group_id=9c4eec6dae5b45d185c5afdaf338a033)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:06.732169 dv-cinder-862432-3-smb devstack@keystone.service[81481]: WARNING py.warnings [None req-53344dbc-8b54-4ecb-a78f-ca70f2de7160 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:12:06.732169 dv-cinder-862432-3-smb devstack@keystone.service[81481]: warnings.warn(msg) Oct 27 13:12:06.732169 dv-cinder-862432-3-smb devstack@keystone.service[81481]: Oct 27 13:12:06.738944 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53344dbc-8b54-4ecb-a78f-ca70f2de7160 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:06.740897 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 143/287] 10.222.0.52 () {56 vars in 1201 bytes} [Thu Oct 27 13:12:06 2022] GET /identity/v3/groups/9c4eec6dae5b45d185c5afdaf338a033 => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:06.747486 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5450a3e-f0e4-459a-8cc6-b8ba94803926 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:06.760858 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5450a3e-f0e4-459a-8cc6-b8ba94803926 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:06.766916 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e045da-411d-4b01-8db3-8ad5122fda55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:06.767848 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e045da-411d-4b01-8db3-8ad5122fda55 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:06.768336 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e045da-411d-4b01-8db3-8ad5122fda55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:06.768837 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e045da-411d-4b01-8db3-8ad5122fda55 admin admin] PATH_INFO: `/v3/projects/350b6dccdfa543e18bffdf3853710ebf` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:06.770280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e045da-411d-4b01-8db3-8ad5122fda55 admin admin] RBAC: Authorizing `identity:get_project(project_id=350b6dccdfa543e18bffdf3853710ebf)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:06.772952 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e045da-411d-4b01-8db3-8ad5122fda55 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:06.774942 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 145/288] 10.222.0.52 () {56 vars in 1207 bytes} [Thu Oct 27 13:12:06 2022] GET /identity/v3/projects/350b6dccdfa543e18bffdf3853710ebf => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:06.780661 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53344dbc-8b54-4ecb-a78f-ca70f2de7160 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:06.794809 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53344dbc-8b54-4ecb-a78f-ca70f2de7160 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:06.805728 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b0350-b25e-4a6e-9a18-814e01f64d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:06.806415 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b0350-b25e-4a6e-9a18-814e01f64d69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:06.806694 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b0350-b25e-4a6e-9a18-814e01f64d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:06.806966 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b0350-b25e-4a6e-9a18-814e01f64d69 admin admin] PATH_INFO: `/v3/projects/350b6dccdfa543e18bffdf3853710ebf/groups/9c4eec6dae5b45d185c5afdaf338a033/roles/5db0b376b1b047f6bdc42dc784aa1ba9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:06.809427 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229b0350-b25e-4a6e-9a18-814e01f64d69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=350b6dccdfa543e18bffdf3853710ebf, group_id=9c4eec6dae5b45d185c5afdaf338a033, role_id=5db0b376b1b047f6bdc42dc784aa1ba9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:06.810514 dv-cinder-862432-3-smb devstack@keystone.service[81481]: WARNING py.warnings [None req-229b0350-b25e-4a6e-9a18-814e01f64d69 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:12:06.810514 dv-cinder-862432-3-smb devstack@keystone.service[81481]: warnings.warn(msg) Oct 27 13:12:06.810514 dv-cinder-862432-3-smb devstack@keystone.service[81481]: Oct 27 13:12:06.812471 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229b0350-b25e-4a6e-9a18-814e01f64d69 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:06.830089 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:06.838743 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 144/289] 10.222.0.52 () {58 vars in 1463 bytes} [Thu Oct 27 13:12:06 2022] PUT /identity/v3/projects/350b6dccdfa543e18bffdf3853710ebf/groups/9c4eec6dae5b45d185c5afdaf338a033/roles/5db0b376b1b047f6bdc42dc784aa1ba9 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:12:06.978897 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8060385-2e5c-404e-951d-932b957a1c15 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:06.979533 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8060385-2e5c-404e-951d-932b957a1c15 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:06.980000 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8060385-2e5c-404e-951d-932b957a1c15 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:06.981620 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 146/290] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:06.987930 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09dbef-0564-456d-b3d8-261ede1c0568 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:06.988242 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09dbef-0564-456d-b3d8-261ede1c0568 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:06.988728 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09dbef-0564-456d-b3d8-261ede1c0568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:07.009217 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-2f09dbef-0564-456d-b3d8-261ede1c0568 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:07.010479 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2f09dbef-0564-456d-b3d8-261ede1c0568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:07.084221 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 145/291] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 27 13:12:07.400249 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8060385-2e5c-404e-951d-932b957a1c15 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:07.415762 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8060385-2e5c-404e-951d-932b957a1c15 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:07.426377 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00fc8d-4ba5-4366-91aa-d1297133aee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:07.427031 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00fc8d-4ba5-4366-91aa-d1297133aee0 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:07.427322 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00fc8d-4ba5-4366-91aa-d1297133aee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:07.427596 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00fc8d-4ba5-4366-91aa-d1297133aee0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:07.443143 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb00fc8d-4ba5-4366-91aa-d1297133aee0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:12:07.448670 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-fb00fc8d-4ba5-4366-91aa-d1297133aee0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:12:07.448670 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:07.448670 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:07.448670 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:07.448670 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:07.448670 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:07.448670 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:07.448670 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:07.448670 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:07.448670 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:07.448670 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:07.448670 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:07.448670 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:12:07.448670 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:12:07.448670 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:12:07.448670 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:12:07.449561 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:12:07.449561 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:12:07.449561 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:12:07.449561 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:12:07.449561 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:07.449561 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:07.449561 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:07.449561 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:07.449561 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:07.449561 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:07.449561 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:07.449561 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:07.449561 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:07.449561 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:07.449561 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:07.449561 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:07.450385 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:07.450385 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:07.450385 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:07.450385 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:07.450385 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:12:07.450385 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:12:07.450385 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:12:07.450385 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:12:07.450385 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:12:07.450385 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:12:07.450385 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:12:07.450385 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:07.450385 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 147/292] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Oct 27 13:12:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:07.455847 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f09dbef-0564-456d-b3d8-261ede1c0568 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:07.467782 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f09dbef-0564-456d-b3d8-261ede1c0568 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:07.469856 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf701d4-3669-4b9e-8518-a0b0a1c19bcc None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:07.470139 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf701d4-3669-4b9e-8518-a0b0a1c19bcc None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:07.470407 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf701d4-3669-4b9e-8518-a0b0a1c19bcc None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:07.473278 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 148/293] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:07.476930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da53e5a-72ed-4db7-980b-fc1eca2ff85c None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:07.477160 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da53e5a-72ed-4db7-980b-fc1eca2ff85c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:07.477441 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da53e5a-72ed-4db7-980b-fc1eca2ff85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:07.478064 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7632de1-0e52-4a5a-9713-a342bb39670f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:07.478679 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7632de1-0e52-4a5a-9713-a342bb39670f admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:07.478951 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7632de1-0e52-4a5a-9713-a342bb39670f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:07.479218 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7632de1-0e52-4a5a-9713-a342bb39670f admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:07.479888 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7632de1-0e52-4a5a-9713-a342bb39670f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:07.480184 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7632de1-0e52-4a5a-9713-a342bb39670f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:07.482948 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7632de1-0e52-4a5a-9713-a342bb39670f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:07.491539 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:07.502796 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 146/294] 10.222.0.52 () {56 vars in 1120 bytes} [Thu Oct 27 13:12:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:07.512833 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7632de1-0e52-4a5a-9713-a342bb39670f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:07.518972 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-5da53e5a-72ed-4db7-980b-fc1eca2ff85c None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:07.520224 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5da53e5a-72ed-4db7-980b-fc1eca2ff85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:07.527869 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7632de1-0e52-4a5a-9713-a342bb39670f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:07.541007 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312526c-ffe0-47b6-a6f7-111fe99dcdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:07.541687 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312526c-ffe0-47b6-a6f7-111fe99dcdc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:07.541969 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312526c-ffe0-47b6-a6f7-111fe99dcdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:07.542240 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312526c-ffe0-47b6-a6f7-111fe99dcdc5 admin admin] PATH_INFO: `/v3/groups/6c626c50bdd74e289adbbe76523f7cd4` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:07.562154 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a312526c-ffe0-47b6-a6f7-111fe99dcdc5 admin admin] RBAC: Authorizing `identity:get_group(group_id=6c626c50bdd74e289adbbe76523f7cd4)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:07.564109 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a312526c-ffe0-47b6-a6f7-111fe99dcdc5 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:07.566021 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 147/295] 10.222.0.52 () {56 vars in 1201 bytes} [Thu Oct 27 13:12:07 2022] GET /identity/v3/groups/6c626c50bdd74e289adbbe76523f7cd4 => generated 229 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:12:07.572959 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312526c-ffe0-47b6-a6f7-111fe99dcdc5 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:07.596167 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312526c-ffe0-47b6-a6f7-111fe99dcdc5 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:07.605685 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be484eba-a14f-458b-901f-d74ba96b06fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:07.606330 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be484eba-a14f-458b-901f-d74ba96b06fd admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:07.606606 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be484eba-a14f-458b-901f-d74ba96b06fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:07.606878 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be484eba-a14f-458b-901f-d74ba96b06fd admin admin] PATH_INFO: `/v3/projects/818c3abbd7494faeb4f418fcf977e5d3` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:07.608293 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be484eba-a14f-458b-901f-d74ba96b06fd admin admin] RBAC: Authorizing `identity:get_project(project_id=818c3abbd7494faeb4f418fcf977e5d3)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:07.610170 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be484eba-a14f-458b-901f-d74ba96b06fd admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:07.611813 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 148/296] 10.222.0.52 () {56 vars in 1207 bytes} [Thu Oct 27 13:12:07 2022] GET /identity/v3/projects/818c3abbd7494faeb4f418fcf977e5d3 => generated 344 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:07.624371 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be484eba-a14f-458b-901f-d74ba96b06fd admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:07.639767 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be484eba-a14f-458b-901f-d74ba96b06fd admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:07.652996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e711f-6dd8-4f9a-85b2-126df720807e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:07.653727 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e711f-6dd8-4f9a-85b2-126df720807e admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:07.653881 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e711f-6dd8-4f9a-85b2-126df720807e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:07.654137 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e711f-6dd8-4f9a-85b2-126df720807e admin admin] PATH_INFO: `/v3/projects/818c3abbd7494faeb4f418fcf977e5d3/groups/6c626c50bdd74e289adbbe76523f7cd4/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:07.659047 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e711f-6dd8-4f9a-85b2-126df720807e admin admin] RBAC: Authorizing `identity:create_grant(project_id=818c3abbd7494faeb4f418fcf977e5d3, group_id=6c626c50bdd74e289adbbe76523f7cd4, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:07.662332 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e711f-6dd8-4f9a-85b2-126df720807e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:07.670510 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 149/297] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 13:12:07.684591 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 149/298] 10.222.0.52 () {58 vars in 1463 bytes} [Thu Oct 27 13:12:07 2022] PUT /identity/v3/projects/818c3abbd7494faeb4f418fcf977e5d3/groups/6c626c50bdd74e289adbbe76523f7cd4/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:12:07.962553 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da53e5a-72ed-4db7-980b-fc1eca2ff85c None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:08.025485 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a964b-d202-4487-8436-7648fd8767e3 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:08.025836 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a964b-d202-4487-8436-7648fd8767e3 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:08.026070 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a964b-d202-4487-8436-7648fd8767e3 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:08.027571 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 150/299] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 13:12:08.032782 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15704a0b-4fd8-4312-9701-e0d4e4c970e0 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:08.033108 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15704a0b-4fd8-4312-9701-e0d4e4c970e0 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:08.033369 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15704a0b-4fd8-4312-9701-e0d4e4c970e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:08.056968 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-15704a0b-4fd8-4312-9701-e0d4e4c970e0 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:08.058571 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-15704a0b-4fd8-4312-9701-e0d4e4c970e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:08.078717 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da53e5a-72ed-4db7-980b-fc1eca2ff85c None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:08.124397 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:08.131008 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d158d-beb6-4de1-8671-0210680a47e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:08.131653 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d158d-beb6-4de1-8671-0210680a47e4 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:08.131934 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d158d-beb6-4de1-8671-0210680a47e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:08.132208 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d158d-beb6-4de1-8671-0210680a47e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:08.146999 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2d158d-beb6-4de1-8671-0210680a47e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:12:08.153202 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-0a2d158d-beb6-4de1-8671-0210680a47e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 13:12:08.153202 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:08.153202 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:08.153202 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:08.153202 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:08.153202 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:08.153202 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:08.153202 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:08.153202 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:08.153202 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:08.153202 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:08.153202 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:08.153202 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:12:08.153202 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:12:08.153202 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:12:08.153202 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:12:08.154130 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:12:08.154130 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:12:08.154130 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:12:08.154130 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:12:08.154130 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:08.154130 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:08.154130 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:08.154130 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:08.154130 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:08.154130 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:08.154130 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:08.154130 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:08.154130 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:08.154130 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:08.154130 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:08.154130 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:08.154896 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:08.154896 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:08.154896 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:08.154896 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:08.154896 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:12:08.154896 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:12:08.154896 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:12:08.154896 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:12:08.154896 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:12:08.154896 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:12:08.154896 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 13:12:08.154896 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:08.155483 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 151/300] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:12:08.157145 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 150/301] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Oct 27 13:12:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:08.163245 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15704a0b-4fd8-4312-9701-e0d4e4c970e0 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:08.209900 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:08.269381 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15704a0b-4fd8-4312-9701-e0d4e4c970e0 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:08.306279 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c4b8b-0863-412c-b0d5-d6d2594dad80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:08.306889 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c4b8b-0863-412c-b0d5-d6d2594dad80 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:08.307221 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c4b8b-0863-412c-b0d5-d6d2594dad80 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:08.307815 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c4b8b-0863-412c-b0d5-d6d2594dad80 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:08.308482 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363c4b8b-0863-412c-b0d5-d6d2594dad80 None admin] RBAC: Adding query filter params (name=member) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:08.308779 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363c4b8b-0863-412c-b0d5-d6d2594dad80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:08.310183 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363c4b8b-0863-412c-b0d5-d6d2594dad80 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:08.319255 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 152/302] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Oct 27 13:12:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:12:08.325482 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d158d-beb6-4de1-8671-0210680a47e4 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:08.438095 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d158d-beb6-4de1-8671-0210680a47e4 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:08.479848 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f21a19-13e2-49ad-b0c2-8285ffe4f242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:08.480460 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f21a19-13e2-49ad-b0c2-8285ffe4f242 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:08.480734 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f21a19-13e2-49ad-b0c2-8285ffe4f242 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:08.481002 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f21a19-13e2-49ad-b0c2-8285ffe4f242 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:08.546992 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:08.559323 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f21a19-13e2-49ad-b0c2-8285ffe4f242 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:08.560837 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f21a19-13e2-49ad-b0c2-8285ffe4f242 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:08.590370 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c4b8b-0863-412c-b0d5-d6d2594dad80 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:08.680389 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 151/303] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Oct 27 13:12:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 13:12:08.686546 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c701325-5187-4749-88f1-3ec12fa66d0a None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:08.686828 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c701325-5187-4749-88f1-3ec12fa66d0a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:08.687097 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c701325-5187-4749-88f1-3ec12fa66d0a None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:08.688689 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 152/304] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:08.689394 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c701325-5187-4749-88f1-3ec12fa66d0a None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:08.724223 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c4b8b-0863-412c-b0d5-d6d2594dad80 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:08.726812 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:08.776220 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a2ec2f-b828-4608-bdd4-a17d00e3f61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:08.776802 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2ec2f-b828-4608-bdd4-a17d00e3f61f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:08.777081 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2ec2f-b828-4608-bdd4-a17d00e3f61f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:08.777348 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2ec2f-b828-4608-bdd4-a17d00e3f61f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:08.796369 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a2ec2f-b828-4608-bdd4-a17d00e3f61f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:12:08.798313 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:08.809244 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-58a2ec2f-b828-4608-bdd4-a17d00e3f61f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 13:12:08.809244 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:08.809244 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:08.809244 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:08.809244 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:08.809244 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:08.809244 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:08.809244 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:08.809244 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:08.809244 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:08.809244 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:08.809244 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:08.809244 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:12:08.809244 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:12:08.809244 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:12:08.809244 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:12:08.810300 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:12:08.810300 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:12:08.810300 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:12:08.810300 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:12:08.810300 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:08.810300 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:08.810300 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:08.810300 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:08.810300 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:08.810300 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:08.810300 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:08.810300 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:08.810300 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:08.810300 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:08.810300 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:08.810300 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:08.811093 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:08.811093 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:08.811093 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:08.811093 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:08.811093 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:12:08.811093 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:12:08.811093 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:12:08.811093 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:12:08.811093 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:12:08.811093 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:12:08.811093 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 13:12:08.811093 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:08.812901 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c701325-5187-4749-88f1-3ec12fa66d0a None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:08.817670 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 153/305] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Oct 27 13:12:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:12:08.819239 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53ba17-2042-4099-bbcb-dc59c4bf9973 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:08.819674 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53ba17-2042-4099-bbcb-dc59c4bf9973 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:08.820085 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53ba17-2042-4099-bbcb-dc59c4bf9973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:08.839465 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-fb53ba17-2042-4099-bbcb-dc59c4bf9973 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:08.840872 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-fb53ba17-2042-4099-bbcb-dc59c4bf9973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:08.853663 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afcb932-f5eb-4b1a-8a2f-0c7608017a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:08.854283 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcb932-f5eb-4b1a-8a2f-0c7608017a70 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:08.854600 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcb932-f5eb-4b1a-8a2f-0c7608017a70 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:08.854874 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcb932-f5eb-4b1a-8a2f-0c7608017a70 None admin] PATH_INFO: `/v3/projects/9a7e52ec5fb64c04a51ab3c08adf1d8b` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:08.856124 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afcb932-f5eb-4b1a-8a2f-0c7608017a70 None admin] RBAC: Authorizing `identity:get_project(project_id=9a7e52ec5fb64c04a51ab3c08adf1d8b)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:08.857757 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afcb932-f5eb-4b1a-8a2f-0c7608017a70 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:08.859601 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 153/306] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Oct 27 13:12:08 2022] GET /identity/v3/projects/9a7e52ec5fb64c04a51ab3c08adf1d8b => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:08.860427 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afcb932-f5eb-4b1a-8a2f-0c7608017a70 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:08.916491 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 154/307] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:12:08.917757 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb53ba17-2042-4099-bbcb-dc59c4bf9973 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:08.970812 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afcb932-f5eb-4b1a-8a2f-0c7608017a70 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:09.005719 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483fa71-2487-46a9-9629-620d5e8c0ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:09.006333 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483fa71-2487-46a9-9629-620d5e8c0ff9 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:09.006603 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483fa71-2487-46a9-9629-620d5e8c0ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:09.006867 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483fa71-2487-46a9-9629-620d5e8c0ff9 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:09.007530 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5483fa71-2487-46a9-9629-620d5e8c0ff9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:09.007827 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5483fa71-2487-46a9-9629-620d5e8c0ff9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:09.009197 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5483fa71-2487-46a9-9629-620d5e8c0ff9 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:09.018174 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 154/308] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Oct 27 13:12:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:09.023717 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483fa71-2487-46a9-9629-620d5e8c0ff9 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:09.048518 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:09.057417 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:09.068940 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb53ba17-2042-4099-bbcb-dc59c4bf9973 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:09.123440 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937d0db-b75b-4b9a-95ef-aedff8535d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:09.124321 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937d0db-b75b-4b9a-95ef-aedff8535d55 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:09.124739 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937d0db-b75b-4b9a-95ef-aedff8535d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:09.125151 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937d0db-b75b-4b9a-95ef-aedff8535d55 None admin] PATH_INFO: `/v3/groups/9c4eec6dae5b45d185c5afdaf338a033` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:09.125640 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483fa71-2487-46a9-9629-620d5e8c0ff9 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:09.127626 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937d0db-b75b-4b9a-95ef-aedff8535d55 None admin] RBAC: Authorizing `identity:get_group(group_id=9c4eec6dae5b45d185c5afdaf338a033)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:09.129352 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937d0db-b75b-4b9a-95ef-aedff8535d55 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:09.131194 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 155/309] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Oct 27 13:12:08 2022] GET /identity/v3/groups/9c4eec6dae5b45d185c5afdaf338a033 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:09.136982 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937d0db-b75b-4b9a-95ef-aedff8535d55 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:09.161583 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c07116-2bba-4f82-bc94-72c613068cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:09.162199 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c07116-2bba-4f82-bc94-72c613068cad None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:09.162477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c07116-2bba-4f82-bc94-72c613068cad None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:09.162746 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c07116-2bba-4f82-bc94-72c613068cad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:09.233380 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c07116-2bba-4f82-bc94-72c613068cad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:09.234882 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c07116-2bba-4f82-bc94-72c613068cad None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:09.260379 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:09.285761 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937d0db-b75b-4b9a-95ef-aedff8535d55 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:09.326556 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39f9e4-72c2-4755-ab29-ea73a987311f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:09.327584 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39f9e4-72c2-4755-ab29-ea73a987311f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:09.328069 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39f9e4-72c2-4755-ab29-ea73a987311f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:09.328529 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39f9e4-72c2-4755-ab29-ea73a987311f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:09.329563 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef39f9e4-72c2-4755-ab29-ea73a987311f None admin] RBAC: Adding query filter params (group.id=9c4eec6dae5b45d185c5afdaf338a033, role.id=3a0f9a2e42334ab59845114892813223, scope.project.id=9a7e52ec5fb64c04a51ab3c08adf1d8b) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:09.330205 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef39f9e4-72c2-4755-ab29-ea73a987311f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:09.331835 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef39f9e4-72c2-4755-ab29-ea73a987311f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:09.339732 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 155/310] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Oct 27 13:12:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 27 13:12:09.340582 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c07116-2bba-4f82-bc94-72c613068cad None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:09.341281 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 156/311] 10.222.0.52 () {56 vars in 1376 bytes} [Thu Oct 27 13:12:09 2022] GET /identity/v3/role_assignments?group.id=9c4eec6dae5b45d185c5afdaf338a033&scope.project.id=9a7e52ec5fb64c04a51ab3c08adf1d8b&role.id=3a0f9a2e42334ab59845114892813223 => generated 611 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:09.351465 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39f9e4-72c2-4755-ab29-ea73a987311f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:09.404802 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:09.453242 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c07116-2bba-4f82-bc94-72c613068cad None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:09.478809 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:09.491724 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319d30b-ad0b-4f53-bf9a-ad41baa97247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:09.492419 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319d30b-ad0b-4f53-bf9a-ad41baa97247 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:09.492704 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319d30b-ad0b-4f53-bf9a-ad41baa97247 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:09.492977 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319d30b-ad0b-4f53-bf9a-ad41baa97247 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:09.504336 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b319d30b-ad0b-4f53-bf9a-ad41baa97247 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:12:09.510324 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-b319d30b-ad0b-4f53-bf9a-ad41baa97247 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 13:12:09.510324 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:09.510324 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:09.510324 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:09.510324 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:09.510324 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:09.510324 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:09.510324 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:09.510324 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:09.510324 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:09.510324 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:09.510324 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:09.510324 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:12:09.510324 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:12:09.510324 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:12:09.510324 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:12:09.511250 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:12:09.511250 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:12:09.511250 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:12:09.511250 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:12:09.511250 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:09.511250 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:09.511250 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:09.511250 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:09.511250 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:09.511250 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:09.511250 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:09.511250 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:09.511250 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:09.511250 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:09.511250 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:09.511250 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:09.512022 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:09.512022 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:09.512022 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:09.512022 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:09.512022 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:12:09.512022 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:12:09.512022 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:12:09.512022 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:12:09.512022 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:12:09.512022 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:12:09.512022 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 13:12:09.512022 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:09.512022 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 156/312] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Oct 27 13:12:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:09.517688 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319d30b-ad0b-4f53-bf9a-ad41baa97247 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:09.520088 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39f9e4-72c2-4755-ab29-ea73a987311f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:09.559274 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856bfc3-bd53-4511-bed1-2b6f85ea1bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:09.559919 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856bfc3-bd53-4511-bed1-2b6f85ea1bf6 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:09.560201 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856bfc3-bd53-4511-bed1-2b6f85ea1bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:09.560476 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856bfc3-bd53-4511-bed1-2b6f85ea1bf6 None admin] PATH_INFO: `/v3/projects/350b6dccdfa543e18bffdf3853710ebf` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:09.561709 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856bfc3-bd53-4511-bed1-2b6f85ea1bf6 None admin] RBAC: Authorizing `identity:get_project(project_id=350b6dccdfa543e18bffdf3853710ebf)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:09.563227 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856bfc3-bd53-4511-bed1-2b6f85ea1bf6 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:09.565211 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 157/313] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Oct 27 13:12:09 2022] GET /identity/v3/projects/350b6dccdfa543e18bffdf3853710ebf => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:09.570985 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856bfc3-bd53-4511-bed1-2b6f85ea1bf6 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:09.629489 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319d30b-ad0b-4f53-bf9a-ad41baa97247 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:09.665782 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe770cdc-21d3-42ae-a4ca-cfb9e477879e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:09.666392 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe770cdc-21d3-42ae-a4ca-cfb9e477879e None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:09.666663 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe770cdc-21d3-42ae-a4ca-cfb9e477879e None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:09.666928 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe770cdc-21d3-42ae-a4ca-cfb9e477879e None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:09.667600 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe770cdc-21d3-42ae-a4ca-cfb9e477879e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:09.667898 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe770cdc-21d3-42ae-a4ca-cfb9e477879e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:09.669282 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe770cdc-21d3-42ae-a4ca-cfb9e477879e None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:09.678426 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 157/314] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Oct 27 13:12:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:09.678592 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:09.684668 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe770cdc-21d3-42ae-a4ca-cfb9e477879e None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:09.687566 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856bfc3-bd53-4511-bed1-2b6f85ea1bf6 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:09.725012 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7af58c-9200-409e-8913-06b1234c19a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:09.725776 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7af58c-9200-409e-8913-06b1234c19a1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:09.726029 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7af58c-9200-409e-8913-06b1234c19a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:09.726306 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7af58c-9200-409e-8913-06b1234c19a1 None admin] PATH_INFO: `/v3/groups/9c4eec6dae5b45d185c5afdaf338a033` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:09.727435 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7af58c-9200-409e-8913-06b1234c19a1 None admin] RBAC: Authorizing `identity:get_group(group_id=9c4eec6dae5b45d185c5afdaf338a033)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:09.728945 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7af58c-9200-409e-8913-06b1234c19a1 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:09.731698 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 158/315] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Oct 27 13:12:09 2022] GET /identity/v3/groups/9c4eec6dae5b45d185c5afdaf338a033 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:09.737739 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:09.739345 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7af58c-9200-409e-8913-06b1234c19a1 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:09.808426 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe770cdc-21d3-42ae-a4ca-cfb9e477879e None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:09.871122 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b61e03-bbe5-4b55-ae11-241df2169681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:09.871905 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b61e03-bbe5-4b55-ae11-241df2169681 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:09.872186 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b61e03-bbe5-4b55-ae11-241df2169681 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:09.872461 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b61e03-bbe5-4b55-ae11-241df2169681 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:09.874265 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7af58c-9200-409e-8913-06b1234c19a1 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:09.918681 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1911c-1474-4d69-9b67-55ae16e26ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:09.919209 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1911c-1474-4d69-9b67-55ae16e26ad4 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:09.919596 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1911c-1474-4d69-9b67-55ae16e26ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:09.919876 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1911c-1474-4d69-9b67-55ae16e26ad4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:09.920620 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1911c-1474-4d69-9b67-55ae16e26ad4 None admin] RBAC: Adding query filter params (group.id=9c4eec6dae5b45d185c5afdaf338a033, role.id=3a0f9a2e42334ab59845114892813223, scope.project.id=350b6dccdfa543e18bffdf3853710ebf) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:09.921016 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1911c-1474-4d69-9b67-55ae16e26ad4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:09.922874 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1911c-1474-4d69-9b67-55ae16e26ad4 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:09.931842 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 159/316] 10.222.0.52 () {56 vars in 1376 bytes} [Thu Oct 27 13:12:09 2022] GET /identity/v3/role_assignments?group.id=9c4eec6dae5b45d185c5afdaf338a033&scope.project.id=350b6dccdfa543e18bffdf3853710ebf&role.id=3a0f9a2e42334ab59845114892813223 => generated 611 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:09.962314 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b61e03-bbe5-4b55-ae11-241df2169681 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:09.964050 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b61e03-bbe5-4b55-ae11-241df2169681 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:10.024484 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:10.088113 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 158/317] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Oct 27 13:12:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 13:12:10.094115 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1911c-1474-4d69-9b67-55ae16e26ad4 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:10.126874 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:10.150325 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cf2bf-deb8-45af-9621-9ad97a78456a None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:10.150625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cf2bf-deb8-45af-9621-9ad97a78456a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:10.150861 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cf2bf-deb8-45af-9621-9ad97a78456a None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:10.152549 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 159/318] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 13:12:10.164019 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31de6c7-e2d8-4bb1-8741-3702dc3056e9 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:10.164322 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31de6c7-e2d8-4bb1-8741-3702dc3056e9 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:10.164567 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31de6c7-e2d8-4bb1-8741-3702dc3056e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:10.190583 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-d31de6c7-e2d8-4bb1-8741-3702dc3056e9 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:10.191847 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d31de6c7-e2d8-4bb1-8741-3702dc3056e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:10.226164 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1911c-1474-4d69-9b67-55ae16e26ad4 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:10.264857 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ddb833-2ab2-4665-b2c8-6de9f92db360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:10.265497 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddb833-2ab2-4665-b2c8-6de9f92db360 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:10.265802 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddb833-2ab2-4665-b2c8-6de9f92db360 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:10.266074 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddb833-2ab2-4665-b2c8-6de9f92db360 None admin] PATH_INFO: `/v3/projects/9a7e52ec5fb64c04a51ab3c08adf1d8b` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:10.267184 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ddb833-2ab2-4665-b2c8-6de9f92db360 None admin] RBAC: Authorizing `identity:get_project(project_id=9a7e52ec5fb64c04a51ab3c08adf1d8b)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:10.268659 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ddb833-2ab2-4665-b2c8-6de9f92db360 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:10.272350 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 160/319] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Oct 27 13:12:10 2022] GET /identity/v3/projects/9a7e52ec5fb64c04a51ab3c08adf1d8b => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:10.274195 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 160/320] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:12:10.279613 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ddb833-2ab2-4665-b2c8-6de9f92db360 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:10.380038 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:10.387036 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ddb833-2ab2-4665-b2c8-6de9f92db360 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:10.422552 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b759774-787b-4993-83fa-200f2b919afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:10.423186 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b759774-787b-4993-83fa-200f2b919afc None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:10.423469 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b759774-787b-4993-83fa-200f2b919afc None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:10.423778 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b759774-787b-4993-83fa-200f2b919afc None admin] PATH_INFO: `/v3/groups/9c4eec6dae5b45d185c5afdaf338a033` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:10.424879 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b759774-787b-4993-83fa-200f2b919afc None admin] RBAC: Authorizing `identity:get_group(group_id=9c4eec6dae5b45d185c5afdaf338a033)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:10.426404 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b759774-787b-4993-83fa-200f2b919afc None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:10.428312 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 161/321] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Oct 27 13:12:10 2022] GET /identity/v3/groups/9c4eec6dae5b45d185c5afdaf338a033 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:10.434399 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31de6c7-e2d8-4bb1-8741-3702dc3056e9 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:10.513299 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:10.539554 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31de6c7-e2d8-4bb1-8741-3702dc3056e9 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:10.550755 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b759774-787b-4993-83fa-200f2b919afc None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:10.586203 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ee379-003a-4b3d-a197-0215ceb03c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:10.586819 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ee379-003a-4b3d-a197-0215ceb03c52 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:10.587360 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ee379-003a-4b3d-a197-0215ceb03c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:10.587632 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ee379-003a-4b3d-a197-0215ceb03c52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:10.588519 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ee379-003a-4b3d-a197-0215ceb03c52 None admin] RBAC: Adding query filter params (group.id=9c4eec6dae5b45d185c5afdaf338a033, role.id=5db0b376b1b047f6bdc42dc784aa1ba9, scope.project.id=9a7e52ec5fb64c04a51ab3c08adf1d8b) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:10.588829 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ee379-003a-4b3d-a197-0215ceb03c52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:10.590915 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ee379-003a-4b3d-a197-0215ceb03c52 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:10.598235 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 161/322] 10.222.0.52 () {56 vars in 1376 bytes} [Thu Oct 27 13:12:10 2022] GET /identity/v3/role_assignments?group.id=9c4eec6dae5b45d185c5afdaf338a033&scope.project.id=9a7e52ec5fb64c04a51ab3c08adf1d8b&role.id=5db0b376b1b047f6bdc42dc784aa1ba9 => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:12:10.674102 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b759774-787b-4993-83fa-200f2b919afc None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:10.715816 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d95232-ce39-4193-8d89-73897cd87247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:10.716523 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d95232-ce39-4193-8d89-73897cd87247 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:10.716804 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d95232-ce39-4193-8d89-73897cd87247 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:10.717076 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d95232-ce39-4193-8d89-73897cd87247 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:10.730303 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d95232-ce39-4193-8d89-73897cd87247 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:12:10.736106 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-06d95232-ce39-4193-8d89-73897cd87247 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 13:12:10.736106 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:10.736106 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:10.736106 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:10.736106 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:10.736106 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:10.736106 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:10.736106 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:10.736106 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:10.736106 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:10.736106 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:10.736106 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:10.736106 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:12:10.736106 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:12:10.736106 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:12:10.736106 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:12:10.737068 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:12:10.737068 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:12:10.737068 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:12:10.737068 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:12:10.737068 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:10.737068 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:10.737068 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:10.737068 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:10.737068 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:10.737068 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:10.737068 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:10.737068 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:10.737068 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:10.737068 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:10.737068 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:10.737068 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:10.737892 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:10.737892 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:10.737892 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:10.737892 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:10.737892 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:12:10.737892 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:12:10.737892 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:12:10.737892 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:12:10.737892 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:12:10.737892 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:12:10.737892 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 13:12:10.737892 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:10.741148 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 162/323] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Oct 27 13:12:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:10.744454 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ee379-003a-4b3d-a197-0215ceb03c52 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:10.843674 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b7c47-112b-4ebc-8494-a0d3a24fe6f7 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:10.844015 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b7c47-112b-4ebc-8494-a0d3a24fe6f7 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:10.844219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b7c47-112b-4ebc-8494-a0d3a24fe6f7 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:10.846732 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 163/324] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 13:12:10.851735 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c07f2f-990b-4af2-b39b-9996fe741ae5 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:10.852013 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c07f2f-990b-4af2-b39b-9996fe741ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:10.852281 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c07f2f-990b-4af2-b39b-9996fe741ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:10.869338 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ee379-003a-4b3d-a197-0215ceb03c52 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:10.873624 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-21c07f2f-990b-4af2-b39b-9996fe741ae5 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:10.874817 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-21c07f2f-990b-4af2-b39b-9996fe741ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:10.895082 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:10.914389 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc99671-d9ce-4627-a627-114279d1f631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:10.915005 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc99671-d9ce-4627-a627-114279d1f631 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:10.915282 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc99671-d9ce-4627-a627-114279d1f631 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:10.915547 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc99671-d9ce-4627-a627-114279d1f631 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:10.916216 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc99671-d9ce-4627-a627-114279d1f631 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:10.916524 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc99671-d9ce-4627-a627-114279d1f631 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:10.921614 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc99671-d9ce-4627-a627-114279d1f631 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:10.924957 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:10.929911 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 162/325] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Oct 27 13:12:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:10.934744 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc99671-d9ce-4627-a627-114279d1f631 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:10.955062 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 164/326] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 13:12:11.043831 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc99671-d9ce-4627-a627-114279d1f631 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:11.079365 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee916e6-7eaf-4640-995c-485f12128319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:11.079910 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee916e6-7eaf-4640-995c-485f12128319 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:11.080192 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee916e6-7eaf-4640-995c-485f12128319 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:11.080465 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee916e6-7eaf-4640-995c-485f12128319 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:11.150557 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:11.152964 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee916e6-7eaf-4640-995c-485f12128319 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:11.154895 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee916e6-7eaf-4640-995c-485f12128319 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:11.218321 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c07f2f-990b-4af2-b39b-9996fe741ae5 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:11.260077 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 163/327] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Oct 27 13:12:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 27 13:12:11.266504 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee916e6-7eaf-4640-995c-485f12128319 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:11.338556 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c07f2f-990b-4af2-b39b-9996fe741ae5 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:11.382635 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507bbb51-ffed-4e24-a072-75d2ecbf8485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:11.383184 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bbb51-ffed-4e24-a072-75d2ecbf8485 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:11.384002 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bbb51-ffed-4e24-a072-75d2ecbf8485 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:11.384002 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bbb51-ffed-4e24-a072-75d2ecbf8485 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:11.390300 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee916e6-7eaf-4640-995c-485f12128319 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:11.391875 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:11.394666 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507bbb51-ffed-4e24-a072-75d2ecbf8485 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:12:11.399515 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-507bbb51-ffed-4e24-a072-75d2ecbf8485 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:12:11.399515 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:11.399515 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:11.399515 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:11.399515 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:11.399515 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:11.399515 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:11.399515 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:11.399515 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:11.399515 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:11.399515 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:11.399515 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:11.399515 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:12:11.399515 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:12:11.399515 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:12:11.399515 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:12:11.400401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:12:11.400401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:12:11.400401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:12:11.400401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:12:11.400401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:11.400401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:11.400401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:11.400401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:11.400401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:11.400401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:11.400401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:11.400401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:11.400401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:11.400401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:11.400401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:11.400401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:11.401190 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:11.401190 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:11.401190 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:11.401190 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:11.401190 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:12:11.401190 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:12:11.401190 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:12:11.401190 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:12:11.401190 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:12:11.401190 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:12:11.401190 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:12:11.401190 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:11.401190 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 165/328] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Oct 27 13:12:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:12:11.406955 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507bbb51-ffed-4e24-a072-75d2ecbf8485 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:11.423236 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:11.433426 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526f640-b598-4ec8-b345-0be9b0b23d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:11.434104 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526f640-b598-4ec8-b345-0be9b0b23d34 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:11.434380 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526f640-b598-4ec8-b345-0be9b0b23d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:11.434649 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526f640-b598-4ec8-b345-0be9b0b23d34 None admin] PATH_INFO: `/v3/projects/350b6dccdfa543e18bffdf3853710ebf` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:11.435952 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526f640-b598-4ec8-b345-0be9b0b23d34 None admin] RBAC: Authorizing `identity:get_project(project_id=350b6dccdfa543e18bffdf3853710ebf)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:11.438484 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526f640-b598-4ec8-b345-0be9b0b23d34 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:11.440671 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 164/329] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Oct 27 13:12:11 2022] GET /identity/v3/projects/350b6dccdfa543e18bffdf3853710ebf => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:12:11.446261 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526f640-b598-4ec8-b345-0be9b0b23d34 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:11.523949 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507bbb51-ffed-4e24-a072-75d2ecbf8485 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:11.550954 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526f640-b598-4ec8-b345-0be9b0b23d34 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:11.558564 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108fcc6f-136e-4c31-8617-822590944b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:11.559166 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108fcc6f-136e-4c31-8617-822590944b30 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:11.559449 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108fcc6f-136e-4c31-8617-822590944b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:11.559719 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108fcc6f-136e-4c31-8617-822590944b30 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:11.560383 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108fcc6f-136e-4c31-8617-822590944b30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:11.560679 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108fcc6f-136e-4c31-8617-822590944b30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:11.562109 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108fcc6f-136e-4c31-8617-822590944b30 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:11.570443 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 166/330] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Oct 27 13:12:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:12:11.576276 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108fcc6f-136e-4c31-8617-822590944b30 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:11.585482 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a9b30c-79fe-4edd-a007-0faba2cc1afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:11.586151 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9b30c-79fe-4edd-a007-0faba2cc1afb None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:11.586422 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9b30c-79fe-4edd-a007-0faba2cc1afb None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:11.586689 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9b30c-79fe-4edd-a007-0faba2cc1afb None admin] PATH_INFO: `/v3/groups/9c4eec6dae5b45d185c5afdaf338a033` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:11.587820 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a9b30c-79fe-4edd-a007-0faba2cc1afb None admin] RBAC: Authorizing `identity:get_group(group_id=9c4eec6dae5b45d185c5afdaf338a033)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:11.589317 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a9b30c-79fe-4edd-a007-0faba2cc1afb None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:11.595622 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 165/331] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Oct 27 13:12:11 2022] GET /identity/v3/groups/9c4eec6dae5b45d185c5afdaf338a033 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:12:11.596428 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a9b30c-79fe-4edd-a007-0faba2cc1afb None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:11.629713 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:11.651277 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:11.677279 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108fcc6f-136e-4c31-8617-822590944b30 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:11.696739 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a9b30c-79fe-4edd-a007-0faba2cc1afb None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:11.711040 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef13fb-cb3e-4b6b-8b88-94498ae990a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:11.711631 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef13fb-cb3e-4b6b-8b88-94498ae990a0 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:11.711905 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef13fb-cb3e-4b6b-8b88-94498ae990a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:11.712170 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef13fb-cb3e-4b6b-8b88-94498ae990a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:11.731805 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244fa8e-1eb3-4e6f-8173-0f29ffab3a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:11.732434 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244fa8e-1eb3-4e6f-8173-0f29ffab3a6b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:11.732711 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244fa8e-1eb3-4e6f-8173-0f29ffab3a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:11.732979 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244fa8e-1eb3-4e6f-8173-0f29ffab3a6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:11.733758 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5244fa8e-1eb3-4e6f-8173-0f29ffab3a6b None admin] RBAC: Adding query filter params (group.id=9c4eec6dae5b45d185c5afdaf338a033, role.id=5db0b376b1b047f6bdc42dc784aa1ba9, scope.project.id=350b6dccdfa543e18bffdf3853710ebf) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:11.734064 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5244fa8e-1eb3-4e6f-8173-0f29ffab3a6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:11.735524 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5244fa8e-1eb3-4e6f-8173-0f29ffab3a6b None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:11.741737 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 166/332] 10.222.0.52 () {56 vars in 1376 bytes} [Thu Oct 27 13:12:11 2022] GET /identity/v3/role_assignments?group.id=9c4eec6dae5b45d185c5afdaf338a033&scope.project.id=350b6dccdfa543e18bffdf3853710ebf&role.id=5db0b376b1b047f6bdc42dc784aa1ba9 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:11.790301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef13fb-cb3e-4b6b-8b88-94498ae990a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:11.791782 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef13fb-cb3e-4b6b-8b88-94498ae990a0 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:11.875515 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:11.903743 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 167/333] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Oct 27 13:12:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 13:12:11.909569 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244fa8e-1eb3-4e6f-8173-0f29ffab3a6b None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:12.020233 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:12.023474 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244fa8e-1eb3-4e6f-8173-0f29ffab3a6b None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:12.059739 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b9417-d14f-43c0-a5c6-724f504b094c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:12.060363 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b9417-d14f-43c0-a5c6-724f504b094c None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:12.060637 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b9417-d14f-43c0-a5c6-724f504b094c None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:12.060907 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b9417-d14f-43c0-a5c6-724f504b094c None admin] PATH_INFO: `/v3/projects/818c3abbd7494faeb4f418fcf977e5d3` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:12.062033 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b9417-d14f-43c0-a5c6-724f504b094c None admin] RBAC: Authorizing `identity:get_project(project_id=818c3abbd7494faeb4f418fcf977e5d3)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:12.063475 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b9417-d14f-43c0-a5c6-724f504b094c None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:12.065319 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 167/334] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Oct 27 13:12:11 2022] GET /identity/v3/projects/818c3abbd7494faeb4f418fcf977e5d3 => generated 344 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:12.070975 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef13fb-cb3e-4b6b-8b88-94498ae990a0 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:12.172514 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef13fb-cb3e-4b6b-8b88-94498ae990a0 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:12.210736 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea72dc-7092-49f6-8bc2-3a3cbd79f663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:12.211662 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea72dc-7092-49f6-8bc2-3a3cbd79f663 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:12.212072 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea72dc-7092-49f6-8bc2-3a3cbd79f663 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:12.212480 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea72dc-7092-49f6-8bc2-3a3cbd79f663 None admin] PATH_INFO: `/v3/groups/6c626c50bdd74e289adbbe76523f7cd4` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:12.214523 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea72dc-7092-49f6-8bc2-3a3cbd79f663 None admin] RBAC: Authorizing `identity:get_group(group_id=6c626c50bdd74e289adbbe76523f7cd4)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:12.216791 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea72dc-7092-49f6-8bc2-3a3cbd79f663 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:12.219349 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 168/335] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Oct 27 13:12:12 2022] GET /identity/v3/groups/6c626c50bdd74e289adbbe76523f7cd4 => generated 229 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:12.228749 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b9417-d14f-43c0-a5c6-724f504b094c None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:12.336410 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b9417-d14f-43c0-a5c6-724f504b094c None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:12.374100 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897e1218-2cf0-4afa-9229-835496848848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:12.374694 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e1218-2cf0-4afa-9229-835496848848 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:12.374976 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e1218-2cf0-4afa-9229-835496848848 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:12.375246 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e1218-2cf0-4afa-9229-835496848848 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:12.375971 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897e1218-2cf0-4afa-9229-835496848848 None admin] RBAC: Adding query filter params (group.id=6c626c50bdd74e289adbbe76523f7cd4, role.id=93bba834c17a4aa7afdc65c002a12975, scope.project.id=818c3abbd7494faeb4f418fcf977e5d3) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:12.376277 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897e1218-2cf0-4afa-9229-835496848848 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:12.377737 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897e1218-2cf0-4afa-9229-835496848848 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:12.383763 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 168/336] 10.222.0.52 () {56 vars in 1376 bytes} [Thu Oct 27 13:12:12 2022] GET /identity/v3/role_assignments?group.id=6c626c50bdd74e289adbbe76523f7cd4&scope.project.id=818c3abbd7494faeb4f418fcf977e5d3&role.id=93bba834c17a4aa7afdc65c002a12975 => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:15.267064 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76cf0f-19f9-4425-87fe-809f10f464c6 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:15.267064 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76cf0f-19f9-4425-87fe-809f10f464c6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:15.267064 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76cf0f-19f9-4425-87fe-809f10f464c6 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:15.267698 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac42eae-03e9-4e0c-9224-6f5b1277d524 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:15.267698 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac42eae-03e9-4e0c-9224-6f5b1277d524 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:15.267698 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac42eae-03e9-4e0c-9224-6f5b1277d524 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:15.268157 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 169/337] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:15.268483 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 169/338] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:15.272143 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f068b-5e84-49eb-a495-3b2fa4b738e8 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:15.272653 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f068b-5e84-49eb-a495-3b2fa4b738e8 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:15.273112 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f068b-5e84-49eb-a495-3b2fa4b738e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:15.273964 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2eafe-b8a0-4097-80af-2a99ea9fc60d None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:15.274476 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2eafe-b8a0-4097-80af-2a99ea9fc60d None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:15.274945 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2eafe-b8a0-4097-80af-2a99ea9fc60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:15.301701 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-fe3f068b-5e84-49eb-a495-3b2fa4b738e8 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:15.302874 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-fe3f068b-5e84-49eb-a495-3b2fa4b738e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:15.310299 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-2af2eafe-b8a0-4097-80af-2a99ea9fc60d None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:15.311450 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2af2eafe-b8a0-4097-80af-2a99ea9fc60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:15.356488 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:15.370858 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:15.404809 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 170/339] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 13:12:15.406539 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6955a9-e4e0-419c-a4dd-ae71d0cc756c None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:15.407097 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6955a9-e4e0-419c-a4dd-ae71d0cc756c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:15.407437 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 170/340] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:12:15.407649 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6955a9-e4e0-419c-a4dd-ae71d0cc756c None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:15.409024 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 171/341] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:15.414811 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ea6b0-cca1-409b-a647-a37d9735e243 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:15.415342 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ea6b0-cca1-409b-a647-a37d9735e243 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:15.415798 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ea6b0-cca1-409b-a647-a37d9735e243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:15.434396 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-212ea6b0-cca1-409b-a647-a37d9735e243 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:15.435849 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-212ea6b0-cca1-409b-a647-a37d9735e243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:15.501216 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 171/342] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:12:15.718551 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6955a9-e4e0-419c-a4dd-ae71d0cc756c None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:15.810689 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ea6b0-cca1-409b-a647-a37d9735e243 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:15.880669 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6955a9-e4e0-419c-a4dd-ae71d0cc756c None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:15.916150 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ea6b0-cca1-409b-a647-a37d9735e243 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:15.917254 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ffea45-313a-42be-b346-401851aafdce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:15.917893 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:15.917998 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ffea45-313a-42be-b346-401851aafdce None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:15.918344 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ffea45-313a-42be-b346-401851aafdce None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:15.918680 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ffea45-313a-42be-b346-401851aafdce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:15.929127 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ffea45-313a-42be-b346-401851aafdce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:15.930616 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ffea45-313a-42be-b346-401851aafdce None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:15.945338 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-59ffea45-313a-42be-b346-401851aafdce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:15.945338 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:15.945338 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:15.945338 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:15.945338 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:15.945338 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:15.945338 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:15.945338 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:15.945338 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:15.945338 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:15.945338 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:15.945338 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:15.945338 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:12:15.945338 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:12:15.945338 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:12:15.945338 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:12:15.946299 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:15.946299 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:15.946299 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:15.946299 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:15.946299 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:15.946299 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:15.946299 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:15.946299 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:15.946299 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:15.946299 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:15.946299 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:15.946299 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:15.946299 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:15.946299 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:15.946299 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:15.946299 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:15.946299 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:12:15.947727 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:12:15.947727 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:15.947727 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:15.947727 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 172/343] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:12:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:15.948042 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83666b-e2a1-41c1-9989-018413c697bf None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:15.948480 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83666b-e2a1-41c1-9989-018413c697bf None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:15.948578 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83666b-e2a1-41c1-9989-018413c697bf None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:15.949833 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 173/344] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:15.950735 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83666b-e2a1-41c1-9989-018413c697bf None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:15.961642 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202ba2a-2fd4-48ce-b428-c685e261cdbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:15.962523 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202ba2a-2fd4-48ce-b428-c685e261cdbd None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:15.963053 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202ba2a-2fd4-48ce-b428-c685e261cdbd None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:15.963317 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202ba2a-2fd4-48ce-b428-c685e261cdbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:15.970429 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:15.976029 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202ba2a-2fd4-48ce-b428-c685e261cdbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:15.977792 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202ba2a-2fd4-48ce-b428-c685e261cdbd None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:15.994413 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-3202ba2a-2fd4-48ce-b428-c685e261cdbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:15.994413 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:15.994413 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:15.994413 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:15.994413 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:15.994413 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:15.994413 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:15.994413 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:15.994413 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:15.994413 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:15.994413 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:15.994413 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:15.994413 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:12:15.994413 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:12:15.994413 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:12:15.994413 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:12:15.995491 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:15.995491 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:15.995491 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:15.995491 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:15.995491 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:15.995491 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:15.995491 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:15.995491 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:15.995491 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:15.995491 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:15.995491 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:15.995491 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:15.995491 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:15.995491 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:15.995491 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:15.995491 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:15.995491 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:12:15.996563 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:12:15.996563 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:15.996563 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:15.998445 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 172/345] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:12:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:12:15.999359 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202ba2a-2fd4-48ce-b428-c685e261cdbd None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:16.066282 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83666b-e2a1-41c1-9989-018413c697bf None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:16.101918 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcdd325-ce8c-4926-9795-372516173c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:16.102549 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdd325-ce8c-4926-9795-372516173c91 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:16.102829 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdd325-ce8c-4926-9795-372516173c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:16.103099 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdd325-ce8c-4926-9795-372516173c91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:16.114880 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcdd325-ce8c-4926-9795-372516173c91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:16.115974 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202ba2a-2fd4-48ce-b428-c685e261cdbd None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:16.116397 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcdd325-ce8c-4926-9795-372516173c91 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:16.132528 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-bdcdd325-ce8c-4926-9795-372516173c91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:16.132528 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:16.132528 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:16.132528 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:16.132528 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:16.132528 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:16.132528 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:16.132528 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:16.132528 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:16.132528 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:16.132528 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:16.132528 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:16.132528 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:12:16.132528 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:12:16.132528 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:12:16.132528 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:12:16.133511 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:16.133511 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:16.133511 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:16.133511 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:16.133511 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:16.133511 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:16.133511 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:16.133511 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:16.133511 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:16.133511 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:16.133511 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:16.133511 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:16.133511 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:16.133511 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:16.133511 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:16.133511 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:16.133511 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:12:16.134423 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:12:16.134423 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:16.134423 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:16.134423 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 174/346] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:12:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:16.134897 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02afc40-a8ed-4c4f-8672-985f30385c1b None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:16.135325 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02afc40-a8ed-4c4f-8672-985f30385c1b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:16.135758 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02afc40-a8ed-4c4f-8672-985f30385c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:16.157559 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-c02afc40-a8ed-4c4f-8672-985f30385c1b None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:16.158744 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c02afc40-a8ed-4c4f-8672-985f30385c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:16.159389 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb03361-05a3-42bc-9473-1309663fbcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:16.160096 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb03361-05a3-42bc-9473-1309663fbcb2 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:16.160374 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb03361-05a3-42bc-9473-1309663fbcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:16.160637 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb03361-05a3-42bc-9473-1309663fbcb2 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:16.161279 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb03361-05a3-42bc-9473-1309663fbcb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:16.161590 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb03361-05a3-42bc-9473-1309663fbcb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:16.162973 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb03361-05a3-42bc-9473-1309663fbcb2 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:16.180045 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 173/347] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:16.180045 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb03361-05a3-42bc-9473-1309663fbcb2 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:16.193126 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:16.227744 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:16.236574 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 175/348] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:12:16.237793 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02afc40-a8ed-4c4f-8672-985f30385c1b None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:16.288804 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb03361-05a3-42bc-9473-1309663fbcb2 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:16.326618 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5cbbe-104c-475f-8a48-8dd49252a7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:16.327668 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5cbbe-104c-475f-8a48-8dd49252a7d7 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:16.327944 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5cbbe-104c-475f-8a48-8dd49252a7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:16.328212 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5cbbe-104c-475f-8a48-8dd49252a7d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:16.328838 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada5cbbe-104c-475f-8a48-8dd49252a7d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:16.329144 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada5cbbe-104c-475f-8a48-8dd49252a7d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:16.330657 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada5cbbe-104c-475f-8a48-8dd49252a7d7 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:16.340793 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02afc40-a8ed-4c4f-8672-985f30385c1b None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:16.347230 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 174/349] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:16.347230 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5cbbe-104c-475f-8a48-8dd49252a7d7 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:16.380774 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ba93e-3af2-484a-ae56-f1c690ffbf2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:16.381702 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ba93e-3af2-484a-ae56-f1c690ffbf2b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:16.381979 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ba93e-3af2-484a-ae56-f1c690ffbf2b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:16.382261 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ba93e-3af2-484a-ae56-f1c690ffbf2b None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:16.382888 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1ba93e-3af2-484a-ae56-f1c690ffbf2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:16.383187 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1ba93e-3af2-484a-ae56-f1c690ffbf2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:16.384577 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1ba93e-3af2-484a-ae56-f1c690ffbf2b None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:16.396302 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 176/350] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:16.397481 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52231c8a-adad-46b8-872e-ad1da5ac034a None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:16.397799 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52231c8a-adad-46b8-872e-ad1da5ac034a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:16.398076 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52231c8a-adad-46b8-872e-ad1da5ac034a None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:16.399407 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 177/351] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:16.400006 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52231c8a-adad-46b8-872e-ad1da5ac034a None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:16.436327 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:16.459387 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:16.464949 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5cbbe-104c-475f-8a48-8dd49252a7d7 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:16.501766 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ced96e-f90a-469c-829b-5976bdcc8a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:16.502381 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ced96e-f90a-469c-829b-5976bdcc8a76 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:16.502657 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ced96e-f90a-469c-829b-5976bdcc8a76 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:16.502931 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ced96e-f90a-469c-829b-5976bdcc8a76 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:16.503591 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ced96e-f90a-469c-829b-5976bdcc8a76 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:16.505054 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ced96e-f90a-469c-829b-5976bdcc8a76 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:16.506986 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52231c8a-adad-46b8-872e-ad1da5ac034a None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:16.526622 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 175/352] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Oct 27 13:12:16 2022] POST /identity/v3/users => generated 248 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:12:16.527667 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ced96e-f90a-469c-829b-5976bdcc8a76 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:16.541725 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3397554-6ca1-4052-a9b9-195082a37b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:16.542352 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3397554-6ca1-4052-a9b9-195082a37b04 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:16.542626 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3397554-6ca1-4052-a9b9-195082a37b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:16.542892 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3397554-6ca1-4052-a9b9-195082a37b04 None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:16.543558 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3397554-6ca1-4052-a9b9-195082a37b04 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:16.545039 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3397554-6ca1-4052-a9b9-195082a37b04 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:16.569937 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 178/353] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Oct 27 13:12:16 2022] POST /identity/v3/users => generated 248 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:12:16.571764 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b26b5-be07-4a02-8d1d-0a81be5f4309 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:16.572249 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b26b5-be07-4a02-8d1d-0a81be5f4309 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:16.572741 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b26b5-be07-4a02-8d1d-0a81be5f4309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:16.593314 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-839b26b5-be07-4a02-8d1d-0a81be5f4309 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:16.594991 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-839b26b5-be07-4a02-8d1d-0a81be5f4309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:16.678769 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ced96e-f90a-469c-829b-5976bdcc8a76 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:16.712645 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:16.722731 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f40601-d85c-4193-8b03-4b2d96d85c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:16.723427 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f40601-d85c-4193-8b03-4b2d96d85c8e None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:16.723714 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f40601-d85c-4193-8b03-4b2d96d85c8e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:16.723991 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f40601-d85c-4193-8b03-4b2d96d85c8e None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:16.724098 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 179/354] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:12:16.724661 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f40601-d85c-4193-8b03-4b2d96d85c8e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:16.724908 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b26b5-be07-4a02-8d1d-0a81be5f4309 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:16.734928 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f40601-d85c-4193-8b03-4b2d96d85c8e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:16.766102 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 176/355] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Oct 27 13:12:16 2022] POST /identity/v3/users => generated 246 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:12:16.784754 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:16.856241 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b26b5-be07-4a02-8d1d-0a81be5f4309 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:16.895402 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d1146-5e90-44e9-87ee-59796de505e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:16.896390 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d1146-5e90-44e9-87ee-59796de505e6 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:16.896850 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d1146-5e90-44e9-87ee-59796de505e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:16.897299 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d1146-5e90-44e9-87ee-59796de505e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:16.909099 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d1146-5e90-44e9-87ee-59796de505e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:16.911096 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d1146-5e90-44e9-87ee-59796de505e6 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:16.928513 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-810d1146-5e90-44e9-87ee-59796de505e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:16.928513 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:16.928513 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:16.928513 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:16.928513 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:16.928513 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:16.928513 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:16.928513 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:16.928513 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:16.928513 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:16.928513 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:16.928513 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:16.928513 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:12:16.928513 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:12:16.928513 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:12:16.928513 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:12:16.929566 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:16.929566 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:16.929566 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:16.929566 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:16.929566 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:16.929566 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:16.929566 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:16.929566 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:16.929566 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:16.929566 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:16.929566 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:16.929566 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:16.929566 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:16.929566 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:16.929566 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:16.929566 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:16.929566 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:12:16.930491 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:12:16.930491 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:16.930491 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:16.932114 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 180/356] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:12:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:16.938714 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f40601-d85c-4193-8b03-4b2d96d85c8e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:17.038279 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d1146-5e90-44e9-87ee-59796de505e6 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:17.077471 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f40601-d85c-4193-8b03-4b2d96d85c8e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:17.118271 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02d0cd-7b80-4eb4-9a9b-871f2a340c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:17.118885 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02d0cd-7b80-4eb4-9a9b-871f2a340c8e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:17.119161 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02d0cd-7b80-4eb4-9a9b-871f2a340c8e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:17.119610 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02d0cd-7b80-4eb4-9a9b-871f2a340c8e None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:17.120267 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d02d0cd-7b80-4eb4-9a9b-871f2a340c8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:17.120566 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d02d0cd-7b80-4eb4-9a9b-871f2a340c8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:17.122123 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d02d0cd-7b80-4eb4-9a9b-871f2a340c8e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:17.136256 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 177/357] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:17.141657 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02d0cd-7b80-4eb4-9a9b-871f2a340c8e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:17.165598 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:17.176903 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d1146-5e90-44e9-87ee-59796de505e6 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:17.195287 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:17.221029 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbde40-3f97-4719-a6d4-8c738fcfeec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:17.221946 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbde40-3f97-4719-a6d4-8c738fcfeec5 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:17.222225 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbde40-3f97-4719-a6d4-8c738fcfeec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:17.222579 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbde40-3f97-4719-a6d4-8c738fcfeec5 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:17.223405 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafbde40-3f97-4719-a6d4-8c738fcfeec5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:17.225650 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafbde40-3f97-4719-a6d4-8c738fcfeec5 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:17.236580 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.sql.core [None req-bafbde40-3f97-4719-a6d4-8c738fcfeec5 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 27 13:12:17.236580 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 27 13:12:17.236580 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [parameters: {'id': '7782f74ab905441e97df4a7f9912e67c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 27 13:12:17.236580 dv-cinder-862432-3-smb devstack@keystone.service[81482]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81482) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 27 13:12:17.254128 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-bafbde40-3f97-4719-a6d4-8c738fcfeec5 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 27 13:12:17.254128 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:17.254128 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 13:12:17.254128 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 27 13:12:17.254128 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 13:12:17.254128 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 27 13:12:17.254128 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 13:12:17.254128 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application result = self._query(query) Oct 27 13:12:17.254128 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 13:12:17.254128 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application conn.query(q) Oct 27 13:12:17.254128 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 13:12:17.254128 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 13:12:17.254128 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 13:12:17.254128 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application result.read() Oct 27 13:12:17.254128 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 13:12:17.255051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 27 13:12:17.255051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 13:12:17.255051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 27 13:12:17.255051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 13:12:17.255051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 27 13:12:17.255051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 13:12:17.255051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 27 13:12:17.255051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 27 13:12:17.255051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:17.255051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 27 13:12:17.255051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:17.255051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:17.255051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 27 13:12:17.255051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 27 13:12:17.255051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 27 13:12:17.255051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return ref.to_dict() Oct 27 13:12:17.255051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 27 13:12:17.255051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application next(self.gen) Oct 27 13:12:17.255979 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 27 13:12:17.255979 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application yield resource Oct 27 13:12:17.255979 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 27 13:12:17.255979 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application next(self.gen) Oct 27 13:12:17.255979 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 27 13:12:17.255979 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self.session.rollback() Oct 27 13:12:17.255979 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 13:12:17.255979 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self.force_reraise() Oct 27 13:12:17.255979 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 13:12:17.255979 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise self.value Oct 27 13:12:17.255979 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 27 13:12:17.255979 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 27 13:12:17.255979 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 27 13:12:17.255979 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application session.commit() Oct 27 13:12:17.255979 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 27 13:12:17.255979 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 27 13:12:17.255979 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 27 13:12:17.256842 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._prepare_impl() Oct 27 13:12:17.256842 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 27 13:12:17.256842 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self.session.flush() Oct 27 13:12:17.256842 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 27 13:12:17.256842 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._flush(objects) Oct 27 13:12:17.256842 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 27 13:12:17.256842 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 27 13:12:17.256842 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 27 13:12:17.256842 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application compat.raise_( Oct 27 13:12:17.256842 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 13:12:17.256842 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception Oct 27 13:12:17.256842 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 27 13:12:17.256842 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application flush_context.execute() Oct 27 13:12:17.256842 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 27 13:12:17.256842 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rec.execute(self) Oct 27 13:12:17.256842 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 27 13:12:17.256842 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 27 13:12:17.258493 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 27 13:12:17.258493 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 27 13:12:17.258493 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 27 13:12:17.258493 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 27 13:12:17.258493 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 27 13:12:17.258493 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 27 13:12:17.258493 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 27 13:12:17.258493 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 27 13:12:17.258493 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 27 13:12:17.258493 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 27 13:12:17.258493 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 27 13:12:17.258493 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 27 13:12:17.258493 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 27 13:12:17.258493 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 27 13:12:17.258493 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 13:12:17.258493 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception Oct 27 13:12:17.259286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 13:12:17.259286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 27 13:12:17.259286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 13:12:17.259286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 27 13:12:17.259286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 13:12:17.259286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application result = self._query(query) Oct 27 13:12:17.259286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 13:12:17.259286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application conn.query(q) Oct 27 13:12:17.259286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 13:12:17.259286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 13:12:17.259286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 13:12:17.259286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application result.read() Oct 27 13:12:17.259286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 13:12:17.259286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 27 13:12:17.259286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 13:12:17.259286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 27 13:12:17.260625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 13:12:17.260625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 27 13:12:17.260625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 13:12:17.260625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 27 13:12:17.260625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 27 13:12:17.260625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 27 13:12:17.260625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [parameters: {'id': '7782f74ab905441e97df4a7f9912e67c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 27 13:12:17.260625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 27 13:12:17.260625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:17.260625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 13:12:17.260625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:17.260625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:17.260625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:17.260625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:17.260625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:17.260625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:17.262684 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:17.262684 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:17.262684 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:17.262684 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:17.262684 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:17.262684 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:17.262684 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 27 13:12:17.262684 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 27 13:12:17.262684 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:17.262684 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:17.262684 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 27 13:12:17.262684 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 27 13:12:17.262684 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 27 13:12:17.262684 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 27 13:12:17.262684 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 27 13:12:17.262684 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:17.264711 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 181/358] 10.222.0.52 () {60 vars in 1131 bytes} [Thu Oct 27 13:12:17 2022] POST /identity/v3/roles => generated 144 bytes in 219 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:12:17.264711 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbde40-3f97-4719-a6d4-8c738fcfeec5 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:17.292804 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02d0cd-7b80-4eb4-9a9b-871f2a340c8e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:17.368657 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db347b-cdc6-47df-9b4b-f1c66461dc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:17.369845 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db347b-cdc6-47df-9b4b-f1c66461dc03 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:17.370373 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db347b-cdc6-47df-9b4b-f1c66461dc03 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:17.370972 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db347b-cdc6-47df-9b4b-f1c66461dc03 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:17.371814 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db347b-cdc6-47df-9b4b-f1c66461dc03 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:17.373604 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db347b-cdc6-47df-9b4b-f1c66461dc03 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:17.408011 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbde40-3f97-4719-a6d4-8c738fcfeec5 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:17.412447 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 178/359] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Oct 27 13:12:17 2022] POST /identity/v3/users => generated 249 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:12:17.446073 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca064bb9-7708-49f8-85bb-2a780d700216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:17.446779 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca064bb9-7708-49f8-85bb-2a780d700216 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:17.447056 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca064bb9-7708-49f8-85bb-2a780d700216 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:17.447321 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca064bb9-7708-49f8-85bb-2a780d700216 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:17.459590 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca064bb9-7708-49f8-85bb-2a780d700216 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:12:17.465046 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-ca064bb9-7708-49f8-85bb-2a780d700216 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 13:12:17.465046 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:17.465046 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:17.465046 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:17.465046 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:17.465046 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:17.465046 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:17.465046 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:17.465046 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:17.465046 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:17.465046 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:17.465046 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:17.465046 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:12:17.465046 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:12:17.465046 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:12:17.465046 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:12:17.466291 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:12:17.466291 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:12:17.466291 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:12:17.466291 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:12:17.466291 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:17.466291 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:17.466291 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:17.466291 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:17.466291 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:17.466291 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:17.466291 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:17.466291 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:17.466291 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:17.466291 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:17.466291 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:17.466291 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:17.467426 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:17.467426 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:17.467426 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:17.467426 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:17.467426 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:12:17.467426 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:12:17.467426 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:12:17.467426 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:12:17.467426 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:12:17.467426 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:12:17.467426 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 13:12:17.467426 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:17.467426 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 182/360] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Oct 27 13:12:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:17.472478 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db347b-cdc6-47df-9b4b-f1c66461dc03 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:17.637122 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db347b-cdc6-47df-9b4b-f1c66461dc03 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:17.638645 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:17.680018 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824ea31-35a3-4157-8140-2ee3d0f3621f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:17.680975 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824ea31-35a3-4157-8140-2ee3d0f3621f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:17.681461 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824ea31-35a3-4157-8140-2ee3d0f3621f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:17.681941 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824ea31-35a3-4157-8140-2ee3d0f3621f None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:17.683206 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b824ea31-35a3-4157-8140-2ee3d0f3621f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:17.683767 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b824ea31-35a3-4157-8140-2ee3d0f3621f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:17.685353 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b824ea31-35a3-4157-8140-2ee3d0f3621f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:17.694224 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 179/361] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Oct 27 13:12:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:19.122594 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb8dc2-3b9f-4ee1-99e1-de4f2c402ee0 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:19.123082 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb8dc2-3b9f-4ee1-99e1-de4f2c402ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:19.123082 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb8dc2-3b9f-4ee1-99e1-de4f2c402ee0 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:19.124720 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 183/362] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:19.129780 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532d830-5ccb-44db-9a53-43ed2716ac3d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:19.130189 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532d830-5ccb-44db-9a53-43ed2716ac3d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:19.130373 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532d830-5ccb-44db-9a53-43ed2716ac3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:19.153866 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d532d830-5ccb-44db-9a53-43ed2716ac3d None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:19.155055 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d532d830-5ccb-44db-9a53-43ed2716ac3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:19.239830 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 180/363] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:12:19.398754 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed44204-3357-44af-b3d7-6074359cc057 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:19.398939 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed44204-3357-44af-b3d7-6074359cc057 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:19.399204 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed44204-3357-44af-b3d7-6074359cc057 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:19.400563 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 184/364] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:19.405895 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac8f4f-46a2-4ed7-8ca9-21cac1b197b4 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:19.406178 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac8f4f-46a2-4ed7-8ca9-21cac1b197b4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:19.406451 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac8f4f-46a2-4ed7-8ca9-21cac1b197b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:19.427088 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-b6ac8f4f-46a2-4ed7-8ca9-21cac1b197b4 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:19.428256 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b6ac8f4f-46a2-4ed7-8ca9-21cac1b197b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:19.476877 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea902e2c-be8d-481c-925a-55c25c8f669a None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:19.477234 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea902e2c-be8d-481c-925a-55c25c8f669a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:19.477417 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea902e2c-be8d-481c-925a-55c25c8f669a None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:19.479032 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 185/365] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:19.494956 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d68608-b4dc-43e7-8bb8-9db936b6cddf None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:19.495237 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d68608-b4dc-43e7-8bb8-9db936b6cddf None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:19.495514 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d68608-b4dc-43e7-8bb8-9db936b6cddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:19.506176 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 181/366] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:12:19.530496 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-79d68608-b4dc-43e7-8bb8-9db936b6cddf None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:19.531681 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-79d68608-b4dc-43e7-8bb8-9db936b6cddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:19.546846 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:19.583827 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac8f4f-46a2-4ed7-8ca9-21cac1b197b4 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:19.621805 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:19.628782 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 186/367] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 13:12:19.724000 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac8f4f-46a2-4ed7-8ca9-21cac1b197b4 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:19.767949 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32403ab3-f5ea-44d8-8a07-1068541aff68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:19.768987 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32403ab3-f5ea-44d8-8a07-1068541aff68 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:19.769548 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32403ab3-f5ea-44d8-8a07-1068541aff68 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:19.770071 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32403ab3-f5ea-44d8-8a07-1068541aff68 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:19.789417 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32403ab3-f5ea-44d8-8a07-1068541aff68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:12:19.794690 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-32403ab3-f5ea-44d8-8a07-1068541aff68 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 13:12:19.794690 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:19.794690 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:19.794690 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:19.794690 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:19.794690 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:19.794690 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:19.794690 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:19.794690 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:19.794690 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:19.794690 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:19.794690 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:19.794690 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:12:19.794690 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:12:19.794690 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:12:19.794690 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:12:19.795559 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:12:19.795559 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:12:19.795559 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:12:19.795559 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:12:19.795559 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:19.795559 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:19.795559 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:19.795559 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:19.795559 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:19.795559 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:19.795559 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:19.795559 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:19.795559 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:19.795559 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:19.795559 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:19.795559 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:19.796342 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:19.796342 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:19.796342 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:19.796342 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:19.796342 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:12:19.796342 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:12:19.796342 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:12:19.796342 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:12:19.796342 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:12:19.796342 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:12:19.796342 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 13:12:19.796342 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:19.798690 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 182/368] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Oct 27 13:12:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:12:19.809554 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d68608-b4dc-43e7-8bb8-9db936b6cddf None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:19.815773 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32403ab3-f5ea-44d8-8a07-1068541aff68 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:19.964615 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:19.975434 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d68608-b4dc-43e7-8bb8-9db936b6cddf None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:19.983080 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32403ab3-f5ea-44d8-8a07-1068541aff68 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:20.014652 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d8bed-3eee-4301-bb5f-609aff15f42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:20.015259 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d8bed-3eee-4301-bb5f-609aff15f42d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:20.015534 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d8bed-3eee-4301-bb5f-609aff15f42d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:20.015799 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d8bed-3eee-4301-bb5f-609aff15f42d None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:20.016449 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d8bed-3eee-4301-bb5f-609aff15f42d None admin] RBAC: Adding query filter params (name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:20.016767 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d8bed-3eee-4301-bb5f-609aff15f42d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:20.018164 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d8bed-3eee-4301-bb5f-609aff15f42d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:20.025052 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79daf5f-84f5-4dd8-992c-4d3fb640e77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:20.026286 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79daf5f-84f5-4dd8-992c-4d3fb640e77b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:20.026793 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79daf5f-84f5-4dd8-992c-4d3fb640e77b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:20.027268 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79daf5f-84f5-4dd8-992c-4d3fb640e77b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:20.028081 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 187/369] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Oct 27 13:12:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:20.029002 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d8bed-3eee-4301-bb5f-609aff15f42d None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:20.041718 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79daf5f-84f5-4dd8-992c-4d3fb640e77b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:12:20.042646 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:20.050213 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-a79daf5f-84f5-4dd8-992c-4d3fb640e77b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 13:12:20.050213 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:20.050213 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:20.050213 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:20.050213 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:20.050213 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:20.050213 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:20.050213 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:20.050213 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:20.050213 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:20.050213 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:20.050213 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:20.050213 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:12:20.050213 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:12:20.050213 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:12:20.050213 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:12:20.051304 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:12:20.051304 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:12:20.051304 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:12:20.051304 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:12:20.051304 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:20.051304 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:20.051304 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:20.051304 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:20.051304 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:20.051304 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:20.051304 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:20.051304 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:20.051304 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:20.051304 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:20.051304 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:20.051304 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:20.052114 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:20.052114 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:20.052114 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:20.052114 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:20.052114 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:12:20.052114 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:12:20.052114 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:12:20.052114 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:12:20.052114 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:12:20.052114 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:12:20.052114 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 13:12:20.052114 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:20.055020 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 183/370] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Oct 27 13:12:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:20.056876 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79daf5f-84f5-4dd8-992c-4d3fb640e77b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:20.145071 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d8bed-3eee-4301-bb5f-609aff15f42d None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:20.166917 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79daf5f-84f5-4dd8-992c-4d3fb640e77b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:20.183102 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd04487-9944-4666-a7b4-6fa7a664d848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:20.184129 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd04487-9944-4666-a7b4-6fa7a664d848 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:20.184605 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd04487-9944-4666-a7b4-6fa7a664d848 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:20.185072 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd04487-9944-4666-a7b4-6fa7a664d848 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:20.198318 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd04487-9944-4666-a7b4-6fa7a664d848 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:12:20.204493 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-5dd04487-9944-4666-a7b4-6fa7a664d848 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 13:12:20.204493 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:20.204493 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:20.204493 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:20.204493 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:20.204493 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:20.204493 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:20.204493 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:20.204493 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:20.204493 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:20.204493 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:20.204493 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:20.204493 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:12:20.204493 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:12:20.204493 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:12:20.204493 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:12:20.205459 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:12:20.205459 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:12:20.205459 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:12:20.205459 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:12:20.205459 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:20.205459 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:20.205459 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:20.205459 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:20.205459 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:20.205459 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:20.205459 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:20.205459 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:20.205459 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:20.205459 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:20.205459 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:20.205459 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:20.206307 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:20.206307 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:20.206307 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:20.206307 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:20.206307 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:12:20.206307 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:12:20.206307 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:12:20.206307 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:12:20.206307 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:12:20.206307 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:12:20.206307 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 13:12:20.206307 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:20.207049 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43509a2a-842a-4769-af5b-9f05667707a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:20.207696 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43509a2a-842a-4769-af5b-9f05667707a0 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:20.207803 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43509a2a-842a-4769-af5b-9f05667707a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:20.207995 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43509a2a-842a-4769-af5b-9f05667707a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:20.214540 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 188/371] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Oct 27 13:12:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:20.216010 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd04487-9944-4666-a7b4-6fa7a664d848 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:20.221428 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43509a2a-842a-4769-af5b-9f05667707a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:20.223105 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43509a2a-842a-4769-af5b-9f05667707a0 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:20.226258 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:20.241235 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-43509a2a-842a-4769-af5b-9f05667707a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:20.241235 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:20.241235 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:20.241235 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:20.241235 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:20.241235 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:20.241235 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:20.241235 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:20.241235 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:20.241235 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:20.241235 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:20.241235 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:20.241235 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:12:20.241235 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:12:20.241235 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:12:20.241235 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:12:20.242285 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:20.242285 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:20.242285 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:20.242285 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:20.242285 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:20.242285 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:20.242285 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:20.242285 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:20.242285 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:20.242285 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:20.242285 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:20.242285 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:20.242285 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:20.242285 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:20.242285 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:20.242285 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:20.242285 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:12:20.243837 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:12:20.243837 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:20.243837 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:20.243837 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 184/372] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:12:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:20.243837 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43509a2a-842a-4769-af5b-9f05667707a0 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:20.301341 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:20.336572 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd04487-9944-4666-a7b4-6fa7a664d848 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:20.358129 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43509a2a-842a-4769-af5b-9f05667707a0 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:20.376741 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5572081-729f-41da-b43d-4787fce11b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:20.377682 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5572081-729f-41da-b43d-4787fce11b83 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:20.378126 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5572081-729f-41da-b43d-4787fce11b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:20.378586 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5572081-729f-41da-b43d-4787fce11b83 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:20.379409 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5572081-729f-41da-b43d-4787fce11b83 None admin] RBAC: Adding query filter params (name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:20.379900 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5572081-729f-41da-b43d-4787fce11b83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:20.381451 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5572081-729f-41da-b43d-4787fce11b83 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:20.390158 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 189/373] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Oct 27 13:12:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:20.391096 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5572081-729f-41da-b43d-4787fce11b83 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:20.399322 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab774a-07ce-4663-ae44-78b6943776ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:20.399932 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab774a-07ce-4663-ae44-78b6943776ba None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:20.400203 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab774a-07ce-4663-ae44-78b6943776ba None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:20.400468 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab774a-07ce-4663-ae44-78b6943776ba None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:20.401127 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab774a-07ce-4663-ae44-78b6943776ba None admin] RBAC: Adding query filter params (name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:20.401426 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab774a-07ce-4663-ae44-78b6943776ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:20.402890 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab774a-07ce-4663-ae44-78b6943776ba None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:20.411958 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 185/374] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Oct 27 13:12:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:20.413169 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19af7ad-f030-4732-aae6-92af17e67193 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:20.413447 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19af7ad-f030-4732-aae6-92af17e67193 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:20.413777 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19af7ad-f030-4732-aae6-92af17e67193 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:20.415225 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 186/375] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:20.418272 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19af7ad-f030-4732-aae6-92af17e67193 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:20.484498 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:20.497366 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5572081-729f-41da-b43d-4787fce11b83 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:20.524985 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:20.526070 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19af7ad-f030-4732-aae6-92af17e67193 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:20.530767 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331fae16-4fcc-465d-8c10-23e55d200f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:20.531365 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331fae16-4fcc-465d-8c10-23e55d200f62 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:20.531636 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331fae16-4fcc-465d-8c10-23e55d200f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:20.531898 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331fae16-4fcc-465d-8c10-23e55d200f62 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:20.532533 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331fae16-4fcc-465d-8c10-23e55d200f62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:20.532831 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331fae16-4fcc-465d-8c10-23e55d200f62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:20.534230 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331fae16-4fcc-465d-8c10-23e55d200f62 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:20.545795 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 190/376] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:20.546573 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331fae16-4fcc-465d-8c10-23e55d200f62 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:20.559438 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5863c6-4802-4741-ac3d-dd7475fefaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:20.560068 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5863c6-4802-4741-ac3d-dd7475fefaa2 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:20.560348 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5863c6-4802-4741-ac3d-dd7475fefaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:20.560617 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5863c6-4802-4741-ac3d-dd7475fefaa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:20.571295 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5863c6-4802-4741-ac3d-dd7475fefaa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:20.572756 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5863c6-4802-4741-ac3d-dd7475fefaa2 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:20.587170 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-6b5863c6-4802-4741-ac3d-dd7475fefaa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:20.587170 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:20.587170 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:20.587170 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:20.587170 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:20.587170 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:20.587170 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:20.587170 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:20.587170 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:20.587170 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:20.587170 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:20.587170 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:20.587170 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:12:20.587170 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:12:20.587170 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:12:20.587170 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:12:20.588199 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:20.588199 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:20.588199 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:20.588199 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:20.588199 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:20.588199 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:20.588199 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:20.588199 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:20.588199 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:20.588199 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:20.588199 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:20.588199 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:20.588199 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:20.588199 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:20.588199 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:20.588199 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:20.588199 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:12:20.589876 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:12:20.589876 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:20.589876 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:20.589876 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 187/377] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:12:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:20.589876 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601060c-7349-4a87-94c0-1333adef921d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:20.589876 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601060c-7349-4a87-94c0-1333adef921d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:20.589876 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601060c-7349-4a87-94c0-1333adef921d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:20.607420 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-5601060c-7349-4a87-94c0-1333adef921d None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:20.608574 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5601060c-7349-4a87-94c0-1333adef921d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:20.644920 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331fae16-4fcc-465d-8c10-23e55d200f62 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:20.674630 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 188/378] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:12:20.675950 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0df7d7-1105-42fc-aaaa-9b30cd4d6b2f None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:20.676263 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0df7d7-1105-42fc-aaaa-9b30cd4d6b2f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:20.676535 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0df7d7-1105-42fc-aaaa-9b30cd4d6b2f None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:20.677973 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 189/379] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:20.678475 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0df7d7-1105-42fc-aaaa-9b30cd4d6b2f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:20.683520 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4056d7-264b-4226-8e34-3aeb072647cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:20.684144 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4056d7-264b-4226-8e34-3aeb072647cf None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:20.684412 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4056d7-264b-4226-8e34-3aeb072647cf None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:20.684673 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4056d7-264b-4226-8e34-3aeb072647cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:20.700171 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4056d7-264b-4226-8e34-3aeb072647cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:20.701686 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4056d7-264b-4226-8e34-3aeb072647cf None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:20.716227 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-db4056d7-264b-4226-8e34-3aeb072647cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:20.716227 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:20.716227 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:20.716227 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:20.716227 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:20.716227 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:20.716227 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:20.716227 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:20.716227 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:20.716227 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:20.716227 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:20.716227 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:20.716227 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:12:20.716227 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:12:20.716227 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:12:20.716227 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:12:20.717131 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:20.717131 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:20.717131 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:20.717131 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:20.717131 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:20.717131 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:20.717131 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:20.717131 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:20.717131 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:20.717131 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:20.717131 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:20.717131 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:20.717131 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:20.717131 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:20.717131 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:20.717131 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:20.717131 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:12:20.718626 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:12:20.718626 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:20.718626 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:20.718626 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 191/380] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:12:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:20.718626 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4056d7-264b-4226-8e34-3aeb072647cf None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:20.735140 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:20.770376 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:20.795988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0df7d7-1105-42fc-aaaa-9b30cd4d6b2f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:20.834723 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4056d7-264b-4226-8e34-3aeb072647cf None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:20.835842 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad11419-1a6f-445b-bc94-66d24102e354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:20.836484 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad11419-1a6f-445b-bc94-66d24102e354 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:20.836783 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad11419-1a6f-445b-bc94-66d24102e354 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:20.837049 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad11419-1a6f-445b-bc94-66d24102e354 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:20.844775 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad11419-1a6f-445b-bc94-66d24102e354 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:20.847158 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad11419-1a6f-445b-bc94-66d24102e354 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:20.864109 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-3ad11419-1a6f-445b-bc94-66d24102e354 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 27 13:12:20.864109 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:20.864109 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:20.864109 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:20.864109 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:20.864109 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:20.864109 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:20.864109 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:20.864109 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:20.864109 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:20.864109 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:20.864109 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:20.864109 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 13:12:20.864109 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 13:12:20.864109 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 13:12:20.864109 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 13:12:20.865067 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:20.865067 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:20.865067 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 13:12:20.865067 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:12:20.865067 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 13:12:20.865067 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:12:20.865067 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:20.865067 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:20.865067 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:20.865067 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:20.865067 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:20.865067 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:20.865067 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:20.865067 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:20.865067 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:20.865067 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:20.865067 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:20.865067 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:20.866025 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:20.866025 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:20.866025 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 13:12:20.866025 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 13:12:20.866025 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 13:12:20.866025 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 13:12:20.866025 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 13:12:20.866025 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 13:12:20.866025 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 27 13:12:20.866025 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:20.867138 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 190/381] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Oct 27 13:12:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:20.868332 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9320e08-1e0b-4a74-b80a-7b318a2af003 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:20.868607 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9320e08-1e0b-4a74-b80a-7b318a2af003 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:20.868830 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9320e08-1e0b-4a74-b80a-7b318a2af003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:20.878690 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b3ef4-aa53-40e8-a1f4-3eca80565806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:20.879292 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b3ef4-aa53-40e8-a1f4-3eca80565806 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:20.879618 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b3ef4-aa53-40e8-a1f4-3eca80565806 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:20.879833 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b3ef4-aa53-40e8-a1f4-3eca80565806 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:20.880474 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924b3ef4-aa53-40e8-a1f4-3eca80565806 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:20.880830 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924b3ef4-aa53-40e8-a1f4-3eca80565806 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:20.882313 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924b3ef4-aa53-40e8-a1f4-3eca80565806 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:20.887474 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-b9320e08-1e0b-4a74-b80a-7b318a2af003 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:20.888640 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b9320e08-1e0b-4a74-b80a-7b318a2af003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:20.897970 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 192/382] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:20.899144 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b3ef4-aa53-40e8-a1f4-3eca80565806 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:20.960026 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 191/383] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:12:20.960880 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9320e08-1e0b-4a74-b80a-7b318a2af003 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:20.990705 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:21.020637 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b3ef4-aa53-40e8-a1f4-3eca80565806 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:21.023218 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:21.058504 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3d89e-b04f-416e-a130-cdb57761f748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:21.059200 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3d89e-b04f-416e-a130-cdb57761f748 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:21.059481 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3d89e-b04f-416e-a130-cdb57761f748 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:21.059754 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3d89e-b04f-416e-a130-cdb57761f748 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:21.060388 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3d89e-b04f-416e-a130-cdb57761f748 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:21.060687 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3d89e-b04f-416e-a130-cdb57761f748 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:21.062109 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3d89e-b04f-416e-a130-cdb57761f748 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:21.065178 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9320e08-1e0b-4a74-b80a-7b318a2af003 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:21.074077 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 193/384] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:21.074883 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3d89e-b04f-416e-a130-cdb57761f748 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:21.105249 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a41349-a4d2-444f-8147-c6a36567691c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:21.106231 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a41349-a4d2-444f-8147-c6a36567691c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:21.106928 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a41349-a4d2-444f-8147-c6a36567691c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:21.107502 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a41349-a4d2-444f-8147-c6a36567691c None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:21.108480 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a41349-a4d2-444f-8147-c6a36567691c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:21.108919 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a41349-a4d2-444f-8147-c6a36567691c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:21.110515 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a41349-a4d2-444f-8147-c6a36567691c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:21.149822 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 192/385] 10.222.0.52 () {56 vars in 1137 bytes} [Thu Oct 27 13:12:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:21.150466 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a41349-a4d2-444f-8147-c6a36567691c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:21.185676 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3d89e-b04f-416e-a130-cdb57761f748 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:21.227175 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ad2ad-e34f-4220-ab36-a169d7f8c1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:21.228040 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ad2ad-e34f-4220-ab36-a169d7f8c1de None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:21.228312 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ad2ad-e34f-4220-ab36-a169d7f8c1de None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:21.228577 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ad2ad-e34f-4220-ab36-a169d7f8c1de None admin] PATH_INFO: `/v3/users/nova` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:21.236146 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0ad2ad-e34f-4220-ab36-a169d7f8c1de None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:21.237610 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0ad2ad-e34f-4220-ab36-a169d7f8c1de None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:21.240230 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:21.250416 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-9d0ad2ad-e34f-4220-ab36-a169d7f8c1de None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 13:12:21.250416 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:21.250416 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:21.250416 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:21.250416 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:21.250416 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:21.250416 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:21.250416 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:21.250416 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:21.250416 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:21.250416 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:21.250416 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:21.250416 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 13:12:21.250416 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 13:12:21.250416 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 13:12:21.250416 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 13:12:21.251293 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:21.251293 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:21.251293 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 13:12:21.251293 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:12:21.251293 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 13:12:21.251293 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:12:21.251293 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:21.251293 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:21.251293 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:21.251293 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:21.251293 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:21.251293 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:21.251293 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:21.251293 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:21.251293 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:21.251293 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:21.251293 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:21.251293 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:21.252184 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:21.252184 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:21.252184 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 13:12:21.252184 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 13:12:21.252184 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 13:12:21.252184 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 13:12:21.252184 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 13:12:21.252184 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 13:12:21.252184 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 27 13:12:21.252184 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:21.252184 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 194/386] 10.222.0.52 () {56 vars in 1093 bytes} [Thu Oct 27 13:12:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:21.253138 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ad2ad-e34f-4220-ab36-a169d7f8c1de None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:21.253204 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a41349-a4d2-444f-8147-c6a36567691c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:21.277683 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:21.289800 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1d853-8f74-4565-b3ee-099d3d6a5971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:21.290422 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1d853-8f74-4565-b3ee-099d3d6a5971 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:21.290694 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1d853-8f74-4565-b3ee-099d3d6a5971 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:21.290965 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1d853-8f74-4565-b3ee-099d3d6a5971 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:21.300767 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c1d853-8f74-4565-b3ee-099d3d6a5971 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:12:21.305739 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-82c1d853-8f74-4565-b3ee-099d3d6a5971 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 13:12:21.305739 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:21.305739 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:21.305739 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:21.305739 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:21.305739 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:21.305739 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:21.305739 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:21.305739 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:21.305739 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:21.305739 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:21.305739 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:21.305739 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:12:21.305739 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:12:21.305739 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:12:21.305739 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:12:21.306832 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:12:21.306832 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:12:21.306832 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:12:21.306832 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:12:21.306832 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:21.306832 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:21.306832 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:21.306832 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:21.306832 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:21.306832 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:21.306832 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:21.306832 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:21.306832 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:21.306832 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:21.306832 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:21.306832 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:21.308149 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:21.308149 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:21.308149 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:21.308149 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:21.308149 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:12:21.308149 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:12:21.308149 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:12:21.308149 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:12:21.308149 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:12:21.308149 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:12:21.308149 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 13:12:21.308149 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:21.308149 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 193/387] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Oct 27 13:12:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:21.308864 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1d853-8f74-4565-b3ee-099d3d6a5971 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:21.357919 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ad2ad-e34f-4220-ab36-a169d7f8c1de None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:21.390726 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c42cc-d56e-4ac8-9b93-7c0b28d2a354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:21.391346 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c42cc-d56e-4ac8-9b93-7c0b28d2a354 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:21.391618 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c42cc-d56e-4ac8-9b93-7c0b28d2a354 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:21.391885 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c42cc-d56e-4ac8-9b93-7c0b28d2a354 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:21.399193 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c42cc-d56e-4ac8-9b93-7c0b28d2a354 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:21.400654 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c42cc-d56e-4ac8-9b93-7c0b28d2a354 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:21.404745 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1d853-8f74-4565-b3ee-099d3d6a5971 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:21.412159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-b76c42cc-d56e-4ac8-9b93-7c0b28d2a354 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 27 13:12:21.412159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:21.412159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:21.412159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:21.412159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:21.412159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:21.412159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:21.412159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:21.412159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:21.412159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:21.412159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:21.412159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:21.412159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 13:12:21.412159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 13:12:21.412159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 13:12:21.412159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 13:12:21.413051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:21.413051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:21.413051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 13:12:21.413051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:12:21.413051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 13:12:21.413051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:12:21.413051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:21.413051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:21.413051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:21.413051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:21.413051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:21.413051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:21.413051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:21.413051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:21.413051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:21.413051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:21.413051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:21.413051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:21.413988 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:21.413988 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:21.413988 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 13:12:21.413988 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 13:12:21.413988 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 13:12:21.413988 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 13:12:21.413988 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 13:12:21.413988 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 13:12:21.413988 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 27 13:12:21.413988 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:21.413988 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 195/388] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Oct 27 13:12:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:21.414546 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c42cc-d56e-4ac8-9b93-7c0b28d2a354 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:21.444283 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064a040-00f1-4806-85c4-56462529d28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:21.444912 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064a040-00f1-4806-85c4-56462529d28c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:21.445184 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064a040-00f1-4806-85c4-56462529d28c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:21.445452 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064a040-00f1-4806-85c4-56462529d28c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:21.455590 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064a040-00f1-4806-85c4-56462529d28c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:21.457123 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064a040-00f1-4806-85c4-56462529d28c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:21.466116 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:21.473032 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-d064a040-00f1-4806-85c4-56462529d28c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:21.473032 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:21.473032 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:21.473032 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:21.473032 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:21.473032 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:21.473032 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:21.473032 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:21.473032 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:21.473032 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:21.473032 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:21.473032 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:21.473032 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:12:21.473032 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:12:21.473032 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:12:21.473032 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:12:21.473985 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:21.473985 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:21.473985 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:21.473985 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:21.473985 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:21.473985 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:21.473985 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:21.473985 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:21.473985 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:21.473985 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:21.473985 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:21.473985 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:21.473985 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:21.473985 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:21.473985 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:21.473985 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:21.473985 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:12:21.474845 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:12:21.474845 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:21.474845 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:21.477678 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 194/389] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:12:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:21.478671 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064a040-00f1-4806-85c4-56462529d28c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:21.501615 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:21.517281 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c42cc-d56e-4ac8-9b93-7c0b28d2a354 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:21.550129 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8c253-4d90-4e3c-8e8a-062dd21d2930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:21.550758 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8c253-4d90-4e3c-8e8a-062dd21d2930 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:21.551102 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8c253-4d90-4e3c-8e8a-062dd21d2930 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:21.551362 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8c253-4d90-4e3c-8e8a-062dd21d2930 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:21.562481 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea8c253-4d90-4e3c-8e8a-062dd21d2930 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:21.564576 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea8c253-4d90-4e3c-8e8a-062dd21d2930 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:21.576214 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064a040-00f1-4806-85c4-56462529d28c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:21.578674 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-bea8c253-4d90-4e3c-8e8a-062dd21d2930 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:21.578674 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:21.578674 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:21.578674 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:21.578674 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:21.578674 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:21.578674 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:21.578674 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:21.578674 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:21.578674 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:21.578674 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:21.578674 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:21.578674 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:12:21.578674 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:12:21.578674 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:12:21.578674 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:12:21.579557 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:21.579557 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:21.579557 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:21.579557 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:21.579557 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:21.579557 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:21.579557 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:21.579557 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:21.579557 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:21.579557 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:21.579557 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:21.579557 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:21.579557 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:21.579557 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:21.579557 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:21.579557 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:21.579557 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:12:21.580390 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:12:21.580390 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:21.580390 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:21.580390 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 196/390] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:12:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:21.580987 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8c253-4d90-4e3c-8e8a-062dd21d2930 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:21.609470 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77ea63-1b87-4bce-b4a5-b0c63438cf22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:21.610103 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77ea63-1b87-4bce-b4a5-b0c63438cf22 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:21.610375 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77ea63-1b87-4bce-b4a5-b0c63438cf22 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:21.610643 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77ea63-1b87-4bce-b4a5-b0c63438cf22 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:21.611356 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77ea63-1b87-4bce-b4a5-b0c63438cf22 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:21.611656 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77ea63-1b87-4bce-b4a5-b0c63438cf22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:21.613204 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77ea63-1b87-4bce-b4a5-b0c63438cf22 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:21.630506 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 195/391] 10.222.0.52 () {56 vars in 1133 bytes} [Thu Oct 27 13:12:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:21.631318 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77ea63-1b87-4bce-b4a5-b0c63438cf22 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:21.681518 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8c253-4d90-4e3c-8e8a-062dd21d2930 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:21.688353 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:21.714771 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dca17e-587d-4740-b667-1d9c90e770ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:21.715369 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dca17e-587d-4740-b667-1d9c90e770ad None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:21.715639 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dca17e-587d-4740-b667-1d9c90e770ad None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:21.715903 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dca17e-587d-4740-b667-1d9c90e770ad None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:21.716554 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dca17e-587d-4740-b667-1d9c90e770ad None admin] RBAC: Adding query filter params (name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:21.716849 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dca17e-587d-4740-b667-1d9c90e770ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:21.718259 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dca17e-587d-4740-b667-1d9c90e770ad None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:21.720387 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:21.728695 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 197/392] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Oct 27 13:12:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:21.729502 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dca17e-587d-4740-b667-1d9c90e770ad None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:21.730153 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77ea63-1b87-4bce-b4a5-b0c63438cf22 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:21.765835 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64810d-2402-4923-97ec-402e09d8d216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:21.766361 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64810d-2402-4923-97ec-402e09d8d216 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:21.766633 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64810d-2402-4923-97ec-402e09d8d216 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:21.766899 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64810d-2402-4923-97ec-402e09d8d216 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:21.767617 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64810d-2402-4923-97ec-402e09d8d216 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:21.767918 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64810d-2402-4923-97ec-402e09d8d216 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:21.769841 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64810d-2402-4923-97ec-402e09d8d216 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:21.789659 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 196/393] 10.222.0.52 () {56 vars in 1137 bytes} [Thu Oct 27 13:12:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:21.789659 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64810d-2402-4923-97ec-402e09d8d216 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:21.833376 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dca17e-587d-4740-b667-1d9c90e770ad None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:21.866560 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0bfbb-2c3d-415a-b05b-ad88a1ddc0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:21.867157 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0bfbb-2c3d-415a-b05b-ad88a1ddc0fd None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:21.867428 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0bfbb-2c3d-415a-b05b-ad88a1ddc0fd None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:21.867691 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0bfbb-2c3d-415a-b05b-ad88a1ddc0fd None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:21.868325 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe0bfbb-2c3d-415a-b05b-ad88a1ddc0fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:21.868617 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe0bfbb-2c3d-415a-b05b-ad88a1ddc0fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:21.870032 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe0bfbb-2c3d-415a-b05b-ad88a1ddc0fd None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:21.880987 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 198/394] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:21.881794 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0bfbb-2c3d-415a-b05b-ad88a1ddc0fd None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:21.887863 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64810d-2402-4923-97ec-402e09d8d216 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:21.904208 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:21.921469 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832d04f-3b4e-4f61-aad4-7daa332b15b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:21.922102 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832d04f-3b4e-4f61-aad4-7daa332b15b9 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:21.922379 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832d04f-3b4e-4f61-aad4-7daa332b15b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:21.922648 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832d04f-3b4e-4f61-aad4-7daa332b15b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:21.923284 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9832d04f-3b4e-4f61-aad4-7daa332b15b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:21.923581 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9832d04f-3b4e-4f61-aad4-7daa332b15b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:21.924965 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9832d04f-3b4e-4f61-aad4-7daa332b15b9 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:21.936364 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 197/395] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:21.937141 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832d04f-3b4e-4f61-aad4-7daa332b15b9 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:21.943610 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:21.984656 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0bfbb-2c3d-415a-b05b-ad88a1ddc0fd None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:22.018168 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d719cf8-b18c-4562-9c23-4bf3635f8326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:22.018716 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d719cf8-b18c-4562-9c23-4bf3635f8326 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:22.018985 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d719cf8-b18c-4562-9c23-4bf3635f8326 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:22.019297 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d719cf8-b18c-4562-9c23-4bf3635f8326 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:22.029577 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d719cf8-b18c-4562-9c23-4bf3635f8326 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:22.031075 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d719cf8-b18c-4562-9c23-4bf3635f8326 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:22.034437 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832d04f-3b4e-4f61-aad4-7daa332b15b9 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:22.045439 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-9d719cf8-b18c-4562-9c23-4bf3635f8326 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:22.045439 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:22.045439 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:22.045439 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:22.045439 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:22.045439 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:22.045439 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:22.045439 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:22.045439 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:22.045439 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:22.045439 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:22.045439 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:22.045439 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:12:22.045439 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:12:22.045439 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:12:22.045439 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:12:22.046346 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:22.046346 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:22.046346 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:22.046346 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:22.046346 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:22.046346 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:22.046346 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:22.046346 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:22.046346 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:22.046346 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:22.046346 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:22.046346 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:22.046346 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:22.046346 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:22.046346 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:22.046346 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:22.046346 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:12:22.047182 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:12:22.047182 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:22.047182 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:22.047182 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 199/396] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:12:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:22.047389 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d719cf8-b18c-4562-9c23-4bf3635f8326 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:22.073345 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc79f5-7318-4822-81af-ba93879393fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:22.074005 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc79f5-7318-4822-81af-ba93879393fd None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:22.074279 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc79f5-7318-4822-81af-ba93879393fd None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:22.074551 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc79f5-7318-4822-81af-ba93879393fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:22.086131 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc79f5-7318-4822-81af-ba93879393fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:22.087723 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc79f5-7318-4822-81af-ba93879393fd None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:22.101908 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-d0fc79f5-7318-4822-81af-ba93879393fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:22.101908 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:22.101908 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:22.101908 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:22.101908 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:22.101908 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:22.101908 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:22.101908 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:22.101908 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:22.101908 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:22.101908 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:22.101908 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:22.101908 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:12:22.101908 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:12:22.101908 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:12:22.101908 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:12:22.102804 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:22.102804 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:22.102804 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:22.102804 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:22.102804 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:22.102804 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:22.102804 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:22.102804 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:22.102804 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:22.102804 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:22.102804 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:22.102804 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:22.102804 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:22.102804 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:22.102804 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:22.102804 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:22.102804 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:12:22.103636 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:12:22.103636 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:22.103636 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:22.103636 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 198/397] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:12:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:22.104562 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc79f5-7318-4822-81af-ba93879393fd None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:22.132006 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:22.149003 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d719cf8-b18c-4562-9c23-4bf3635f8326 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:22.159038 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:22.182389 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b6a59-e94c-40d1-b2cd-85df2b312397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:22.183328 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b6a59-e94c-40d1-b2cd-85df2b312397 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:22.183603 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b6a59-e94c-40d1-b2cd-85df2b312397 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:22.183855 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b6a59-e94c-40d1-b2cd-85df2b312397 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:22.194184 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b6a59-e94c-40d1-b2cd-85df2b312397 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:22.195661 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b6a59-e94c-40d1-b2cd-85df2b312397 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:22.202685 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc79f5-7318-4822-81af-ba93879393fd None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:22.209467 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-765b6a59-e94c-40d1-b2cd-85df2b312397 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:22.209467 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:22.209467 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:22.209467 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:22.209467 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:22.209467 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:22.209467 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:22.209467 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:22.209467 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:22.209467 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:22.209467 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:22.209467 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:22.209467 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:12:22.209467 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:12:22.209467 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:12:22.209467 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:12:22.210504 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:22.210504 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:22.210504 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:22.210504 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:22.210504 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:22.210504 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:22.210504 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:22.210504 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:22.210504 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:22.210504 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:22.210504 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:22.210504 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:22.210504 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:22.210504 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:22.210504 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:22.210504 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:22.210504 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:12:22.211339 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:12:22.211339 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:22.211339 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:22.211339 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 200/398] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:12:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:22.211339 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b6a59-e94c-40d1-b2cd-85df2b312397 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:22.239099 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d41f7-f55f-4724-9969-da531f79a0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:22.239759 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d41f7-f55f-4724-9969-da531f79a0e5 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:22.240028 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d41f7-f55f-4724-9969-da531f79a0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:22.240281 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d41f7-f55f-4724-9969-da531f79a0e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:22.246813 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d41f7-f55f-4724-9969-da531f79a0e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:22.248260 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d41f7-f55f-4724-9969-da531f79a0e5 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:22.259804 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-787d41f7-f55f-4724-9969-da531f79a0e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:12:22.259804 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:22.259804 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:22.259804 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:22.259804 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:22.259804 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:22.259804 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:22.259804 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:22.259804 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:22.259804 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:22.259804 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:22.259804 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:22.259804 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 13:12:22.259804 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 13:12:22.259804 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 13:12:22.260679 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 13:12:22.260679 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:22.260679 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:22.260679 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:22.260679 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:22.260679 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:22.260679 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:22.260679 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:22.260679 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:22.260679 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:22.260679 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:22.260679 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:22.260679 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:22.260679 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:22.260679 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:22.260679 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:22.260679 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:22.261867 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 13:12:22.261867 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 13:12:22.261867 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 13:12:22.261867 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 13:12:22.261867 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 13:12:22.261867 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 13:12:22.261867 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:12:22.261867 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:22.261867 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 199/399] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Oct 27 13:12:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:22.261867 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d41f7-f55f-4724-9969-da531f79a0e5 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:22.319688 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b6a59-e94c-40d1-b2cd-85df2b312397 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:22.347605 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:22.353461 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5b552-1184-471f-84ee-84c5885c1fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:22.354125 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5b552-1184-471f-84ee-84c5885c1fe4 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:22.354366 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5b552-1184-471f-84ee-84c5885c1fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:22.354646 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5b552-1184-471f-84ee-84c5885c1fe4 None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:22.355282 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af5b552-1184-471f-84ee-84c5885c1fe4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:22.356731 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af5b552-1184-471f-84ee-84c5885c1fe4 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:22.359309 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d41f7-f55f-4724-9969-da531f79a0e5 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:22.378204 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 201/400] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Oct 27 13:12:22 2022] POST /identity/v3/users => generated 247 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:12:22.379430 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5b552-1184-471f-84ee-84c5885c1fe4 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:22.401999 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:22.412546 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f637b-fb0a-4a05-acd7-d0088025b001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:22.413611 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f637b-fb0a-4a05-acd7-d0088025b001 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:22.414054 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f637b-fb0a-4a05-acd7-d0088025b001 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:22.414588 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f637b-fb0a-4a05-acd7-d0088025b001 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:22.415231 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f637b-fb0a-4a05-acd7-d0088025b001 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:22.415534 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f637b-fb0a-4a05-acd7-d0088025b001 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:22.417334 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f637b-fb0a-4a05-acd7-d0088025b001 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:22.436871 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 200/401] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:22.436871 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f637b-fb0a-4a05-acd7-d0088025b001 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:22.503299 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5b552-1184-471f-84ee-84c5885c1fe4 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:22.541854 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b3d8f-a534-40f5-84c2-9214611b7e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:22.542477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b3d8f-a534-40f5-84c2-9214611b7e0a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:22.542754 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b3d8f-a534-40f5-84c2-9214611b7e0a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:22.543025 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b3d8f-a534-40f5-84c2-9214611b7e0a None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:22.543671 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b3d8f-a534-40f5-84c2-9214611b7e0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:22.543974 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b3d8f-a534-40f5-84c2-9214611b7e0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:22.545369 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b3d8f-a534-40f5-84c2-9214611b7e0a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:22.550269 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f637b-fb0a-4a05-acd7-d0088025b001 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:22.559043 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 202/402] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:22.559555 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b3d8f-a534-40f5-84c2-9214611b7e0a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:22.589601 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc36b11-e8a7-4bdc-8854-e08238968dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:22.590578 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc36b11-e8a7-4bdc-8854-e08238968dc0 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:22.590864 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc36b11-e8a7-4bdc-8854-e08238968dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:22.591170 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc36b11-e8a7-4bdc-8854-e08238968dc0 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:22.592523 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc36b11-e8a7-4bdc-8854-e08238968dc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:22.592523 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc36b11-e8a7-4bdc-8854-e08238968dc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:22.593440 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc36b11-e8a7-4bdc-8854-e08238968dc0 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:22.610362 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 201/403] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:22.610362 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc36b11-e8a7-4bdc-8854-e08238968dc0 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:22.617705 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:22.650916 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:22.675101 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b3d8f-a534-40f5-84c2-9214611b7e0a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:22.709964 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f681e-14e3-44e5-81ab-9457f0f70669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:22.710565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f681e-14e3-44e5-81ab-9457f0f70669 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:22.710844 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f681e-14e3-44e5-81ab-9457f0f70669 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:22.711106 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f681e-14e3-44e5-81ab-9457f0f70669 None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:22.711998 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f681e-14e3-44e5-81ab-9457f0f70669 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:22.712119 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f681e-14e3-44e5-81ab-9457f0f70669 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:22.713487 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f681e-14e3-44e5-81ab-9457f0f70669 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:22.714777 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc36b11-e8a7-4bdc-8854-e08238968dc0 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:22.736309 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 203/404] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Oct 27 13:12:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:22.737192 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f681e-14e3-44e5-81ab-9457f0f70669 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:22.754383 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf962e-b8c0-43d6-9803-3dc57b5e2880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:22.755097 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf962e-b8c0-43d6-9803-3dc57b5e2880 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:22.755442 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf962e-b8c0-43d6-9803-3dc57b5e2880 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:22.755790 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf962e-b8c0-43d6-9803-3dc57b5e2880 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:22.762835 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bf962e-b8c0-43d6-9803-3dc57b5e2880 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:22.764411 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bf962e-b8c0-43d6-9803-3dc57b5e2880 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:22.776135 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-04bf962e-b8c0-43d6-9803-3dc57b5e2880 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:12:22.776135 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:22.776135 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:22.776135 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:22.776135 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:22.776135 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:22.776135 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:22.776135 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:22.776135 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:22.776135 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:22.776135 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:22.776135 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:22.776135 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 13:12:22.776135 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 13:12:22.776135 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 13:12:22.777169 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 13:12:22.777169 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:22.777169 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:22.777169 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:22.777169 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:22.777169 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:22.777169 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:22.777169 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:22.777169 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:22.777169 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:22.777169 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:22.777169 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:22.777169 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:22.777169 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:22.777169 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:22.777169 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:22.777169 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:22.778410 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 13:12:22.778410 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 13:12:22.778410 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 13:12:22.778410 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 13:12:22.778410 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 13:12:22.778410 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 13:12:22.778410 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:12:22.778410 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:22.778930 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 202/405] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Oct 27 13:12:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:22.779755 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf962e-b8c0-43d6-9803-3dc57b5e2880 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:22.852753 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:22.852935 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f681e-14e3-44e5-81ab-9457f0f70669 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:22.890012 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6bd804-3dc0-4137-aaa5-a1246234d427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:22.890642 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6bd804-3dc0-4137-aaa5-a1246234d427 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:22.890912 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6bd804-3dc0-4137-aaa5-a1246234d427 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:22.891175 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6bd804-3dc0-4137-aaa5-a1246234d427 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:22.891375 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf962e-b8c0-43d6-9803-3dc57b5e2880 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:22.899452 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6bd804-3dc0-4137-aaa5-a1246234d427 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:22.901276 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6bd804-3dc0-4137-aaa5-a1246234d427 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:22.903450 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:22.914687 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-9b6bd804-3dc0-4137-aaa5-a1246234d427 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 27 13:12:22.914687 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:22.914687 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:22.914687 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:22.914687 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:22.914687 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:22.914687 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:22.914687 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:22.914687 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:22.914687 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:22.914687 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:22.914687 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:22.914687 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 13:12:22.914687 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 13:12:22.914687 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 13:12:22.914687 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 13:12:22.915615 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:22.915615 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:22.915615 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 13:12:22.915615 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:12:22.915615 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 13:12:22.915615 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:12:22.915615 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:22.915615 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:22.915615 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:22.915615 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:22.915615 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:22.915615 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:22.915615 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:22.915615 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:22.915615 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:22.915615 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:22.915615 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:22.915615 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:22.916508 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:22.916508 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:22.916508 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 13:12:22.916508 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 13:12:22.916508 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 13:12:22.916508 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 13:12:22.916508 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 13:12:22.916508 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 13:12:22.916508 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 27 13:12:22.916508 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:22.920436 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 204/406] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Oct 27 13:12:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:22.921102 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6bd804-3dc0-4137-aaa5-a1246234d427 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:22.929331 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2d172-66b3-4178-b7d7-ad7bb28a55fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:22.929996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2d172-66b3-4178-b7d7-ad7bb28a55fe None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:22.930274 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2d172-66b3-4178-b7d7-ad7bb28a55fe None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:22.930546 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2d172-66b3-4178-b7d7-ad7bb28a55fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:22.937708 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e2d172-66b3-4178-b7d7-ad7bb28a55fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:22.939159 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e2d172-66b3-4178-b7d7-ad7bb28a55fe None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:22.951805 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-19e2d172-66b3-4178-b7d7-ad7bb28a55fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:12:22.951805 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:22.951805 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:22.951805 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:22.951805 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:22.951805 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:22.951805 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:22.951805 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:22.951805 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:22.951805 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:22.951805 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:22.951805 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:22.951805 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 13:12:22.951805 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 13:12:22.951805 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 13:12:22.952846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 13:12:22.952846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:22.952846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:22.952846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:22.952846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:22.952846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:22.952846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:22.952846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:22.952846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:22.952846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:22.952846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:22.952846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:22.952846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:22.952846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:22.952846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:22.952846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:22.952846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:22.953872 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 13:12:22.953872 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 13:12:22.953872 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 13:12:22.953872 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 13:12:22.953872 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 13:12:22.953872 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 13:12:22.953872 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:12:22.953872 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:22.953872 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 203/407] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Oct 27 13:12:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:22.953872 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2d172-66b3-4178-b7d7-ad7bb28a55fe None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:23.033370 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6bd804-3dc0-4137-aaa5-a1246234d427 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:23.054722 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2d172-66b3-4178-b7d7-ad7bb28a55fe None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:23.071019 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a9800-4fad-44b4-a069-9a53d0165d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:23.071826 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a9800-4fad-44b4-a069-9a53d0165d41 None admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:23.072192 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a9800-4fad-44b4-a069-9a53d0165d41 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:23.072563 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a9800-4fad-44b4-a069-9a53d0165d41 None admin] PATH_INFO: `/v3/projects/0be19dd5a0df4cf79fe2ec14d11521f0/users/aa785d7f18b54de48a0ec78ec8642e17/roles/75936ae3accd49cb935acc7c628e2136` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:23.082651 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:23.088442 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a9800-4fad-44b4-a069-9a53d0165d41 None admin] RBAC: Authorizing `identity:create_grant(project_id=0be19dd5a0df4cf79fe2ec14d11521f0, user_id=aa785d7f18b54de48a0ec78ec8642e17, role_id=75936ae3accd49cb935acc7c628e2136)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:23.090056 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a9800-4fad-44b4-a069-9a53d0165d41 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:23.091551 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8eceaa-78a2-43ce-83a0-a681cdb181b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:23.092366 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8eceaa-78a2-43ce-83a0-a681cdb181b8 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:23.092730 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8eceaa-78a2-43ce-83a0-a681cdb181b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:23.093196 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8eceaa-78a2-43ce-83a0-a681cdb181b8 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:23.093981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8eceaa-78a2-43ce-83a0-a681cdb181b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:23.094404 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8eceaa-78a2-43ce-83a0-a681cdb181b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:23.095953 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8eceaa-78a2-43ce-83a0-a681cdb181b8 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:23.104562 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 205/408] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Oct 27 13:12:22 2022] PUT /identity/v3/projects/0be19dd5a0df4cf79fe2ec14d11521f0/users/aa785d7f18b54de48a0ec78ec8642e17/roles/75936ae3accd49cb935acc7c628e2136 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:12:23.105753 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a9800-4fad-44b4-a069-9a53d0165d41 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:23.123228 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 204/409] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Oct 27 13:12:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:23.124099 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8eceaa-78a2-43ce-83a0-a681cdb181b8 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:23.168689 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:23.236009 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a9800-4fad-44b4-a069-9a53d0165d41 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:23.255887 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8eceaa-78a2-43ce-83a0-a681cdb181b8 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:23.281614 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7558b-9adf-4baf-a42f-8ea6f35edc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:23.282718 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7558b-9adf-4baf-a42f-8ea6f35edc9a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:23.283931 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7558b-9adf-4baf-a42f-8ea6f35edc9a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:23.284466 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7558b-9adf-4baf-a42f-8ea6f35edc9a None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:23.285951 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c7558b-9adf-4baf-a42f-8ea6f35edc9a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:23.286475 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c7558b-9adf-4baf-a42f-8ea6f35edc9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:23.289288 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c7558b-9adf-4baf-a42f-8ea6f35edc9a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:23.299951 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69676dc5-c662-487e-8b15-aac9407b7581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:23.300715 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69676dc5-c662-487e-8b15-aac9407b7581 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:23.301053 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69676dc5-c662-487e-8b15-aac9407b7581 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:23.301388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69676dc5-c662-487e-8b15-aac9407b7581 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:23.302199 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69676dc5-c662-487e-8b15-aac9407b7581 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:23.302566 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69676dc5-c662-487e-8b15-aac9407b7581 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:23.304097 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69676dc5-c662-487e-8b15-aac9407b7581 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:23.318115 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 205/410] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Oct 27 13:12:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:23.324795 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69676dc5-c662-487e-8b15-aac9407b7581 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:23.340172 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 206/411] 10.222.0.52 () {56 vars in 1139 bytes} [Thu Oct 27 13:12:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:23.341799 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7558b-9adf-4baf-a42f-8ea6f35edc9a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:23.380740 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:23.438080 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69676dc5-c662-487e-8b15-aac9407b7581 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:23.477661 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e06ff-7ac4-4e0b-a72e-679dbdd8282d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:23.478315 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e06ff-7ac4-4e0b-a72e-679dbdd8282d None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:23.478589 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e06ff-7ac4-4e0b-a72e-679dbdd8282d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:23.478862 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e06ff-7ac4-4e0b-a72e-679dbdd8282d None admin] PATH_INFO: `/v3/projects/0be19dd5a0df4cf79fe2ec14d11521f0/users/719e4bf834d6490b96066e55a26fb159/roles/75936ae3accd49cb935acc7c628e2136` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:23.483677 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7558b-9adf-4baf-a42f-8ea6f35edc9a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:23.493443 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:23.495652 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e06ff-7ac4-4e0b-a72e-679dbdd8282d None admin] RBAC: Authorizing `identity:create_grant(project_id=0be19dd5a0df4cf79fe2ec14d11521f0, user_id=719e4bf834d6490b96066e55a26fb159, role_id=75936ae3accd49cb935acc7c628e2136)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:23.497565 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e06ff-7ac4-4e0b-a72e-679dbdd8282d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:23.516314 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 206/412] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Oct 27 13:12:23 2022] PUT /identity/v3/projects/0be19dd5a0df4cf79fe2ec14d11521f0/users/719e4bf834d6490b96066e55a26fb159/roles/75936ae3accd49cb935acc7c628e2136 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:12:23.517520 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e06ff-7ac4-4e0b-a72e-679dbdd8282d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:23.545138 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bad6bc-249a-441a-bba5-e95c121bb0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:23.545847 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bad6bc-249a-441a-bba5-e95c121bb0bb None admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:23.546160 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bad6bc-249a-441a-bba5-e95c121bb0bb None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:23.546455 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bad6bc-249a-441a-bba5-e95c121bb0bb None admin] PATH_INFO: `/v3/projects/0be19dd5a0df4cf79fe2ec14d11521f0/users/2298dbfcf7b74668902781401f77215e/roles/75936ae3accd49cb935acc7c628e2136` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:23.582585 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bad6bc-249a-441a-bba5-e95c121bb0bb None admin] RBAC: Authorizing `identity:create_grant(project_id=0be19dd5a0df4cf79fe2ec14d11521f0, user_id=2298dbfcf7b74668902781401f77215e, role_id=75936ae3accd49cb935acc7c628e2136)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:23.584146 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bad6bc-249a-441a-bba5-e95c121bb0bb None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:23.619204 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 207/413] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Oct 27 13:12:23 2022] PUT /identity/v3/projects/0be19dd5a0df4cf79fe2ec14d11521f0/users/2298dbfcf7b74668902781401f77215e/roles/75936ae3accd49cb935acc7c628e2136 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:12:23.635970 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:23.641313 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e06ff-7ac4-4e0b-a72e-679dbdd8282d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:23.687148 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75aab35-630b-4cdb-bfa0-1f61c7e5748e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:23.688169 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75aab35-630b-4cdb-bfa0-1f61c7e5748e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:23.688645 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75aab35-630b-4cdb-bfa0-1f61c7e5748e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:23.689140 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75aab35-630b-4cdb-bfa0-1f61c7e5748e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:23.707384 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75aab35-630b-4cdb-bfa0-1f61c7e5748e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:23.709278 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75aab35-630b-4cdb-bfa0-1f61c7e5748e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:23.731864 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-a75aab35-630b-4cdb-bfa0-1f61c7e5748e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:23.731864 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:23.731864 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:23.731864 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:23.731864 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:23.731864 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:23.731864 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:23.731864 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:23.731864 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:23.731864 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:23.731864 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:23.731864 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:23.731864 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:12:23.731864 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:12:23.731864 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:12:23.731864 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:12:23.732835 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:23.732835 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:23.732835 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:23.732835 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:23.732835 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:23.732835 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:23.732835 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:23.732835 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:23.732835 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:23.732835 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:23.732835 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:23.732835 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:23.732835 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:23.732835 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:23.732835 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:23.732835 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:23.732835 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:12:23.733739 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:12:23.733739 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:23.733739 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:23.736037 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 207/414] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:12:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:23.741379 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bad6bc-249a-441a-bba5-e95c121bb0bb None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:23.890791 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bad6bc-249a-441a-bba5-e95c121bb0bb None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:23.927000 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4f719-0623-441f-a622-55b7f6ce2750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:23.927604 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4f719-0623-441f-a622-55b7f6ce2750 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:23.927879 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4f719-0623-441f-a622-55b7f6ce2750 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:23.928147 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4f719-0623-441f-a622-55b7f6ce2750 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:23.928785 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c4f719-0623-441f-a622-55b7f6ce2750 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:23.929081 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c4f719-0623-441f-a622-55b7f6ce2750 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:23.930568 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c4f719-0623-441f-a622-55b7f6ce2750 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:23.944650 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 208/415] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:23.949890 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75aab35-630b-4cdb-bfa0-1f61c7e5748e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:24.102238 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75aab35-630b-4cdb-bfa0-1f61c7e5748e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:24.151009 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d952fa9-513e-4800-ae9f-1aff91c6c195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:24.151611 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d952fa9-513e-4800-ae9f-1aff91c6c195 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:24.151893 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d952fa9-513e-4800-ae9f-1aff91c6c195 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:24.152162 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d952fa9-513e-4800-ae9f-1aff91c6c195 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:24.164544 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d952fa9-513e-4800-ae9f-1aff91c6c195 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:24.166032 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d952fa9-513e-4800-ae9f-1aff91c6c195 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:24.180305 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-9d952fa9-513e-4800-ae9f-1aff91c6c195 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:12:24.180305 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:24.180305 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:24.180305 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:24.180305 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:24.180305 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:24.180305 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:24.180305 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:24.180305 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:24.180305 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:24.180305 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:24.180305 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:24.180305 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 13:12:24.180305 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 13:12:24.180305 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 13:12:24.181190 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 13:12:24.181190 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:24.181190 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:24.181190 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:24.181190 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:24.181190 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:24.181190 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:24.181190 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:24.181190 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:24.181190 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:24.181190 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:24.181190 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:24.181190 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:24.181190 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:24.181190 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:24.181190 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:24.181190 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:24.182079 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 13:12:24.182079 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 13:12:24.182079 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 13:12:24.182079 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 13:12:24.182079 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 13:12:24.182079 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 13:12:24.182079 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:12:24.182079 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:24.182079 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 208/416] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Oct 27 13:12:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:24.187605 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4f719-0623-441f-a622-55b7f6ce2750 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:24.225354 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:24.329754 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4f719-0623-441f-a622-55b7f6ce2750 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:24.364774 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33dd1ff-27d8-45fb-9f87-6b59569eff4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:24.365385 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33dd1ff-27d8-45fb-9f87-6b59569eff4d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:24.365695 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33dd1ff-27d8-45fb-9f87-6b59569eff4d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:24.365965 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33dd1ff-27d8-45fb-9f87-6b59569eff4d None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:24.366660 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33dd1ff-27d8-45fb-9f87-6b59569eff4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:24.366966 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33dd1ff-27d8-45fb-9f87-6b59569eff4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:24.368436 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33dd1ff-27d8-45fb-9f87-6b59569eff4d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:24.381354 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 209/417] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Oct 27 13:12:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:24.386972 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d952fa9-513e-4800-ae9f-1aff91c6c195 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:24.417285 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:24.537310 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d952fa9-513e-4800-ae9f-1aff91c6c195 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:24.583538 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c62af6-9070-437d-a756-c2d8f0934aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:24.584212 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c62af6-9070-437d-a756-c2d8f0934aba None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:24.584492 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c62af6-9070-437d-a756-c2d8f0934aba None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:24.584769 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c62af6-9070-437d-a756-c2d8f0934aba None admin] PATH_INFO: `/v3/projects/0be19dd5a0df4cf79fe2ec14d11521f0/users/d803f074332a4216aee8a38220faa10a/roles/75936ae3accd49cb935acc7c628e2136` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:24.607140 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c62af6-9070-437d-a756-c2d8f0934aba None admin] RBAC: Authorizing `identity:create_grant(project_id=0be19dd5a0df4cf79fe2ec14d11521f0, user_id=d803f074332a4216aee8a38220faa10a, role_id=75936ae3accd49cb935acc7c628e2136)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:24.608607 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c62af6-9070-437d-a756-c2d8f0934aba None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:24.615112 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fecf0-1cd4-420e-9654-4679aa1fe5d5 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:24.615555 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fecf0-1cd4-420e-9654-4679aa1fe5d5 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:24.615891 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fecf0-1cd4-420e-9654-4679aa1fe5d5 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:24.617588 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 210/418] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:24.630414 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 209/419] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Oct 27 13:12:24 2022] PUT /identity/v3/projects/0be19dd5a0df4cf79fe2ec14d11521f0/users/d803f074332a4216aee8a38220faa10a/roles/75936ae3accd49cb935acc7c628e2136 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:12:24.632699 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad22cfd-c225-45f8-abb8-0e085521d6ed None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:24.632986 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad22cfd-c225-45f8-abb8-0e085521d6ed None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:24.633260 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad22cfd-c225-45f8-abb8-0e085521d6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:24.670774 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-3ad22cfd-c225-45f8-abb8-0e085521d6ed None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:24.671923 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3ad22cfd-c225-45f8-abb8-0e085521d6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:24.783040 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 211/420] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 13:12:25.081114 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c62af6-9070-437d-a756-c2d8f0934aba None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:25.158549 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:25.205200 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c62af6-9070-437d-a756-c2d8f0934aba None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:25.239768 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e389e3-868c-4cc9-a233-eade785f099e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:25.240401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e389e3-868c-4cc9-a233-eade785f099e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:25.240677 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e389e3-868c-4cc9-a233-eade785f099e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:25.240948 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e389e3-868c-4cc9-a233-eade785f099e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:25.251434 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e389e3-868c-4cc9-a233-eade785f099e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:12:25.256332 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-e1e389e3-868c-4cc9-a233-eade785f099e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 13:12:25.256332 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:25.256332 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:25.256332 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:25.256332 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:25.256332 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:25.256332 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:25.256332 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:25.256332 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:25.256332 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:25.256332 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:25.256332 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:25.256332 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:12:25.256332 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:12:25.256332 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:12:25.256332 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:12:25.257242 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:12:25.257242 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:12:25.257242 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:12:25.257242 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:12:25.257242 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:25.257242 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:25.257242 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:25.257242 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:25.257242 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:25.257242 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:25.257242 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:25.257242 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:25.257242 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:25.257242 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:25.257242 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:25.257242 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:25.258088 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:25.258088 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:25.258088 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:25.258088 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:25.258088 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:12:25.258088 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:12:25.258088 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:12:25.258088 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:12:25.258088 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:12:25.258088 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:12:25.258088 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 13:12:25.258088 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:25.258088 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 210/421] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Oct 27 13:12:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:25.263705 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad22cfd-c225-45f8-abb8-0e085521d6ed None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:25.274153 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:25.383392 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad22cfd-c225-45f8-abb8-0e085521d6ed None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:25.419173 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dabbaa-6fbf-47a5-b2b1-ac85c1a07298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:25.419788 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dabbaa-6fbf-47a5-b2b1-ac85c1a07298 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:25.420067 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dabbaa-6fbf-47a5-b2b1-ac85c1a07298 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:25.420387 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dabbaa-6fbf-47a5-b2b1-ac85c1a07298 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:25.421059 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dabbaa-6fbf-47a5-b2b1-ac85c1a07298 None admin] RBAC: Adding query filter params (name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:25.421360 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dabbaa-6fbf-47a5-b2b1-ac85c1a07298 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:25.422773 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dabbaa-6fbf-47a5-b2b1-ac85c1a07298 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:25.431722 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 212/422] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Oct 27 13:12:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:25.437695 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e389e3-868c-4cc9-a233-eade785f099e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:25.553042 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e389e3-868c-4cc9-a233-eade785f099e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:25.580702 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:25.601391 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630dd828-f84f-437b-9b2d-4b96daa69af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:25.602142 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630dd828-f84f-437b-9b2d-4b96daa69af7 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:25.602423 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630dd828-f84f-437b-9b2d-4b96daa69af7 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:25.602698 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630dd828-f84f-437b-9b2d-4b96daa69af7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:25.615527 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630dd828-f84f-437b-9b2d-4b96daa69af7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:25.617003 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630dd828-f84f-437b-9b2d-4b96daa69af7 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:25.632467 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-630dd828-f84f-437b-9b2d-4b96daa69af7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:25.632467 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:25.632467 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:25.632467 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:25.632467 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:25.632467 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:25.632467 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:25.632467 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:25.632467 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:25.632467 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:25.632467 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:25.632467 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:25.632467 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:12:25.632467 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:12:25.632467 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:12:25.632467 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:12:25.634667 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:25.634667 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:25.634667 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:25.634667 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:25.634667 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:25.634667 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:25.634667 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:25.634667 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:25.634667 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:25.634667 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:25.634667 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:25.634667 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:25.634667 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:25.634667 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:25.634667 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:25.634667 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:25.634667 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:12:25.636755 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:12:25.636755 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:25.636755 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:25.636755 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 211/423] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:12:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:25.640045 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dabbaa-6fbf-47a5-b2b1-ac85c1a07298 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:25.713582 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:25.748804 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dabbaa-6fbf-47a5-b2b1-ac85c1a07298 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:25.783226 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e69b19-7608-4a25-9c97-d3a15d8105de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:25.786860 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e69b19-7608-4a25-9c97-d3a15d8105de None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:25.786860 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e69b19-7608-4a25-9c97-d3a15d8105de None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:25.786860 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e69b19-7608-4a25-9c97-d3a15d8105de None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:25.786860 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e69b19-7608-4a25-9c97-d3a15d8105de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:25.786860 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e69b19-7608-4a25-9c97-d3a15d8105de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:25.787630 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e69b19-7608-4a25-9c97-d3a15d8105de None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:25.800041 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 213/424] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:25.805912 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630dd828-f84f-437b-9b2d-4b96daa69af7 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:25.912230 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630dd828-f84f-437b-9b2d-4b96daa69af7 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:25.955310 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b416e-8414-4627-8461-445cefc92bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:25.956003 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b416e-8414-4627-8461-445cefc92bf7 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:25.956331 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b416e-8414-4627-8461-445cefc92bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:25.956677 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b416e-8414-4627-8461-445cefc92bf7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:25.969369 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b416e-8414-4627-8461-445cefc92bf7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:25.970909 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b416e-8414-4627-8461-445cefc92bf7 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:25.986656 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-303b416e-8414-4627-8461-445cefc92bf7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 27 13:12:25.986656 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:25.986656 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:25.986656 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:25.986656 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:25.986656 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:25.986656 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:25.986656 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:25.986656 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:25.986656 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:25.986656 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:25.986656 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:25.986656 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 13:12:25.986656 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 13:12:25.986656 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 13:12:25.986656 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 13:12:25.987594 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:25.987594 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:25.987594 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 13:12:25.987594 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:12:25.987594 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 13:12:25.987594 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:12:25.987594 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:25.987594 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:25.987594 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:25.987594 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:25.987594 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:25.987594 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:25.987594 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:25.987594 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:25.987594 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:25.987594 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:25.987594 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:25.987594 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:25.988516 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:25.988516 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:25.988516 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 13:12:25.988516 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 13:12:25.988516 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 13:12:25.988516 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 13:12:25.988516 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 13:12:25.988516 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 13:12:25.988516 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 27 13:12:25.988516 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:25.988516 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 212/425] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Oct 27 13:12:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:25.993854 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e69b19-7608-4a25-9c97-d3a15d8105de None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:26.053779 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301b6ff-3768-4aa2-a8dd-695f6be00b53 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:26.054094 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301b6ff-3768-4aa2-a8dd-695f6be00b53 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:26.054330 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301b6ff-3768-4aa2-a8dd-695f6be00b53 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:26.055949 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 213/426] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 13:12:26.061173 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607b560-b445-46ea-8886-b11133d77894 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:26.061449 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607b560-b445-46ea-8886-b11133d77894 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:26.061756 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607b560-b445-46ea-8886-b11133d77894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:26.082249 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-5607b560-b445-46ea-8886-b11133d77894 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:26.083800 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5607b560-b445-46ea-8886-b11133d77894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:26.114004 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:26.157643 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 214/427] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 13:12:26.197655 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e69b19-7608-4a25-9c97-d3a15d8105de None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:26.226124 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:26.234424 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68a98b-a91f-4224-83a1-6e11563fafca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:26.235038 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68a98b-a91f-4224-83a1-6e11563fafca None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:26.235314 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68a98b-a91f-4224-83a1-6e11563fafca None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:26.235585 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68a98b-a91f-4224-83a1-6e11563fafca None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:26.236321 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb68a98b-a91f-4224-83a1-6e11563fafca None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:26.236622 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb68a98b-a91f-4224-83a1-6e11563fafca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:26.238317 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb68a98b-a91f-4224-83a1-6e11563fafca None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:26.256429 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 214/428] 10.222.0.52 () {56 vars in 1135 bytes} [Thu Oct 27 13:12:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:26.262151 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607b560-b445-46ea-8886-b11133d77894 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:26.385764 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607b560-b445-46ea-8886-b11133d77894 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:26.418146 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9d332-7501-4f71-b321-cf3567b489bf None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:26.418651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9d332-7501-4f71-b321-cf3567b489bf None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:26.418888 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9d332-7501-4f71-b321-cf3567b489bf None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:26.420543 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 215/429] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:26.425503 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6721138-1281-454b-80ed-9c0404249bde None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:26.425825 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6721138-1281-454b-80ed-9c0404249bde None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:26.426101 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6721138-1281-454b-80ed-9c0404249bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:26.430813 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a594e72-938b-4a2d-a817-e1a154c6faea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:26.431455 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a594e72-938b-4a2d-a817-e1a154c6faea None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:26.431726 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a594e72-938b-4a2d-a817-e1a154c6faea None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:26.431991 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a594e72-938b-4a2d-a817-e1a154c6faea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:26.443433 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a594e72-938b-4a2d-a817-e1a154c6faea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:26.444892 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a594e72-938b-4a2d-a817-e1a154c6faea None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:26.459703 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-1a594e72-938b-4a2d-a817-e1a154c6faea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:26.459703 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:26.459703 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:26.459703 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:26.459703 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:26.459703 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:26.459703 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:26.459703 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:26.459703 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:26.459703 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:26.459703 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:26.459703 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:26.459703 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:12:26.459703 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:12:26.459703 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:12:26.459703 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:12:26.460582 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:26.460582 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:26.460582 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:26.460582 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:26.460582 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:26.460582 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:26.460582 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:26.460582 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:26.460582 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:26.460582 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:26.460582 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:26.460582 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:26.460582 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:26.460582 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:26.460582 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:26.460582 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:26.460582 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:12:26.461481 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:12:26.461481 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:26.461481 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:26.461481 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 215/430] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:12:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:26.464864 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-a6721138-1281-454b-80ed-9c0404249bde None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:26.469086 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a6721138-1281-454b-80ed-9c0404249bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:26.473735 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a594e72-938b-4a2d-a817-e1a154c6faea None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:26.489898 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:26.569226 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 216/431] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 13:12:26.570374 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6721138-1281-454b-80ed-9c0404249bde None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:26.583949 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a594e72-938b-4a2d-a817-e1a154c6faea None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:26.624115 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96475ff-508f-4eec-b594-3f55aa37069a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:26.624995 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96475ff-508f-4eec-b594-3f55aa37069a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:26.625439 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96475ff-508f-4eec-b594-3f55aa37069a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:26.625898 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96475ff-508f-4eec-b594-3f55aa37069a None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:26.626951 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96475ff-508f-4eec-b594-3f55aa37069a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:26.627823 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96475ff-508f-4eec-b594-3f55aa37069a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:26.629412 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96475ff-508f-4eec-b594-3f55aa37069a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:26.644833 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 216/432] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:12:26.647243 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511f129-e0b3-442f-adc7-cdafe6c22b2d None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:26.647698 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511f129-e0b3-442f-adc7-cdafe6c22b2d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:26.648399 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511f129-e0b3-442f-adc7-cdafe6c22b2d None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:26.650007 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 217/433] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:26.654930 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511f129-e0b3-442f-adc7-cdafe6c22b2d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:26.687846 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6721138-1281-454b-80ed-9c0404249bde None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:26.710732 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:26.733055 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b858b-3697-43ce-82b0-bbe8b2d682db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:26.734307 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b858b-3697-43ce-82b0-bbe8b2d682db None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:26.734653 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b858b-3697-43ce-82b0-bbe8b2d682db None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:26.734989 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b858b-3697-43ce-82b0-bbe8b2d682db None admin] PATH_INFO: `/v3/roles/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:26.742854 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:26.751838 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b858b-3697-43ce-82b0-bbe8b2d682db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:12:26.757193 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-130b858b-3697-43ce-82b0-bbe8b2d682db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 13:12:26.757193 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:26.757193 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:26.757193 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:26.757193 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:26.757193 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:26.757193 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:26.757193 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:26.757193 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:26.757193 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:26.757193 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:26.757193 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:26.757193 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:12:26.757193 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:12:26.757193 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:12:26.757193 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:12:26.758124 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:12:26.758124 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:12:26.758124 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:12:26.758124 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:12:26.758124 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:26.758124 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:26.758124 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:26.758124 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:26.758124 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:26.758124 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:26.758124 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:26.758124 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:26.758124 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:26.758124 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:26.758124 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:26.758124 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:26.758917 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:26.758917 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:26.758917 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:26.758917 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:26.758917 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:12:26.758917 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:12:26.758917 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:12:26.758917 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:12:26.758917 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:12:26.758917 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:12:26.758917 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 13:12:26.758917 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:26.766147 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 217/434] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Oct 27 13:12:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:26.767589 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9e015-9fd9-4be6-8c87-180a04da97e2 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:26.768119 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9e015-9fd9-4be6-8c87-180a04da97e2 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:26.768604 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9e015-9fd9-4be6-8c87-180a04da97e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:26.778658 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511f129-e0b3-442f-adc7-cdafe6c22b2d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:26.787595 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-d7a9e015-9fd9-4be6-8c87-180a04da97e2 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:26.789118 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d7a9e015-9fd9-4be6-8c87-180a04da97e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:26.823984 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7405c-13bc-4b06-a279-ea7e1dde2792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:26.824625 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7405c-13bc-4b06-a279-ea7e1dde2792 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:26.824896 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7405c-13bc-4b06-a279-ea7e1dde2792 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:26.825162 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7405c-13bc-4b06-a279-ea7e1dde2792 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:26.832963 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7405c-13bc-4b06-a279-ea7e1dde2792 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:26.834537 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7405c-13bc-4b06-a279-ea7e1dde2792 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:26.846613 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-d4c7405c-13bc-4b06-a279-ea7e1dde2792 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:12:26.846613 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:26.846613 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:26.846613 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:26.846613 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:26.846613 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:26.846613 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:26.846613 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:26.846613 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:26.846613 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:26.846613 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:26.846613 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:26.846613 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 13:12:26.846613 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 13:12:26.846613 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 13:12:26.847618 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 13:12:26.847618 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:26.847618 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:26.847618 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:26.847618 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:26.847618 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:26.847618 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:26.847618 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:26.847618 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:26.847618 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:26.847618 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:26.847618 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:26.847618 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:26.847618 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:26.847618 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:26.847618 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:26.847618 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:26.848463 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 13:12:26.848463 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 13:12:26.848463 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 13:12:26.848463 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 13:12:26.848463 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 13:12:26.848463 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 13:12:26.848463 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:12:26.848463 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:26.852707 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 218/435] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Oct 27 13:12:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:26.853600 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7405c-13bc-4b06-a279-ea7e1dde2792 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:26.877557 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 218/436] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:12:26.877557 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9e015-9fd9-4be6-8c87-180a04da97e2 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:26.978787 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7405c-13bc-4b06-a279-ea7e1dde2792 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:26.997787 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9e015-9fd9-4be6-8c87-180a04da97e2 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:27.006172 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:27.013295 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b266b-574f-43cd-816d-3177c4f46fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:27.013988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b266b-574f-43cd-816d-3177c4f46fd6 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:27.014271 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b266b-574f-43cd-816d-3177c4f46fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:27.014545 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b266b-574f-43cd-816d-3177c4f46fd6 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:27.015265 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350b266b-574f-43cd-816d-3177c4f46fd6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:27.015643 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350b266b-574f-43cd-816d-3177c4f46fd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:27.016985 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350b266b-574f-43cd-816d-3177c4f46fd6 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:27.018538 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:27.031571 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 219/437] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Oct 27 13:12:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:27.032455 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b266b-574f-43cd-816d-3177c4f46fd6 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:27.037521 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db0226-c870-4561-8c2d-4c807d647a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:27.038333 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db0226-c870-4561-8c2d-4c807d647a6a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:27.038762 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db0226-c870-4561-8c2d-4c807d647a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:27.039181 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db0226-c870-4561-8c2d-4c807d647a6a None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:27.040010 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28db0226-c870-4561-8c2d-4c807d647a6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:27.040444 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28db0226-c870-4561-8c2d-4c807d647a6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:27.042159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28db0226-c870-4561-8c2d-4c807d647a6a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:27.055585 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 219/438] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Oct 27 13:12:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:27.056669 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db0226-c870-4561-8c2d-4c807d647a6a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:27.138692 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b266b-574f-43cd-816d-3177c4f46fd6 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:27.160805 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db0226-c870-4561-8c2d-4c807d647a6a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:27.173839 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc6051-f0c8-4d6a-8bf1-a713ab85ba53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:27.174472 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc6051-f0c8-4d6a-8bf1-a713ab85ba53 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:27.174749 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc6051-f0c8-4d6a-8bf1-a713ab85ba53 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:27.175018 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc6051-f0c8-4d6a-8bf1-a713ab85ba53 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:27.185671 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc6051-f0c8-4d6a-8bf1-a713ab85ba53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:12:27.190638 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-b0bc6051-f0c8-4d6a-8bf1-a713ab85ba53 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 13:12:27.190638 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:27.190638 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:27.190638 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:27.190638 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:27.190638 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:27.190638 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:27.190638 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:27.190638 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:27.190638 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:27.190638 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:27.190638 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:27.190638 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:12:27.190638 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:12:27.190638 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:12:27.190638 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:12:27.191751 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:12:27.191751 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:12:27.191751 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:12:27.191751 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:12:27.191751 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:27.191751 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:27.191751 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:27.191751 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:27.191751 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:27.191751 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:27.191751 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:27.191751 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:27.191751 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:27.191751 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:27.191751 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:27.191751 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:27.194318 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:27.194318 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:27.194318 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:27.194318 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:27.194318 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:12:27.194318 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:12:27.194318 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:12:27.194318 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:12:27.194318 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:12:27.194318 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:12:27.194318 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 13:12:27.194318 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:27.194318 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 220/439] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Oct 27 13:12:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:27.194318 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc6051-f0c8-4d6a-8bf1-a713ab85ba53 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:27.203411 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1094f-986d-4047-ba7b-9fbe68c22bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:27.204065 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1094f-986d-4047-ba7b-9fbe68c22bb1 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:27.204406 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1094f-986d-4047-ba7b-9fbe68c22bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:27.204677 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1094f-986d-4047-ba7b-9fbe68c22bb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:27.217614 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b1094f-986d-4047-ba7b-9fbe68c22bb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:27.219169 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b1094f-986d-4047-ba7b-9fbe68c22bb1 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:27.235497 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-b4b1094f-986d-4047-ba7b-9fbe68c22bb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:27.235497 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:27.235497 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:27.235497 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:27.235497 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:27.235497 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:27.235497 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:27.235497 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:27.235497 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:27.235497 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:27.235497 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:27.235497 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:27.235497 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:12:27.235497 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:12:27.235497 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:12:27.235497 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:12:27.236440 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:27.236440 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:27.236440 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:27.236440 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:27.236440 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:27.236440 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:27.236440 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:27.236440 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:27.236440 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:27.236440 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:27.236440 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:27.236440 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:27.236440 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:27.236440 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:27.236440 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:27.236440 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:27.236440 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:12:27.237285 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:12:27.237285 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:27.237285 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:27.241745 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 220/440] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:12:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:27.242520 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1094f-986d-4047-ba7b-9fbe68c22bb1 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:27.258847 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:27.263976 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:27.305502 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc6051-f0c8-4d6a-8bf1-a713ab85ba53 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:27.341404 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b5fa9-2986-4630-8f5f-0a4258fc2803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:27.342089 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b5fa9-2986-4630-8f5f-0a4258fc2803 None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:27.342366 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b5fa9-2986-4630-8f5f-0a4258fc2803 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:27.342636 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b5fa9-2986-4630-8f5f-0a4258fc2803 None admin] PATH_INFO: `/v3/projects/0be19dd5a0df4cf79fe2ec14d11521f0/users/62769acbfca242d6a0b0fe5a6b8bc108/roles/75936ae3accd49cb935acc7c628e2136` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:27.349841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1094f-986d-4047-ba7b-9fbe68c22bb1 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:27.358639 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b5fa9-2986-4630-8f5f-0a4258fc2803 None admin] RBAC: Authorizing `identity:create_grant(project_id=0be19dd5a0df4cf79fe2ec14d11521f0, user_id=62769acbfca242d6a0b0fe5a6b8bc108, role_id=75936ae3accd49cb935acc7c628e2136)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:27.360083 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b5fa9-2986-4630-8f5f-0a4258fc2803 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:27.372823 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 221/441] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Oct 27 13:12:27 2022] PUT /identity/v3/projects/0be19dd5a0df4cf79fe2ec14d11521f0/users/62769acbfca242d6a0b0fe5a6b8bc108/roles/75936ae3accd49cb935acc7c628e2136 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:12:27.373634 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b5fa9-2986-4630-8f5f-0a4258fc2803 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:27.394280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c9107-69b2-4d6b-8f8c-a8a29c60afc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:27.394988 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c9107-69b2-4d6b-8f8c-a8a29c60afc7 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:27.395257 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c9107-69b2-4d6b-8f8c-a8a29c60afc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:27.395528 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c9107-69b2-4d6b-8f8c-a8a29c60afc7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:27.408595 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c9107-69b2-4d6b-8f8c-a8a29c60afc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:12:27.414301 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-c82c9107-69b2-4d6b-8f8c-a8a29c60afc7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 13:12:27.414301 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:27.414301 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:27.414301 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:27.414301 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:27.414301 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:27.414301 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:27.414301 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:27.414301 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:27.414301 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:27.414301 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:27.414301 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:27.414301 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:12:27.414301 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:12:27.414301 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:12:27.414301 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:12:27.415278 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:12:27.415278 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:12:27.415278 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:12:27.415278 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:12:27.415278 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:27.415278 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:27.415278 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:27.415278 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:27.415278 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:27.415278 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:27.415278 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:27.415278 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:27.415278 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:27.415278 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:27.415278 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:27.415278 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:27.416280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:27.416280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:27.416280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:27.416280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:27.416280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:12:27.416280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:12:27.416280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:12:27.416280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:12:27.416280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:12:27.416280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:12:27.416280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 13:12:27.416280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:27.416280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 221/442] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Oct 27 13:12:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:27.416280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c9107-69b2-4d6b-8f8c-a8a29c60afc7 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:27.498154 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b5fa9-2986-4630-8f5f-0a4258fc2803 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:27.506303 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:27.514231 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:27.538828 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956277ca-24a5-46e7-91cf-eaf2eb58727b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:27.539723 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956277ca-24a5-46e7-91cf-eaf2eb58727b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:27.539996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956277ca-24a5-46e7-91cf-eaf2eb58727b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:27.540263 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956277ca-24a5-46e7-91cf-eaf2eb58727b None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:27.540927 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956277ca-24a5-46e7-91cf-eaf2eb58727b None admin] RBAC: Adding query filter params (name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:27.541227 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c9107-69b2-4d6b-8f8c-a8a29c60afc7 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:27.541328 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956277ca-24a5-46e7-91cf-eaf2eb58727b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:27.542661 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956277ca-24a5-46e7-91cf-eaf2eb58727b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:27.551824 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 222/443] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Oct 27 13:12:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:27.553085 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383927bd-8569-48ac-bccd-dd789a5052aa None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:27.553356 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383927bd-8569-48ac-bccd-dd789a5052aa None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:27.554277 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383927bd-8569-48ac-bccd-dd789a5052aa None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:27.554846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 223/444] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:27.555529 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383927bd-8569-48ac-bccd-dd789a5052aa None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:27.581772 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7f185-b24a-4557-abda-c9880fc4a7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:27.582615 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7f185-b24a-4557-abda-c9880fc4a7ad None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:27.583029 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7f185-b24a-4557-abda-c9880fc4a7ad None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:27.583341 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7f185-b24a-4557-abda-c9880fc4a7ad None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:27.584066 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e7f185-b24a-4557-abda-c9880fc4a7ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:27.584459 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e7f185-b24a-4557-abda-c9880fc4a7ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:27.585976 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e7f185-b24a-4557-abda-c9880fc4a7ad None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:27.598971 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 222/445] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:27.599921 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7f185-b24a-4557-abda-c9880fc4a7ad None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:27.676859 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383927bd-8569-48ac-bccd-dd789a5052aa None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:27.708977 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7f185-b24a-4557-abda-c9880fc4a7ad None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:27.712904 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c5db2d-5248-4295-a75b-2342784734d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:27.713613 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5db2d-5248-4295-a75b-2342784734d4 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:27.713956 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5db2d-5248-4295-a75b-2342784734d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:27.714298 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5db2d-5248-4295-a75b-2342784734d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:27.715025 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c5db2d-5248-4295-a75b-2342784734d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:27.715394 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c5db2d-5248-4295-a75b-2342784734d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:27.716833 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c5db2d-5248-4295-a75b-2342784734d4 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:27.726063 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 224/446] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Oct 27 13:12:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:27.727069 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1209c-52b1-4fa8-936c-2703a0aedb63 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:27.727350 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1209c-52b1-4fa8-936c-2703a0aedb63 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:27.727620 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1209c-52b1-4fa8-936c-2703a0aedb63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:27.746057 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-17e1209c-52b1-4fa8-936c-2703a0aedb63 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:27.747235 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-17e1209c-52b1-4fa8-936c-2703a0aedb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:27.751485 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37ed8e-76e3-4c39-8ca2-510b53366184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:27.752065 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37ed8e-76e3-4c39-8ca2-510b53366184 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:27.752343 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37ed8e-76e3-4c39-8ca2-510b53366184 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:27.752624 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37ed8e-76e3-4c39-8ca2-510b53366184 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:27.760526 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:27.764663 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c37ed8e-76e3-4c39-8ca2-510b53366184 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:27.766348 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c37ed8e-76e3-4c39-8ca2-510b53366184 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:27.773348 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:27.782562 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-4c37ed8e-76e3-4c39-8ca2-510b53366184 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:27.782562 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:27.782562 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:27.782562 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:27.782562 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:27.782562 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:27.782562 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:27.782562 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:27.782562 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:27.782562 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:27.782562 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:27.782562 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:27.782562 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:12:27.782562 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:12:27.782562 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:12:27.782562 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:12:27.783727 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:27.783727 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:27.783727 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:27.783727 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:27.783727 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:27.783727 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:27.783727 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:27.783727 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:27.783727 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:27.783727 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:27.783727 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:27.783727 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:27.783727 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:27.783727 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:27.783727 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:27.783727 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:27.783727 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:12:27.784912 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:12:27.784912 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:27.784912 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:27.787920 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 223/447] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:12:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:27.787920 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37ed8e-76e3-4c39-8ca2-510b53366184 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:27.835283 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 225/448] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:12:27.836853 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1209c-52b1-4fa8-936c-2703a0aedb63 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:27.901871 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37ed8e-76e3-4c39-8ca2-510b53366184 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:27.936853 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d5ab7-e573-4c87-8985-0dd9b62ce10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:27.937567 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d5ab7-e573-4c87-8985-0dd9b62ce10a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:27.937797 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d5ab7-e573-4c87-8985-0dd9b62ce10a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:27.938078 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d5ab7-e573-4c87-8985-0dd9b62ce10a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:27.946131 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d5ab7-e573-4c87-8985-0dd9b62ce10a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:27.947602 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d5ab7-e573-4c87-8985-0dd9b62ce10a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:27.959422 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-f65d5ab7-e573-4c87-8985-0dd9b62ce10a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 27 13:12:27.959422 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:27.959422 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:27.959422 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:27.959422 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:27.959422 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:27.959422 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:27.959422 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:27.959422 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:27.959422 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:27.959422 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:27.959422 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:27.959422 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 13:12:27.959422 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 13:12:27.959422 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 13:12:27.959422 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 13:12:27.960526 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:27.960526 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:27.960526 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 13:12:27.960526 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:12:27.960526 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 13:12:27.960526 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:12:27.960526 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:27.960526 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:27.960526 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:27.960526 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:27.960526 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:27.960526 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:27.960526 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:27.960526 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:27.960526 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:27.960526 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:27.960526 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:27.960526 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:27.961664 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:27.961664 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:27.961664 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 13:12:27.961664 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 13:12:27.961664 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 13:12:27.961664 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 13:12:27.961664 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 13:12:27.961664 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 13:12:27.961664 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 27 13:12:27.961664 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:27.965454 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 224/449] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Oct 27 13:12:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:27.966306 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d5ab7-e573-4c87-8985-0dd9b62ce10a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:27.979851 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1209c-52b1-4fa8-936c-2703a0aedb63 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:28.018476 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:28.028499 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac4cea-7a77-4001-8357-cccad54106b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:28.029786 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac4cea-7a77-4001-8357-cccad54106b5 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:28.030442 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac4cea-7a77-4001-8357-cccad54106b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:28.030885 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac4cea-7a77-4001-8357-cccad54106b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:28.045030 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac4cea-7a77-4001-8357-cccad54106b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:28.047257 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac4cea-7a77-4001-8357-cccad54106b5 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:28.066301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-afac4cea-7a77-4001-8357-cccad54106b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:28.066301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:28.066301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:28.066301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:28.066301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:28.066301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:28.066301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:28.066301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:28.066301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:28.066301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:28.066301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:28.066301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:28.066301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:12:28.066301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:12:28.066301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:12:28.066301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:12:28.067564 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:28.067564 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:28.067564 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:28.067564 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:28.067564 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:28.067564 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:28.067564 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:28.067564 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:28.067564 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:28.067564 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:28.067564 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:28.067564 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:28.067564 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:28.067564 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:28.067564 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:28.067564 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:28.067564 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:12:28.068531 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:12:28.068531 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:28.068531 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:28.068531 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 226/450] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:12:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:28.068531 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac4cea-7a77-4001-8357-cccad54106b5 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:28.083265 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:28.086679 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d5ab7-e573-4c87-8985-0dd9b62ce10a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:28.125295 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0fa64-9a88-43ee-81b1-623d0253231e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:28.125939 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0fa64-9a88-43ee-81b1-623d0253231e None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:28.126225 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0fa64-9a88-43ee-81b1-623d0253231e None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:28.126499 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0fa64-9a88-43ee-81b1-623d0253231e None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:28.127143 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e0fa64-9a88-43ee-81b1-623d0253231e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:28.127445 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e0fa64-9a88-43ee-81b1-623d0253231e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:28.128894 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e0fa64-9a88-43ee-81b1-623d0253231e None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:28.141726 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 225/451] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:28.141726 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0fa64-9a88-43ee-81b1-623d0253231e None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:28.174103 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac4cea-7a77-4001-8357-cccad54106b5 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:28.210008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12b8a2-dc5d-4931-b6cb-1911d1dbb7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:28.210613 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12b8a2-dc5d-4931-b6cb-1911d1dbb7cb None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:28.210894 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12b8a2-dc5d-4931-b6cb-1911d1dbb7cb None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:28.211162 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12b8a2-dc5d-4931-b6cb-1911d1dbb7cb None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:28.211882 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e12b8a2-dc5d-4931-b6cb-1911d1dbb7cb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:28.212237 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e12b8a2-dc5d-4931-b6cb-1911d1dbb7cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:28.213645 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e12b8a2-dc5d-4931-b6cb-1911d1dbb7cb None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:28.232834 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 227/452] 10.222.0.52 () {56 vars in 1137 bytes} [Thu Oct 27 13:12:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:28.233450 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12b8a2-dc5d-4931-b6cb-1911d1dbb7cb None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:28.252455 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0fa64-9a88-43ee-81b1-623d0253231e None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:28.264684 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:28.291533 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23aeca8-315f-49ac-bfb8-4329510b46b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:28.292050 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23aeca8-315f-49ac-bfb8-4329510b46b1 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:28.292328 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23aeca8-315f-49ac-bfb8-4329510b46b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:28.292599 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23aeca8-315f-49ac-bfb8-4329510b46b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:28.293248 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23aeca8-315f-49ac-bfb8-4329510b46b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:28.293573 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23aeca8-315f-49ac-bfb8-4329510b46b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:28.294971 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23aeca8-315f-49ac-bfb8-4329510b46b1 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:28.306760 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 226/453] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:28.311491 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23aeca8-315f-49ac-bfb8-4329510b46b1 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:28.314183 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:28.346838 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12b8a2-dc5d-4931-b6cb-1911d1dbb7cb None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:28.383603 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da355f-1af5-43a8-9a5e-67e66c206c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:28.384227 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da355f-1af5-43a8-9a5e-67e66c206c87 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:28.384498 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da355f-1af5-43a8-9a5e-67e66c206c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:28.385167 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da355f-1af5-43a8-9a5e-67e66c206c87 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:28.396162 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da355f-1af5-43a8-9a5e-67e66c206c87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:12:28.400981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-e2da355f-1af5-43a8-9a5e-67e66c206c87 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 13:12:28.400981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:28.400981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:28.400981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:28.400981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:28.400981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:28.400981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:28.400981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:28.400981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:28.400981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:28.400981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:28.400981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:28.400981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:12:28.400981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:12:28.400981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:12:28.400981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:12:28.402086 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:12:28.402086 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:12:28.402086 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:12:28.402086 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:12:28.402086 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:28.402086 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:28.402086 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:28.402086 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:28.402086 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:28.402086 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:28.402086 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:28.402086 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:28.402086 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:28.402086 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:28.402086 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:28.402086 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:28.402887 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:28.402887 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:28.402887 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:28.402887 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:28.402887 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:12:28.402887 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:12:28.402887 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:12:28.402887 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:12:28.402887 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:12:28.402887 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:12:28.402887 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 13:12:28.402887 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:28.402887 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 228/454] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Oct 27 13:12:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:28.402887 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da355f-1af5-43a8-9a5e-67e66c206c87 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:28.416617 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23aeca8-315f-49ac-bfb8-4329510b46b1 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:28.451245 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22092dc2-b4a1-44bf-8a85-aab6ba938bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:28.451869 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22092dc2-b4a1-44bf-8a85-aab6ba938bd8 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:28.452149 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22092dc2-b4a1-44bf-8a85-aab6ba938bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:28.452423 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22092dc2-b4a1-44bf-8a85-aab6ba938bd8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:28.460112 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22092dc2-b4a1-44bf-8a85-aab6ba938bd8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:28.461659 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22092dc2-b4a1-44bf-8a85-aab6ba938bd8 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:28.473625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-22092dc2-b4a1-44bf-8a85-aab6ba938bd8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 13:12:28.473625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:28.473625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:28.473625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:28.473625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:28.473625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:28.473625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:28.473625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:28.473625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:28.473625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:28.473625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:28.473625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:28.473625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 13:12:28.473625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 13:12:28.473625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 13:12:28.473625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 13:12:28.474565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:28.474565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:28.474565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 13:12:28.474565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:12:28.474565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 13:12:28.474565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:12:28.474565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:28.474565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:28.474565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:28.474565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:28.474565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:28.474565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:28.474565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:28.474565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:28.474565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:28.474565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:28.474565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:28.474565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:28.475445 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:28.475445 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:28.475445 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 13:12:28.475445 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 13:12:28.475445 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 13:12:28.475445 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 13:12:28.475445 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 13:12:28.475445 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 13:12:28.475445 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 27 13:12:28.475445 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:28.475445 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 227/455] 10.222.0.52 () {56 vars in 1093 bytes} [Thu Oct 27 13:12:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:28.476009 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22092dc2-b4a1-44bf-8a85-aab6ba938bd8 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:28.508157 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:28.517470 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da355f-1af5-43a8-9a5e-67e66c206c87 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:28.549554 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:28.557223 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24513dc-3104-4003-8ecb-35629cbb5aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:28.558191 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24513dc-3104-4003-8ecb-35629cbb5aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:28.558473 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24513dc-3104-4003-8ecb-35629cbb5aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:28.558744 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24513dc-3104-4003-8ecb-35629cbb5aa5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:28.587533 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22092dc2-b4a1-44bf-8a85-aab6ba938bd8 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:28.623386 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c7a5a-909a-47dd-8468-6123056e7ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:28.624124 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c7a5a-909a-47dd-8468-6123056e7ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:28.624404 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c7a5a-909a-47dd-8468-6123056e7ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:28.624673 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c7a5a-909a-47dd-8468-6123056e7ed7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:28.630600 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24513dc-3104-4003-8ecb-35629cbb5aa5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:28.632093 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24513dc-3104-4003-8ecb-35629cbb5aa5 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:28.632727 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c7a5a-909a-47dd-8468-6123056e7ed7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:28.634204 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c7a5a-909a-47dd-8468-6123056e7ed7 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:28.646665 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-220c7a5a-909a-47dd-8468-6123056e7ed7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 27 13:12:28.646665 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:28.646665 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:28.646665 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:28.646665 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:28.646665 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:28.646665 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:28.646665 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:28.646665 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:28.646665 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:28.646665 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:28.646665 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:28.646665 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 13:12:28.646665 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 13:12:28.646665 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 13:12:28.646665 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 13:12:28.647593 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:28.647593 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:28.647593 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 13:12:28.647593 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:12:28.647593 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 13:12:28.647593 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:12:28.647593 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:28.647593 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:28.647593 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:28.647593 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:28.647593 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:28.647593 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:28.647593 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:28.647593 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:28.647593 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:28.647593 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:28.647593 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:28.647593 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:28.648473 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:28.648473 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:28.648473 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 13:12:28.648473 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 13:12:28.648473 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 13:12:28.648473 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 13:12:28.648473 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 13:12:28.648473 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 13:12:28.648473 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 27 13:12:28.648473 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:28.648473 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 228/456] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Oct 27 13:12:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:28.649047 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c7a5a-909a-47dd-8468-6123056e7ed7 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:28.740347 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:28.743362 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 229/457] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Oct 27 13:12:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 13:12:28.743362 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24513dc-3104-4003-8ecb-35629cbb5aa5 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:28.755740 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c7a5a-909a-47dd-8468-6123056e7ed7 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:28.776792 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:28.790596 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ee8d5-e27a-408c-822e-79d857945c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:28.791780 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ee8d5-e27a-408c-822e-79d857945c1e None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:28.792493 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ee8d5-e27a-408c-822e-79d857945c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:28.792917 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ee8d5-e27a-408c-822e-79d857945c1e None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:28.794019 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ee8d5-e27a-408c-822e-79d857945c1e None admin] RBAC: Adding query filter params (name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:28.794468 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ee8d5-e27a-408c-822e-79d857945c1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:28.796788 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ee8d5-e27a-408c-822e-79d857945c1e None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:28.809340 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 229/458] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Oct 27 13:12:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:28.810680 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ee8d5-e27a-408c-822e-79d857945c1e None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:28.849866 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24513dc-3104-4003-8ecb-35629cbb5aa5 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:28.884655 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f5000-6c83-4ebe-a183-4cd6e7fc8c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:28.885364 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f5000-6c83-4ebe-a183-4cd6e7fc8c4d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:28.885721 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f5000-6c83-4ebe-a183-4cd6e7fc8c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:28.885994 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f5000-6c83-4ebe-a183-4cd6e7fc8c4d None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:28.886858 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302f5000-6c83-4ebe-a183-4cd6e7fc8c4d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:28.887162 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302f5000-6c83-4ebe-a183-4cd6e7fc8c4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:28.888598 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302f5000-6c83-4ebe-a183-4cd6e7fc8c4d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:28.909426 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 230/459] 10.222.0.52 () {56 vars in 1133 bytes} [Thu Oct 27 13:12:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:28.910640 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f5000-6c83-4ebe-a183-4cd6e7fc8c4d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:28.920752 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ee8d5-e27a-408c-822e-79d857945c1e None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:28.958183 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843dcf59-6a50-4950-88f3-9d30ad570cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:28.958962 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843dcf59-6a50-4950-88f3-9d30ad570cd7 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:28.959077 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843dcf59-6a50-4950-88f3-9d30ad570cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:28.959369 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843dcf59-6a50-4950-88f3-9d30ad570cd7 None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:28.960095 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843dcf59-6a50-4950-88f3-9d30ad570cd7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:28.960443 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843dcf59-6a50-4950-88f3-9d30ad570cd7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:28.961910 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843dcf59-6a50-4950-88f3-9d30ad570cd7 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:28.985434 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 230/460] 10.222.0.52 () {56 vars in 1137 bytes} [Thu Oct 27 13:12:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:28.985434 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843dcf59-6a50-4950-88f3-9d30ad570cd7 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:28.999145 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:29.009088 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:29.021982 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f5000-6c83-4ebe-a183-4cd6e7fc8c4d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:29.059132 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a31768-9b0c-4da8-b125-a492241fd628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:29.059691 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a31768-9b0c-4da8-b125-a492241fd628 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:29.059969 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a31768-9b0c-4da8-b125-a492241fd628 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:29.060430 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a31768-9b0c-4da8-b125-a492241fd628 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:29.071322 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a31768-9b0c-4da8-b125-a492241fd628 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:29.072797 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a31768-9b0c-4da8-b125-a492241fd628 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:29.087968 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-94a31768-9b0c-4da8-b125-a492241fd628 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:29.087968 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:29.087968 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:29.087968 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:29.087968 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:29.087968 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:29.087968 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:29.087968 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:29.087968 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:29.087968 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:29.087968 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:29.087968 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:29.087968 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:12:29.087968 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:12:29.087968 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:12:29.087968 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:12:29.088873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:29.088873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:29.088873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:29.088873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:29.088873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:29.088873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:29.088873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:29.088873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:29.088873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:29.088873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:29.088873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:29.088873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:29.088873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:29.088873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:29.088873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:29.088873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:29.088873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:12:29.089721 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:12:29.089721 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:29.089721 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:29.089721 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 231/461] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:12:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:29.094402 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a31768-9b0c-4da8-b125-a492241fd628 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:29.098735 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843dcf59-6a50-4950-88f3-9d30ad570cd7 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:29.135122 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433fc5c-b19e-49a9-88ca-c5e522e7851a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:29.135789 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433fc5c-b19e-49a9-88ca-c5e522e7851a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:29.136031 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433fc5c-b19e-49a9-88ca-c5e522e7851a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:29.136326 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433fc5c-b19e-49a9-88ca-c5e522e7851a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:29.147348 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3433fc5c-b19e-49a9-88ca-c5e522e7851a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:29.149217 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3433fc5c-b19e-49a9-88ca-c5e522e7851a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:29.164286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-3433fc5c-b19e-49a9-88ca-c5e522e7851a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:29.164286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:29.164286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:29.164286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:29.164286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:29.164286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:29.164286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:29.164286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:29.164286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:29.164286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:29.164286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:29.164286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:29.164286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:12:29.164286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:12:29.164286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:12:29.164286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:12:29.165264 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:29.165264 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:29.165264 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:29.165264 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:29.165264 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:29.165264 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:29.165264 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:29.165264 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:29.165264 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:29.165264 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:29.165264 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:29.165264 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:29.165264 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:29.165264 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:29.165264 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:29.165264 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:29.165264 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:12:29.166458 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:12:29.166458 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:29.166458 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:29.170050 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 231/462] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:12:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:29.170954 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433fc5c-b19e-49a9-88ca-c5e522e7851a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:29.200333 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a31768-9b0c-4da8-b125-a492241fd628 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:29.235375 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:29.237601 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d4033-10f1-4895-b20c-7c395b543995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:29.238237 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d4033-10f1-4895-b20c-7c395b543995 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:29.238504 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d4033-10f1-4895-b20c-7c395b543995 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:29.238772 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d4033-10f1-4895-b20c-7c395b543995 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:29.249460 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:29.279588 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433fc5c-b19e-49a9-88ca-c5e522e7851a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:29.310807 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d4033-10f1-4895-b20c-7c395b543995 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:29.312188 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d4033-10f1-4895-b20c-7c395b543995 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:29.317132 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124ce9a-b234-4fe7-b1a8-1076edc36d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:29.318010 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124ce9a-b234-4fe7-b1a8-1076edc36d67 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:29.318467 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124ce9a-b234-4fe7-b1a8-1076edc36d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:29.318911 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124ce9a-b234-4fe7-b1a8-1076edc36d67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:29.394532 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7124ce9a-b234-4fe7-b1a8-1076edc36d67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:29.396225 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7124ce9a-b234-4fe7-b1a8-1076edc36d67 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:29.412556 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 232/463] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Oct 27 13:12:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 13:12:29.413440 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d4033-10f1-4895-b20c-7c395b543995 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:29.457913 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:29.470061 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:29.518530 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 232/464] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Oct 27 13:12:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 13:12:29.518530 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124ce9a-b234-4fe7-b1a8-1076edc36d67 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:29.524417 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d4033-10f1-4895-b20c-7c395b543995 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:29.558595 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c97317-6c3f-4863-b3ec-86fa3d4efd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:29.559196 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c97317-6c3f-4863-b3ec-86fa3d4efd28 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:29.559470 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c97317-6c3f-4863-b3ec-86fa3d4efd28 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:29.559737 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c97317-6c3f-4863-b3ec-86fa3d4efd28 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:29.560369 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c97317-6c3f-4863-b3ec-86fa3d4efd28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:29.560666 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c97317-6c3f-4863-b3ec-86fa3d4efd28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:29.562119 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c97317-6c3f-4863-b3ec-86fa3d4efd28 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:29.573444 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 233/465] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:29.574254 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c97317-6c3f-4863-b3ec-86fa3d4efd28 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:29.616166 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124ce9a-b234-4fe7-b1a8-1076edc36d67 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:29.649000 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c1f16-bee8-4fc7-a68f-356a1b4d6730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:29.649623 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c1f16-bee8-4fc7-a68f-356a1b4d6730 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:29.649914 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c1f16-bee8-4fc7-a68f-356a1b4d6730 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:29.650161 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c1f16-bee8-4fc7-a68f-356a1b4d6730 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:29.650808 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c1f16-bee8-4fc7-a68f-356a1b4d6730 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:29.651102 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c1f16-bee8-4fc7-a68f-356a1b4d6730 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:29.652520 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c1f16-bee8-4fc7-a68f-356a1b4d6730 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:29.663452 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 233/466] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:29.664226 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c1f16-bee8-4fc7-a68f-356a1b4d6730 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:29.672501 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:29.675398 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c97317-6c3f-4863-b3ec-86fa3d4efd28 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:29.689977 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:29.710198 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7e7b1-d57d-4ec1-9ae8-875f0431c1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:29.710824 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7e7b1-d57d-4ec1-9ae8-875f0431c1dd None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:29.711100 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7e7b1-d57d-4ec1-9ae8-875f0431c1dd None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:29.711370 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7e7b1-d57d-4ec1-9ae8-875f0431c1dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:29.723093 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7e7b1-d57d-4ec1-9ae8-875f0431c1dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:29.724558 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7e7b1-d57d-4ec1-9ae8-875f0431c1dd None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:29.739749 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-3ce7e7b1-d57d-4ec1-9ae8-875f0431c1dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:29.739749 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:29.739749 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:29.739749 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:29.739749 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:29.739749 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:29.739749 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:29.739749 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:29.739749 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:29.739749 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:29.739749 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:29.739749 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:29.739749 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:12:29.739749 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:12:29.739749 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:12:29.739749 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:12:29.740644 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:29.740644 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:29.740644 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:29.740644 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:29.740644 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:29.740644 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:29.740644 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:29.740644 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:29.740644 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:29.740644 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:29.740644 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:29.740644 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:29.740644 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:29.740644 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:29.740644 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:29.740644 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:29.740644 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:12:29.741498 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:12:29.741498 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:29.741498 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:29.741498 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 234/467] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:12:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:29.742072 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd79777-3102-4172-829c-352c510379a6 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:29.742294 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd79777-3102-4172-829c-352c510379a6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:29.742539 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd79777-3102-4172-829c-352c510379a6 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:29.743773 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 235/468] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:29.744467 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd79777-3102-4172-829c-352c510379a6 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:29.770116 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c1f16-bee8-4fc7-a68f-356a1b4d6730 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:29.810150 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606ce8c-95b0-4f73-bc98-03bb48e127b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:29.810786 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606ce8c-95b0-4f73-bc98-03bb48e127b5 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:29.811062 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606ce8c-95b0-4f73-bc98-03bb48e127b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:29.811333 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606ce8c-95b0-4f73-bc98-03bb48e127b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:29.823109 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3606ce8c-95b0-4f73-bc98-03bb48e127b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:29.824537 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3606ce8c-95b0-4f73-bc98-03bb48e127b5 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:29.838679 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-3606ce8c-95b0-4f73-bc98-03bb48e127b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:29.838679 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:29.838679 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:29.838679 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:29.838679 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:29.838679 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:29.838679 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:29.838679 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:29.838679 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:29.838679 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:29.838679 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:29.838679 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:29.838679 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:12:29.838679 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:12:29.838679 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:12:29.838679 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:12:29.839651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:29.839651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:29.839651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:29.839651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:29.839651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:29.839651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:29.839651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:29.839651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:29.839651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:29.839651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:29.839651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:29.839651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:29.839651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:29.839651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:29.839651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:29.839651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:29.839651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:12:29.840492 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:12:29.840492 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:29.840492 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:29.840492 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 234/469] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:12:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:29.840492 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606ce8c-95b0-4f73-bc98-03bb48e127b5 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:29.852021 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd79777-3102-4172-829c-352c510379a6 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:29.884995 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6090eb-01c2-4e98-b930-506a0214f292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:29.885671 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6090eb-01c2-4e98-b930-506a0214f292 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:29.885938 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6090eb-01c2-4e98-b930-506a0214f292 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:29.886200 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6090eb-01c2-4e98-b930-506a0214f292 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:29.892716 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6090eb-01c2-4e98-b930-506a0214f292 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:29.894275 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6090eb-01c2-4e98-b930-506a0214f292 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:29.905433 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-8c6090eb-01c2-4e98-b930-506a0214f292 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:12:29.905433 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:29.905433 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:29.905433 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:29.905433 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:29.905433 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:29.905433 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:29.905433 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:29.905433 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:29.905433 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:29.905433 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:29.905433 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:29.905433 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 13:12:29.905433 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 13:12:29.905433 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 13:12:29.906393 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 13:12:29.906393 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:29.906393 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:29.906393 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:29.906393 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:29.906393 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:29.906393 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:29.906393 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:29.906393 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:29.906393 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:29.906393 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:29.906393 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:29.906393 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:29.906393 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:29.906393 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:29.906393 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:29.906393 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:29.907222 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 13:12:29.907222 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 13:12:29.907222 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 13:12:29.907222 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 13:12:29.907222 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 13:12:29.907222 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 13:12:29.907222 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:12:29.907222 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:29.907222 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 236/470] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Oct 27 13:12:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:29.907689 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6090eb-01c2-4e98-b930-506a0214f292 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:29.920574 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:29.922605 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:29.945945 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606ce8c-95b0-4f73-bc98-03bb48e127b5 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:29.981084 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e6ed3-54d4-4d23-b6b2-8a10c59010d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:29.981756 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e6ed3-54d4-4d23-b6b2-8a10c59010d0 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:29.982031 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e6ed3-54d4-4d23-b6b2-8a10c59010d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:29.982299 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e6ed3-54d4-4d23-b6b2-8a10c59010d0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:29.989793 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e6ed3-54d4-4d23-b6b2-8a10c59010d0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:29.991265 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e6ed3-54d4-4d23-b6b2-8a10c59010d0 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:30.002406 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-f29e6ed3-54d4-4d23-b6b2-8a10c59010d0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 27 13:12:30.002406 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:30.002406 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:30.002406 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:30.002406 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:30.002406 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:30.002406 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:30.002406 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:30.002406 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:30.002406 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:30.002406 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:30.002406 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:30.002406 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 13:12:30.002406 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 13:12:30.002406 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 13:12:30.002406 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 13:12:30.003370 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:30.003370 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:30.003370 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 13:12:30.003370 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:12:30.003370 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 13:12:30.003370 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:12:30.003370 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:30.003370 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:30.003370 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:30.003370 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:30.003370 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:30.003370 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:30.003370 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:30.003370 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:30.003370 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:30.003370 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:30.003370 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:30.003370 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:30.004280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:30.004280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:30.004280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 13:12:30.004280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 13:12:30.004280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 13:12:30.004280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 13:12:30.004280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 13:12:30.004280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 13:12:30.004280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 27 13:12:30.004280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:30.004280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 235/471] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Oct 27 13:12:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:30.004862 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f9be5-d584-47ce-9fec-b20b049bd643 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:30.004935 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f9be5-d584-47ce-9fec-b20b049bd643 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:30.005169 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f9be5-d584-47ce-9fec-b20b049bd643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:30.011078 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6090eb-01c2-4e98-b930-506a0214f292 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:30.023653 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-e95f9be5-d584-47ce-9fec-b20b049bd643 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:30.024869 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e95f9be5-d584-47ce-9fec-b20b049bd643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:30.044766 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eaa63e-f3fb-4667-b514-b6f61cc94c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:30.045400 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eaa63e-f3fb-4667-b514-b6f61cc94c3e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:30.045717 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eaa63e-f3fb-4667-b514-b6f61cc94c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:30.045980 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eaa63e-f3fb-4667-b514-b6f61cc94c3e None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:30.046634 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eaa63e-f3fb-4667-b514-b6f61cc94c3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:30.046931 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eaa63e-f3fb-4667-b514-b6f61cc94c3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:30.048382 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eaa63e-f3fb-4667-b514-b6f61cc94c3e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:30.060165 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 237/472] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:30.062415 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eaa63e-f3fb-4667-b514-b6f61cc94c3e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:30.092851 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 236/473] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:12:30.093606 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f9be5-d584-47ce-9fec-b20b049bd643 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:30.142896 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:30.164651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:30.175272 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eaa63e-f3fb-4667-b514-b6f61cc94c3e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:30.207372 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f9be5-d584-47ce-9fec-b20b049bd643 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:30.214633 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef8063d-9a33-4cff-9f23-d2a2423e808e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:30.215242 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8063d-9a33-4cff-9f23-d2a2423e808e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:30.215519 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8063d-9a33-4cff-9f23-d2a2423e808e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:30.215788 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8063d-9a33-4cff-9f23-d2a2423e808e None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:30.216401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef8063d-9a33-4cff-9f23-d2a2423e808e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:30.216717 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef8063d-9a33-4cff-9f23-d2a2423e808e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:30.218130 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef8063d-9a33-4cff-9f23-d2a2423e808e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:30.234785 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 238/474] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:30.234785 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef8063d-9a33-4cff-9f23-d2a2423e808e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:30.246425 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df658b0f-b93e-4ada-a93e-65c67eced5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:30.247086 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df658b0f-b93e-4ada-a93e-65c67eced5b0 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:30.247396 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df658b0f-b93e-4ada-a93e-65c67eced5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:30.247662 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df658b0f-b93e-4ada-a93e-65c67eced5b0 None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:30.248324 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df658b0f-b93e-4ada-a93e-65c67eced5b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:30.248633 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df658b0f-b93e-4ada-a93e-65c67eced5b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:30.250224 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df658b0f-b93e-4ada-a93e-65c67eced5b0 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:30.262641 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 237/475] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Oct 27 13:12:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:30.263779 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df658b0f-b93e-4ada-a93e-65c67eced5b0 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:30.336789 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef8063d-9a33-4cff-9f23-d2a2423e808e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:30.366381 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:30.368762 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df658b0f-b93e-4ada-a93e-65c67eced5b0 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:30.372099 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6ceb6-38be-4f4b-a5a0-46968f8a6543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:30.372697 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6ceb6-38be-4f4b-a5a0-46968f8a6543 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:30.372972 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6ceb6-38be-4f4b-a5a0-46968f8a6543 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:30.373240 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6ceb6-38be-4f4b-a5a0-46968f8a6543 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:30.373994 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6ceb6-38be-4f4b-a5a0-46968f8a6543 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:30.374293 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6ceb6-38be-4f4b-a5a0-46968f8a6543 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:30.375720 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6ceb6-38be-4f4b-a5a0-46968f8a6543 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:30.391646 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:30.397418 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 239/476] 10.222.0.52 () {56 vars in 1139 bytes} [Thu Oct 27 13:12:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:30.397418 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6ceb6-38be-4f4b-a5a0-46968f8a6543 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:30.408613 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8bb20-15a9-41b1-8dbf-bb6afb9e9b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:30.409255 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8bb20-15a9-41b1-8dbf-bb6afb9e9b68 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:30.409625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8bb20-15a9-41b1-8dbf-bb6afb9e9b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:30.409909 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8bb20-15a9-41b1-8dbf-bb6afb9e9b68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:30.416703 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b8bb20-15a9-41b1-8dbf-bb6afb9e9b68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:30.418190 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b8bb20-15a9-41b1-8dbf-bb6afb9e9b68 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:30.429878 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-27b8bb20-15a9-41b1-8dbf-bb6afb9e9b68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:12:30.429878 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:30.429878 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:30.429878 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:30.429878 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:30.429878 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:30.429878 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:30.429878 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:30.429878 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:30.429878 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:30.429878 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:30.429878 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:30.429878 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 13:12:30.429878 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 13:12:30.429878 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 13:12:30.430750 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 13:12:30.430750 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:30.430750 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:30.430750 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:30.430750 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:30.430750 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:30.430750 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:30.430750 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:30.430750 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:30.430750 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:30.430750 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:30.430750 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:30.430750 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:30.430750 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:30.430750 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:30.430750 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:30.430750 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:30.431585 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 13:12:30.431585 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 13:12:30.431585 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 13:12:30.431585 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 13:12:30.431585 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 13:12:30.431585 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 13:12:30.431585 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:12:30.431585 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:30.431585 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 238/477] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Oct 27 13:12:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:30.432032 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8bb20-15a9-41b1-8dbf-bb6afb9e9b68 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:30.495476 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6ceb6-38be-4f4b-a5a0-46968f8a6543 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:30.528381 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ac0ba-4a9b-484f-b990-4f93db5d6ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:30.529003 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ac0ba-4a9b-484f-b990-4f93db5d6ea2 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:30.529268 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ac0ba-4a9b-484f-b990-4f93db5d6ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:30.529551 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ac0ba-4a9b-484f-b990-4f93db5d6ea2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:30.535748 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8bb20-15a9-41b1-8dbf-bb6afb9e9b68 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:30.536107 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ac0ba-4a9b-484f-b990-4f93db5d6ea2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:30.537581 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ac0ba-4a9b-484f-b990-4f93db5d6ea2 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:30.548444 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-a24ac0ba-4a9b-484f-b990-4f93db5d6ea2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:12:30.548444 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:30.548444 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:30.548444 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:30.548444 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:30.548444 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:30.548444 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:30.548444 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:30.548444 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:30.548444 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:30.548444 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:30.548444 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:30.548444 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 13:12:30.548444 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 13:12:30.548444 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 13:12:30.549429 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 13:12:30.549429 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:30.549429 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:30.549429 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:30.549429 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:30.549429 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:30.549429 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:30.549429 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:30.549429 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:30.549429 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:30.549429 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:30.549429 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:30.549429 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:30.549429 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:30.549429 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:30.549429 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:30.549429 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:30.550334 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 13:12:30.550334 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 13:12:30.550334 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 13:12:30.550334 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 13:12:30.550334 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 13:12:30.550334 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 13:12:30.550334 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:12:30.550334 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:30.550334 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 240/478] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Oct 27 13:12:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:30.550334 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ac0ba-4a9b-484f-b990-4f93db5d6ea2 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:30.574484 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3106c7-fa0a-42af-a590-9c842d0b5547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:30.575114 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3106c7-fa0a-42af-a590-9c842d0b5547 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:30.575384 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3106c7-fa0a-42af-a590-9c842d0b5547 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:30.575621 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3106c7-fa0a-42af-a590-9c842d0b5547 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:30.576329 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3106c7-fa0a-42af-a590-9c842d0b5547 None admin] RBAC: Adding query filter params (role.id=75936ae3accd49cb935acc7c628e2136, scope.project.id=0be19dd5a0df4cf79fe2ec14d11521f0, user.id=aa785d7f18b54de48a0ec78ec8642e17) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:30.576628 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3106c7-fa0a-42af-a590-9c842d0b5547 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:30.578099 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3106c7-fa0a-42af-a590-9c842d0b5547 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:30.584066 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 239/479] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Oct 27 13:12:30 2022] GET /identity/v3/role_assignments?user.id=aa785d7f18b54de48a0ec78ec8642e17&scope.project.id=0be19dd5a0df4cf79fe2ec14d11521f0&role.id=75936ae3accd49cb935acc7c628e2136 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:30.584733 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3106c7-fa0a-42af-a590-9c842d0b5547 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:30.616300 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:30.644086 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:30.676079 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ac0ba-4a9b-484f-b990-4f93db5d6ea2 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:30.703125 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3106c7-fa0a-42af-a590-9c842d0b5547 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:30.712660 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f28cd-9d5f-4174-aa3a-69a799d23fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:30.713279 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f28cd-9d5f-4174-aa3a-69a799d23fd7 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:30.713565 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f28cd-9d5f-4174-aa3a-69a799d23fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:30.713860 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f28cd-9d5f-4174-aa3a-69a799d23fd7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:30.728401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28f28cd-9d5f-4174-aa3a-69a799d23fd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:12:30.733301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-f28f28cd-9d5f-4174-aa3a-69a799d23fd7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 13:12:30.733301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:30.733301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:30.733301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:30.733301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:30.733301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:30.733301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:30.733301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:30.733301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:30.733301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:30.733301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:30.733301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:30.733301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:12:30.733301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:12:30.733301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:12:30.733301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:12:30.734383 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:12:30.734383 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:12:30.734383 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:12:30.734383 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:12:30.734383 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:30.734383 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:30.734383 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:30.734383 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:30.734383 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:30.734383 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:30.734383 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:30.734383 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:30.734383 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:30.734383 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:30.734383 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:30.734383 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:30.735171 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:30.735171 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:30.735171 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:30.735171 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:30.735171 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:12:30.735171 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:12:30.735171 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:12:30.735171 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:12:30.735171 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:12:30.735171 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:12:30.735171 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 13:12:30.735171 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:30.735171 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 241/480] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Oct 27 13:12:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:30.735838 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f28cd-9d5f-4174-aa3a-69a799d23fd7 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:30.748123 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7d66b-af25-4750-9a77-ebe767f71d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:30.748740 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7d66b-af25-4750-9a77-ebe767f71d53 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:30.749012 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7d66b-af25-4750-9a77-ebe767f71d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:30.749277 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7d66b-af25-4750-9a77-ebe767f71d53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:30.836039 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd7d66b-af25-4750-9a77-ebe767f71d53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:30.837769 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd7d66b-af25-4750-9a77-ebe767f71d53 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:30.846164 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f28cd-9d5f-4174-aa3a-69a799d23fd7 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:30.857621 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:30.883615 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb90dc7-6fa8-43eb-bd03-d1258f106f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:30.884614 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb90dc7-6fa8-43eb-bd03-d1258f106f91 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:30.884889 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb90dc7-6fa8-43eb-bd03-d1258f106f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:30.885153 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb90dc7-6fa8-43eb-bd03-d1258f106f91 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:30.885865 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb90dc7-6fa8-43eb-bd03-d1258f106f91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:30.886170 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb90dc7-6fa8-43eb-bd03-d1258f106f91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:30.887642 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb90dc7-6fa8-43eb-bd03-d1258f106f91 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:30.889091 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:30.900675 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 242/481] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Oct 27 13:12:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:30.901282 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb90dc7-6fa8-43eb-bd03-d1258f106f91 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:30.952432 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 240/482] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Oct 27 13:12:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 13:12:30.953108 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7d66b-af25-4750-9a77-ebe767f71d53 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:31.014374 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb90dc7-6fa8-43eb-bd03-d1258f106f91 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:31.049401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b9575-fd3b-4a50-933b-e1fc11f18b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:31.050658 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b9575-fd3b-4a50-933b-e1fc11f18b52 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:31.051111 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b9575-fd3b-4a50-933b-e1fc11f18b52 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:31.051546 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b9575-fd3b-4a50-933b-e1fc11f18b52 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:31.052568 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b9575-fd3b-4a50-933b-e1fc11f18b52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:31.053013 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b9575-fd3b-4a50-933b-e1fc11f18b52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:31.054689 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b9575-fd3b-4a50-933b-e1fc11f18b52 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:31.055310 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7d66b-af25-4750-9a77-ebe767f71d53 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:31.069139 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 243/483] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Oct 27 13:12:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:31.070232 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b9575-fd3b-4a50-933b-e1fc11f18b52 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:31.098255 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529b1ef-c792-4d3b-b478-6dc6b7b535a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:31.098788 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529b1ef-c792-4d3b-b478-6dc6b7b535a0 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:31.099062 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529b1ef-c792-4d3b-b478-6dc6b7b535a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:31.099333 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529b1ef-c792-4d3b-b478-6dc6b7b535a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:31.100032 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529b1ef-c792-4d3b-b478-6dc6b7b535a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:31.100287 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529b1ef-c792-4d3b-b478-6dc6b7b535a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:31.101722 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529b1ef-c792-4d3b-b478-6dc6b7b535a0 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:31.103346 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:31.111764 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 241/484] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Oct 27 13:12:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:31.112368 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529b1ef-c792-4d3b-b478-6dc6b7b535a0 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:31.124708 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:31.181449 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b9575-fd3b-4a50-933b-e1fc11f18b52 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:31.212262 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529b1ef-c792-4d3b-b478-6dc6b7b535a0 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:31.220072 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7824f-cae9-4564-a573-fdf54d84702a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:31.220977 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7824f-cae9-4564-a573-fdf54d84702a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:31.221250 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7824f-cae9-4564-a573-fdf54d84702a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:31.221552 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7824f-cae9-4564-a573-fdf54d84702a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:31.222416 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f7824f-cae9-4564-a573-fdf54d84702a None admin] RBAC: Adding query filter params (role.id=75936ae3accd49cb935acc7c628e2136, scope.project.id=0be19dd5a0df4cf79fe2ec14d11521f0, user.id=719e4bf834d6490b96066e55a26fb159) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:31.222787 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f7824f-cae9-4564-a573-fdf54d84702a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:31.224242 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f7824f-cae9-4564-a573-fdf54d84702a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:31.241569 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 244/485] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Oct 27 13:12:31 2022] GET /identity/v3/role_assignments?user.id=719e4bf834d6490b96066e55a26fb159&scope.project.id=0be19dd5a0df4cf79fe2ec14d11521f0&role.id=75936ae3accd49cb935acc7c628e2136 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:31.241569 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7824f-cae9-4564-a573-fdf54d84702a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:31.259918 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f4b5c-6fb8-4c75-b07f-8edc6fdad75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:31.260646 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f4b5c-6fb8-4c75-b07f-8edc6fdad75b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:31.260924 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f4b5c-6fb8-4c75-b07f-8edc6fdad75b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:31.261195 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f4b5c-6fb8-4c75-b07f-8edc6fdad75b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:31.273429 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f4b5c-6fb8-4c75-b07f-8edc6fdad75b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:31.274940 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f4b5c-6fb8-4c75-b07f-8edc6fdad75b None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:31.291067 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-5c6f4b5c-6fb8-4c75-b07f-8edc6fdad75b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:31.291067 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:31.291067 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:31.291067 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:31.291067 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:31.291067 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:31.291067 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:31.291067 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:31.291067 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:31.291067 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:31.291067 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:31.291067 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:31.291067 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:12:31.291067 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:12:31.291067 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:12:31.291067 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:12:31.292111 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:31.292111 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:31.292111 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:31.292111 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:31.292111 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:31.292111 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:31.292111 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:31.292111 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:31.292111 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:31.292111 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:31.292111 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:31.292111 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:31.292111 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:31.292111 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:31.292111 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:31.292111 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:31.292111 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:12:31.292945 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:12:31.292945 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:31.292945 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:31.292945 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 242/486] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:12:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:31.293153 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f4b5c-6fb8-4c75-b07f-8edc6fdad75b None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:31.353153 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:31.362714 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7824f-cae9-4564-a573-fdf54d84702a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:31.366964 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:31.404729 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c3c056-ef0b-4cad-b7ec-dbf0e8c4d73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:31.405626 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3c056-ef0b-4cad-b7ec-dbf0e8c4d73e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:31.405907 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3c056-ef0b-4cad-b7ec-dbf0e8c4d73e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:31.406176 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3c056-ef0b-4cad-b7ec-dbf0e8c4d73e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:31.406907 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c3c056-ef0b-4cad-b7ec-dbf0e8c4d73e None admin] RBAC: Adding query filter params (role.id=75936ae3accd49cb935acc7c628e2136, scope.project.id=0be19dd5a0df4cf79fe2ec14d11521f0, user.id=2298dbfcf7b74668902781401f77215e) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:31.407210 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c3c056-ef0b-4cad-b7ec-dbf0e8c4d73e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:31.408728 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c3c056-ef0b-4cad-b7ec-dbf0e8c4d73e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:31.413943 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f4b5c-6fb8-4c75-b07f-8edc6fdad75b None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:31.416603 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 245/487] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Oct 27 13:12:31 2022] GET /identity/v3/role_assignments?user.id=2298dbfcf7b74668902781401f77215e&scope.project.id=0be19dd5a0df4cf79fe2ec14d11521f0&role.id=75936ae3accd49cb935acc7c628e2136 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:31.417490 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c3c056-ef0b-4cad-b7ec-dbf0e8c4d73e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:31.460220 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd3ecc-ec67-4bf7-b463-3533b4050393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:31.461013 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd3ecc-ec67-4bf7-b463-3533b4050393 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:31.461287 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd3ecc-ec67-4bf7-b463-3533b4050393 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:31.462624 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd3ecc-ec67-4bf7-b463-3533b4050393 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:31.478994 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd3ecc-ec67-4bf7-b463-3533b4050393 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:31.480991 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd3ecc-ec67-4bf7-b463-3533b4050393 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:31.501486 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-7ffd3ecc-ec67-4bf7-b463-3533b4050393 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:31.501486 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:31.501486 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:31.501486 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:31.501486 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:31.501486 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:31.501486 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:31.501486 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:31.501486 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:31.501486 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:31.501486 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:31.501486 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:31.501486 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:12:31.501486 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:12:31.501486 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:12:31.501486 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:12:31.503912 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:31.503912 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:31.503912 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:31.503912 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:31.503912 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:31.503912 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:31.503912 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:31.503912 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:31.503912 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:31.503912 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:31.503912 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:31.503912 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:31.503912 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:31.503912 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:31.503912 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:31.503912 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:31.503912 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:12:31.505835 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:12:31.505835 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:31.505835 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:31.505835 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 243/488] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:12:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:31.509403 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd3ecc-ec67-4bf7-b463-3533b4050393 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:31.549955 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c3c056-ef0b-4cad-b7ec-dbf0e8c4d73e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:31.591799 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a476e29-97b4-4207-ae79-33f2f453d0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:31.592566 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a476e29-97b4-4207-ae79-33f2f453d0b0 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:31.593096 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a476e29-97b4-4207-ae79-33f2f453d0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:31.593458 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a476e29-97b4-4207-ae79-33f2f453d0b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:31.594723 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a476e29-97b4-4207-ae79-33f2f453d0b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:31.595267 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a476e29-97b4-4207-ae79-33f2f453d0b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:31.596821 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a476e29-97b4-4207-ae79-33f2f453d0b0 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:31.614604 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 246/489] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:31.622219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a476e29-97b4-4207-ae79-33f2f453d0b0 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:31.642768 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd3ecc-ec67-4bf7-b463-3533b4050393 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:31.648203 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:31.660927 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:31.683511 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bfc5bd-6625-46cc-89b9-34548ab05a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:31.684275 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfc5bd-6625-46cc-89b9-34548ab05a10 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:31.684553 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfc5bd-6625-46cc-89b9-34548ab05a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:31.684818 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfc5bd-6625-46cc-89b9-34548ab05a10 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:31.686863 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bfc5bd-6625-46cc-89b9-34548ab05a10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:31.686863 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bfc5bd-6625-46cc-89b9-34548ab05a10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:31.687527 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bfc5bd-6625-46cc-89b9-34548ab05a10 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:31.703243 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 244/490] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:12:31.709576 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bfc5bd-6625-46cc-89b9-34548ab05a10 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:31.758812 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a476e29-97b4-4207-ae79-33f2f453d0b0 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:31.809894 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39011e5-2df2-4176-9e70-d94170c37517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:31.810768 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39011e5-2df2-4176-9e70-d94170c37517 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:31.811210 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39011e5-2df2-4176-9e70-d94170c37517 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:31.811713 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39011e5-2df2-4176-9e70-d94170c37517 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:31.820126 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39011e5-2df2-4176-9e70-d94170c37517 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:31.822225 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39011e5-2df2-4176-9e70-d94170c37517 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:31.840793 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bfc5bd-6625-46cc-89b9-34548ab05a10 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:31.844370 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-e39011e5-2df2-4176-9e70-d94170c37517 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:12:31.844370 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:31.844370 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:31.844370 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:31.844370 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:31.844370 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:31.844370 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:31.844370 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:31.844370 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:31.844370 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:31.844370 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:31.844370 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:31.844370 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 13:12:31.844370 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 13:12:31.844370 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 13:12:31.845388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 13:12:31.845388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:31.845388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:31.845388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:31.845388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:31.845388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:31.845388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:31.845388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:31.845388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:31.845388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:31.845388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:31.845388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:31.845388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:31.845388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:31.845388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:31.845388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:31.845388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:31.846477 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 13:12:31.846477 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 13:12:31.846477 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 13:12:31.846477 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 13:12:31.846477 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 13:12:31.846477 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 13:12:31.846477 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:12:31.846477 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:31.849146 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 247/491] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Oct 27 13:12:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:12:31.855207 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39011e5-2df2-4176-9e70-d94170c37517 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:31.885490 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269ebb8-f81a-47e5-b30e-93b17ada3c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:31.886691 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269ebb8-f81a-47e5-b30e-93b17ada3c25 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:31.887160 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269ebb8-f81a-47e5-b30e-93b17ada3c25 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:31.888008 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269ebb8-f81a-47e5-b30e-93b17ada3c25 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:31.898832 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7269ebb8-f81a-47e5-b30e-93b17ada3c25 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:31.901480 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7269ebb8-f81a-47e5-b30e-93b17ada3c25 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:31.917810 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-7269ebb8-f81a-47e5-b30e-93b17ada3c25 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 27 13:12:31.917810 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:31.917810 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:31.917810 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:31.917810 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:31.917810 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:31.917810 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:31.917810 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:31.917810 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:31.917810 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:31.917810 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:31.917810 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:31.917810 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 13:12:31.917810 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 13:12:31.917810 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 13:12:31.917810 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 13:12:31.918965 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:31.918965 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:31.918965 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 13:12:31.918965 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:12:31.918965 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 13:12:31.918965 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:12:31.918965 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:31.918965 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:31.918965 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:31.918965 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:31.918965 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:31.918965 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:31.918965 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:31.918965 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:31.918965 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:31.918965 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:31.918965 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:31.918965 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:31.919866 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:31.919866 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:31.919866 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 13:12:31.919866 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 13:12:31.919866 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 13:12:31.919866 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 13:12:31.919866 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 13:12:31.919866 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 13:12:31.919866 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 27 13:12:31.919866 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:31.922788 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 245/492] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Oct 27 13:12:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:12:31.928507 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269ebb8-f81a-47e5-b30e-93b17ada3c25 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:31.954094 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:31.966502 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:31.980298 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39011e5-2df2-4176-9e70-d94170c37517 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:32.017708 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051e0ef-d31a-4dae-8991-da0a016833a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:32.018427 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051e0ef-d31a-4dae-8991-da0a016833a0 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:32.018793 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051e0ef-d31a-4dae-8991-da0a016833a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:32.019289 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051e0ef-d31a-4dae-8991-da0a016833a0 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:32.020521 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051e0ef-d31a-4dae-8991-da0a016833a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:32.020521 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051e0ef-d31a-4dae-8991-da0a016833a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:32.022018 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051e0ef-d31a-4dae-8991-da0a016833a0 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:32.041186 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 248/493] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Oct 27 13:12:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:12:32.041186 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051e0ef-d31a-4dae-8991-da0a016833a0 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:32.079415 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269ebb8-f81a-47e5-b30e-93b17ada3c25 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:32.117464 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c619dd0-0c7c-427d-bc95-9892c546ea0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:32.118125 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c619dd0-0c7c-427d-bc95-9892c546ea0c None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:32.118663 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c619dd0-0c7c-427d-bc95-9892c546ea0c None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:32.118936 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c619dd0-0c7c-427d-bc95-9892c546ea0c None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:32.119665 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c619dd0-0c7c-427d-bc95-9892c546ea0c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:32.119968 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c619dd0-0c7c-427d-bc95-9892c546ea0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:32.121756 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c619dd0-0c7c-427d-bc95-9892c546ea0c None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:32.141560 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 246/494] 10.222.0.52 () {56 vars in 1135 bytes} [Thu Oct 27 13:12:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:32.147417 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c619dd0-0c7c-427d-bc95-9892c546ea0c None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:32.213325 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051e0ef-d31a-4dae-8991-da0a016833a0 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:32.248836 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed9a11-ec2b-4a3a-baa7-616eba0be470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:32.249430 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed9a11-ec2b-4a3a-baa7-616eba0be470 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:32.249768 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed9a11-ec2b-4a3a-baa7-616eba0be470 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:32.250037 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed9a11-ec2b-4a3a-baa7-616eba0be470 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:32.250755 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ed9a11-ec2b-4a3a-baa7-616eba0be470 None admin] RBAC: Adding query filter params (role.id=75936ae3accd49cb935acc7c628e2136, scope.project.id=0be19dd5a0df4cf79fe2ec14d11521f0, user.id=d803f074332a4216aee8a38220faa10a) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:32.251056 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ed9a11-ec2b-4a3a-baa7-616eba0be470 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:32.252494 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ed9a11-ec2b-4a3a-baa7-616eba0be470 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:32.263564 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 249/495] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Oct 27 13:12:32 2022] GET /identity/v3/role_assignments?user.id=d803f074332a4216aee8a38220faa10a&scope.project.id=0be19dd5a0df4cf79fe2ec14d11521f0&role.id=75936ae3accd49cb935acc7c628e2136 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:32.335399 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:32.346146 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c619dd0-0c7c-427d-bc95-9892c546ea0c None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:32.385149 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd9cf1a-31db-4c19-887f-c8cc047e6f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:32.385808 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9cf1a-31db-4c19-887f-c8cc047e6f8a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:32.386082 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9cf1a-31db-4c19-887f-c8cc047e6f8a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:32.386352 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9cf1a-31db-4c19-887f-c8cc047e6f8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:32.460923 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd9cf1a-31db-4c19-887f-c8cc047e6f8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:32.462431 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd9cf1a-31db-4c19-887f-c8cc047e6f8a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:32.559210 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:32.569419 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 247/496] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Oct 27 13:12:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 13:12:32.575017 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed9a11-ec2b-4a3a-baa7-616eba0be470 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:32.578378 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:32.698019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed9a11-ec2b-4a3a-baa7-616eba0be470 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:32.742545 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395addd9-8db5-4774-9a5f-a0d13ba20595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:32.743168 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395addd9-8db5-4774-9a5f-a0d13ba20595 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:32.743450 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395addd9-8db5-4774-9a5f-a0d13ba20595 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:32.743724 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395addd9-8db5-4774-9a5f-a0d13ba20595 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:32.754637 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395addd9-8db5-4774-9a5f-a0d13ba20595 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:32.756105 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395addd9-8db5-4774-9a5f-a0d13ba20595 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:32.770672 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-395addd9-8db5-4774-9a5f-a0d13ba20595 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:32.770672 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:32.770672 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:32.770672 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:32.770672 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:32.770672 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:32.770672 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:32.770672 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:32.770672 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:32.770672 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:32.770672 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:32.770672 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:32.770672 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:12:32.770672 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:12:32.770672 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:12:32.770672 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:12:32.771624 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:32.771624 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:32.771624 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:32.771624 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:32.771624 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:32.771624 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:32.771624 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:32.771624 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:32.771624 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:32.771624 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:32.771624 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:32.771624 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:32.771624 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:32.771624 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:32.771624 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:32.771624 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:32.771624 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:12:32.772565 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:12:32.772565 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:32.772565 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:32.772565 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 250/497] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:12:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:32.777685 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd9cf1a-31db-4c19-887f-c8cc047e6f8a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:32.886290 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd9cf1a-31db-4c19-887f-c8cc047e6f8a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:32.940555 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c4b1b-a29b-4938-9f32-b179d3f8efda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:32.941220 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c4b1b-a29b-4938-9f32-b179d3f8efda None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:32.941496 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c4b1b-a29b-4938-9f32-b179d3f8efda None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:32.941786 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c4b1b-a29b-4938-9f32-b179d3f8efda None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:32.942428 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c4b1b-a29b-4938-9f32-b179d3f8efda None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:32.942726 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c4b1b-a29b-4938-9f32-b179d3f8efda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:32.944108 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c4b1b-a29b-4938-9f32-b179d3f8efda None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:32.959895 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 248/498] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:12:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:32.965155 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395addd9-8db5-4774-9a5f-a0d13ba20595 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:32.998156 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f4998-d3f3-46ee-977a-aba3fb4beb49 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:32.998538 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f4998-d3f3-46ee-977a-aba3fb4beb49 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:32.998819 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f4998-d3f3-46ee-977a-aba3fb4beb49 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:33.000182 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 249/499] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 13:12:33.006947 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce1ae4-128b-4d5a-93a1-a7ade24a1d3f None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:33.007698 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce1ae4-128b-4d5a-93a1-a7ade24a1d3f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:33.008142 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce1ae4-128b-4d5a-93a1-a7ade24a1d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:33.036732 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-08ce1ae4-128b-4d5a-93a1-a7ade24a1d3f None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:33.039392 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-08ce1ae4-128b-4d5a-93a1-a7ade24a1d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:33.061873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:33.126495 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395addd9-8db5-4774-9a5f-a0d13ba20595 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:33.158579 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:33.164020 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9131e2e-e9ff-4da9-bff0-b1cc0b33053d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:33.164931 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9131e2e-e9ff-4da9-bff0-b1cc0b33053d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:33.165400 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9131e2e-e9ff-4da9-bff0-b1cc0b33053d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:33.165885 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9131e2e-e9ff-4da9-bff0-b1cc0b33053d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:33.174086 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9131e2e-e9ff-4da9-bff0-b1cc0b33053d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:33.176112 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9131e2e-e9ff-4da9-bff0-b1cc0b33053d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:33.189988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-f9131e2e-e9ff-4da9-bff0-b1cc0b33053d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:12:33.189988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:33.189988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:33.189988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:33.189988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:33.189988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:33.189988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:33.189988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:33.189988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:33.189988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:33.189988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:33.189988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:33.189988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 13:12:33.189988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 13:12:33.189988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 13:12:33.190997 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 13:12:33.190997 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:33.190997 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:33.190997 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:33.190997 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:33.190997 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:33.190997 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:33.190997 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:33.190997 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:33.190997 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:33.190997 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:33.190997 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:33.190997 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:33.190997 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:33.190997 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:33.190997 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:33.190997 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:33.192320 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 13:12:33.192320 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 13:12:33.192320 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 13:12:33.192320 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 13:12:33.192320 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 13:12:33.192320 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 13:12:33.192320 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:12:33.192320 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:33.194772 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 251/500] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Oct 27 13:12:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:33.199853 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 250/501] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 13:12:33.201010 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9131e2e-e9ff-4da9-bff0-b1cc0b33053d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:33.300782 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9131e2e-e9ff-4da9-bff0-b1cc0b33053d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:33.317914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:33.336014 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876e79d-d943-4ae7-b2ac-4460e48c90f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:33.336963 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876e79d-d943-4ae7-b2ac-4460e48c90f3 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:33.337460 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876e79d-d943-4ae7-b2ac-4460e48c90f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:33.337954 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876e79d-d943-4ae7-b2ac-4460e48c90f3 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:33.338828 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876e79d-d943-4ae7-b2ac-4460e48c90f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:33.339320 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876e79d-d943-4ae7-b2ac-4460e48c90f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:33.341035 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876e79d-d943-4ae7-b2ac-4460e48c90f3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:33.354170 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 252/502] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Oct 27 13:12:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:33.362688 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce1ae4-128b-4d5a-93a1-a7ade24a1d3f None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:33.466444 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce1ae4-128b-4d5a-93a1-a7ade24a1d3f None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:33.521009 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695779ca-8071-4f7d-94d4-b54538ddfc8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:33.522060 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695779ca-8071-4f7d-94d4-b54538ddfc8c None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:33.522554 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695779ca-8071-4f7d-94d4-b54538ddfc8c None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:33.523012 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695779ca-8071-4f7d-94d4-b54538ddfc8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:33.523931 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695779ca-8071-4f7d-94d4-b54538ddfc8c None admin] RBAC: Adding query filter params (role.id=75936ae3accd49cb935acc7c628e2136, scope.project.id=0be19dd5a0df4cf79fe2ec14d11521f0, user.id=62769acbfca242d6a0b0fe5a6b8bc108) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:33.524444 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695779ca-8071-4f7d-94d4-b54538ddfc8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:33.526098 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695779ca-8071-4f7d-94d4-b54538ddfc8c None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:33.535186 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 251/503] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Oct 27 13:12:33 2022] GET /identity/v3/role_assignments?user.id=62769acbfca242d6a0b0fe5a6b8bc108&scope.project.id=0be19dd5a0df4cf79fe2ec14d11521f0&role.id=75936ae3accd49cb935acc7c628e2136 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:33.546916 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876e79d-d943-4ae7-b2ac-4460e48c90f3 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:33.656677 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876e79d-d943-4ae7-b2ac-4460e48c90f3 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:33.696796 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d0dae-c29a-445a-b95b-bbd0de96e9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:33.697879 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d0dae-c29a-445a-b95b-bbd0de96e9b2 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:33.698458 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d0dae-c29a-445a-b95b-bbd0de96e9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:33.698939 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d0dae-c29a-445a-b95b-bbd0de96e9b2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:33.699722 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d0dae-c29a-445a-b95b-bbd0de96e9b2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:33.701332 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d0dae-c29a-445a-b95b-bbd0de96e9b2 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:33.713140 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-b18d0dae-c29a-445a-b95b-bbd0de96e9b2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 13:12:33.713140 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:33.713140 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 13:12:33.713140 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 13:12:33.713140 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 13:12:33.713140 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 13:12:33.713140 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 13:12:33.713140 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:12:33.713140 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 13:12:33.713140 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:33.713140 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 13:12:33.713140 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:33.713140 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:33.713140 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:33.713140 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:33.713140 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:33.713140 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:33.714224 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:33.714224 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:33.714224 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:33.714224 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:33.714224 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:33.714224 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:33.714224 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 13:12:33.714224 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 13:12:33.714224 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 13:12:33.714224 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 13:12:33.714224 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:33.714224 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:33.714224 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:33.714224 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:33.714224 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:33.714224 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:33.715055 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:33.715055 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:33.715055 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:33.715055 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:33.715055 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:33.715055 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:33.715055 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:33.715055 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:33.715055 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:33.715055 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:33.715055 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 13:12:33.715055 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:12:33.715055 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 13:12:33.715055 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:33.721658 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 253/504] 10.222.0.52 () {56 vars in 1129 bytes} [Thu Oct 27 13:12:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:33.724634 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695779ca-8071-4f7d-94d4-b54538ddfc8c None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:33.776889 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:33.847145 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695779ca-8071-4f7d-94d4-b54538ddfc8c None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:33.885209 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f77c89-716d-43f3-b610-70a9be34bbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:33.886274 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f77c89-716d-43f3-b610-70a9be34bbd0 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:33.886746 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f77c89-716d-43f3-b610-70a9be34bbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:33.887311 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f77c89-716d-43f3-b610-70a9be34bbd0 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:33.888127 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f77c89-716d-43f3-b610-70a9be34bbd0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:33.888617 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f77c89-716d-43f3-b610-70a9be34bbd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:33.890218 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f77c89-716d-43f3-b610-70a9be34bbd0 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:33.899830 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 252/505] 10.222.0.52 () {56 vars in 1124 bytes} [Thu Oct 27 13:12:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:33.901467 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d0dae-c29a-445a-b95b-bbd0de96e9b2 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:33.944089 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:34.010376 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d0dae-c29a-445a-b95b-bbd0de96e9b2 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:34.045127 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca665eff-416d-4821-9ad6-78b41dcb8e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:34.045765 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca665eff-416d-4821-9ad6-78b41dcb8e8e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:34.046037 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca665eff-416d-4821-9ad6-78b41dcb8e8e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:34.046301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca665eff-416d-4821-9ad6-78b41dcb8e8e None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:34.046922 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca665eff-416d-4821-9ad6-78b41dcb8e8e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:34.047219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca665eff-416d-4821-9ad6-78b41dcb8e8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:34.048600 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca665eff-416d-4821-9ad6-78b41dcb8e8e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:34.058763 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 254/506] 10.222.0.52 () {56 vars in 1124 bytes} [Thu Oct 27 13:12:33 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:34.084527 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5fa249-52f2-4a47-bb03-5b30c1a072ba None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:34.084843 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5fa249-52f2-4a47-bb03-5b30c1a072ba None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:34.085074 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5fa249-52f2-4a47-bb03-5b30c1a072ba None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:34.086625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 253/507] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:34.092419 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec42c7c-6ad6-4e1f-999f-0fc473658b9f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:34.092743 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec42c7c-6ad6-4e1f-999f-0fc473658b9f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:34.092963 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec42c7c-6ad6-4e1f-999f-0fc473658b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:34.112667 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-cec42c7c-6ad6-4e1f-999f-0fc473658b9f None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:34.113967 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cec42c7c-6ad6-4e1f-999f-0fc473658b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:34.209481 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 255/508] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:12:34.351014 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227655d-10c6-40b9-8220-6cfdc622cff7 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:34.351369 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227655d-10c6-40b9-8220-6cfdc622cff7 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:34.351547 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227655d-10c6-40b9-8220-6cfdc622cff7 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:34.353199 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 254/509] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:34.358572 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e02dc2-7b2a-473d-b0bf-df33ac0bf2fe None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:34.358859 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e02dc2-7b2a-473d-b0bf-df33ac0bf2fe None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:34.359134 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e02dc2-7b2a-473d-b0bf-df33ac0bf2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:34.380352 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-91e02dc2-7b2a-473d-b0bf-df33ac0bf2fe None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:34.381516 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-91e02dc2-7b2a-473d-b0bf-df33ac0bf2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:34.412099 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:34.467524 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 256/510] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:12:34.563001 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227655d-10c6-40b9-8220-6cfdc622cff7 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:34.702247 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227655d-10c6-40b9-8220-6cfdc622cff7 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:34.715919 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:34.750440 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79f610-29e3-42d3-882a-7c3ea986e4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:34.751001 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79f610-29e3-42d3-882a-7c3ea986e4f3 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:34.751280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79f610-29e3-42d3-882a-7c3ea986e4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:34.751552 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79f610-29e3-42d3-882a-7c3ea986e4f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:34.775386 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f79f610-29e3-42d3-882a-7c3ea986e4f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:12:34.780186 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-5f79f610-29e3-42d3-882a-7c3ea986e4f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:12:34.780186 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:34.780186 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:34.780186 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:34.780186 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:34.780186 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:34.780186 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:34.780186 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:34.780186 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:34.780186 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:34.780186 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:34.780186 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:34.780186 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:12:34.780186 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:12:34.780186 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:12:34.780186 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:12:34.781091 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:12:34.781091 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:12:34.781091 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:12:34.781091 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:12:34.781091 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:34.781091 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:34.781091 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:34.781091 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:34.781091 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:34.781091 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:34.781091 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:34.781091 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:34.781091 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:34.781091 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:34.781091 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:34.781091 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:34.781931 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:34.781931 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:34.781931 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:34.781931 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:34.781931 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:12:34.781931 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:12:34.781931 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:12:34.781931 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:12:34.781931 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:12:34.781931 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:12:34.781931 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:12:34.781931 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:34.781931 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 255/511] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Oct 27 13:12:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:34.790834 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e02dc2-7b2a-473d-b0bf-df33ac0bf2fe None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:34.791848 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79f610-29e3-42d3-882a-7c3ea986e4f3 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:34.948621 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79f610-29e3-42d3-882a-7c3ea986e4f3 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:34.984801 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e02dc2-7b2a-473d-b0bf-df33ac0bf2fe None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:35.015527 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b775ea9-71f1-4394-a204-cd1b34269034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:35.016093 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b775ea9-71f1-4394-a204-cd1b34269034 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:35.016367 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b775ea9-71f1-4394-a204-cd1b34269034 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:35.016636 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b775ea9-71f1-4394-a204-cd1b34269034 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:35.036499 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b775ea9-71f1-4394-a204-cd1b34269034 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:35.038035 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b775ea9-71f1-4394-a204-cd1b34269034 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:35.053932 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f10916-e5c0-4a07-9654-f926dd50a71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:35.054541 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f10916-e5c0-4a07-9654-f926dd50a71f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:35.054819 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f10916-e5c0-4a07-9654-f926dd50a71f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:35.055091 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f10916-e5c0-4a07-9654-f926dd50a71f None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:35.055862 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f10916-e5c0-4a07-9654-f926dd50a71f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:35.056167 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f10916-e5c0-4a07-9654-f926dd50a71f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:35.057872 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f10916-e5c0-4a07-9654-f926dd50a71f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:35.068466 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-2b775ea9-71f1-4394-a204-cd1b34269034 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:35.068466 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:35.068466 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:35.068466 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:35.068466 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:35.068466 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:35.068466 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:35.068466 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:35.068466 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:35.068466 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:35.068466 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:35.068466 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:35.068466 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:12:35.068466 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:12:35.068466 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:12:35.068466 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:12:35.069420 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:35.069420 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:35.069420 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:35.069420 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:35.069420 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:35.069420 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:35.069420 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:35.069420 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:35.069420 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:35.069420 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:35.069420 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:35.069420 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:35.069420 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:35.069420 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:35.069420 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:35.069420 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:35.069420 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:12:35.070357 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:12:35.070357 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:35.070357 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:35.071037 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 256/512] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:12:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:12:35.075030 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 257/513] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Oct 27 13:12:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:35.075818 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b775ea9-71f1-4394-a204-cd1b34269034 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:35.080586 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f10916-e5c0-4a07-9654-f926dd50a71f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:35.122898 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:35.123555 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:35.219175 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f10916-e5c0-4a07-9654-f926dd50a71f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:35.223513 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b775ea9-71f1-4394-a204-cd1b34269034 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:35.257605 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15678712-4314-4893-96ee-056cc48cab1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:35.258226 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15678712-4314-4893-96ee-056cc48cab1f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:35.258578 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15678712-4314-4893-96ee-056cc48cab1f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:35.258861 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15678712-4314-4893-96ee-056cc48cab1f None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:35.259603 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15678712-4314-4893-96ee-056cc48cab1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:35.259996 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15678712-4314-4893-96ee-056cc48cab1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:35.260721 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3895961-5f54-4d06-b805-43348b6bcfb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:35.261374 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15678712-4314-4893-96ee-056cc48cab1f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:35.261748 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3895961-5f54-4d06-b805-43348b6bcfb9 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:35.262195 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3895961-5f54-4d06-b805-43348b6bcfb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:35.262633 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3895961-5f54-4d06-b805-43348b6bcfb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:35.274138 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3895961-5f54-4d06-b805-43348b6bcfb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:35.275873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3895961-5f54-4d06-b805-43348b6bcfb9 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:35.277681 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 257/514] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:35.279405 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d86c6b-f5c2-4a12-8aed-63dc2cb8b7ee None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:35.279685 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d86c6b-f5c2-4a12-8aed-63dc2cb8b7ee None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:35.279953 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d86c6b-f5c2-4a12-8aed-63dc2cb8b7ee None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:35.281324 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 258/515] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:35.288443 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d86c6b-f5c2-4a12-8aed-63dc2cb8b7ee None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:35.297176 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-e3895961-5f54-4d06-b805-43348b6bcfb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:35.297176 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:35.297176 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:35.297176 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:35.297176 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:35.297176 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:35.297176 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:35.297176 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:35.297176 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:35.297176 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:35.297176 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:35.297176 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:35.297176 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:12:35.297176 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:12:35.297176 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:12:35.297176 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:12:35.298353 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:35.298353 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:35.298353 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:35.298353 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:35.298353 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:35.298353 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:35.298353 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:35.298353 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:35.298353 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:35.298353 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:35.298353 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:35.298353 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:35.298353 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:35.298353 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:35.298353 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:35.298353 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:35.298353 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:12:35.299214 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:12:35.299214 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:35.299214 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:35.301604 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 258/516] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:12:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:12:35.303069 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03015688-b37e-4fa1-a1c0-740f495909ec None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:35.303542 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03015688-b37e-4fa1-a1c0-740f495909ec None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:35.305943 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03015688-b37e-4fa1-a1c0-740f495909ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:35.330357 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-03015688-b37e-4fa1-a1c0-740f495909ec None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:35.331858 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-03015688-b37e-4fa1-a1c0-740f495909ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:35.390772 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:35.412242 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d86c6b-f5c2-4a12-8aed-63dc2cb8b7ee None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:35.420562 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 259/517] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:12:35.420562 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03015688-b37e-4fa1-a1c0-740f495909ec None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:35.423094 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:35.479747 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce223df2-0b9f-4ade-b887-3102a9d7a06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:35.480745 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce223df2-0b9f-4ade-b887-3102a9d7a06d None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:35.481218 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce223df2-0b9f-4ade-b887-3102a9d7a06d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:35.481751 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce223df2-0b9f-4ade-b887-3102a9d7a06d None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:35.482658 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce223df2-0b9f-4ade-b887-3102a9d7a06d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:35.484319 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce223df2-0b9f-4ade-b887-3102a9d7a06d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:35.520279 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03015688-b37e-4fa1-a1c0-740f495909ec None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:35.528132 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 259/518] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Oct 27 13:12:35 2022] POST /identity/v3/users => generated 254 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:12:35.558161 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e6ad8-4345-4f67-ae49-c21769002e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:35.558794 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e6ad8-4345-4f67-ae49-c21769002e8a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:35.559075 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e6ad8-4345-4f67-ae49-c21769002e8a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:35.559339 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e6ad8-4345-4f67-ae49-c21769002e8a None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:35.560002 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e6ad8-4345-4f67-ae49-c21769002e8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:35.560289 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e6ad8-4345-4f67-ae49-c21769002e8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:35.561706 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e6ad8-4345-4f67-ae49-c21769002e8a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:35.575562 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 260/519] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:35.581127 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce223df2-0b9f-4ade-b887-3102a9d7a06d None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:35.707703 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce223df2-0b9f-4ade-b887-3102a9d7a06d None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:35.751396 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36688a5b-7848-4feb-8b1a-486602ec20e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:35.752054 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36688a5b-7848-4feb-8b1a-486602ec20e0 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:35.752323 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36688a5b-7848-4feb-8b1a-486602ec20e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:35.752591 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36688a5b-7848-4feb-8b1a-486602ec20e0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:35.766048 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36688a5b-7848-4feb-8b1a-486602ec20e0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:35.767569 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36688a5b-7848-4feb-8b1a-486602ec20e0 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:35.775572 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:35.790673 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-36688a5b-7848-4feb-8b1a-486602ec20e0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 13:12:35.790673 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:35.790673 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:35.790673 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:35.790673 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:35.790673 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:35.790673 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:35.790673 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:35.790673 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:35.790673 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:35.790673 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:35.790673 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:35.790673 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 13:12:35.790673 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 13:12:35.790673 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 13:12:35.790673 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 13:12:35.791627 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:35.791627 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:35.791627 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 13:12:35.791627 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:12:35.791627 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 13:12:35.791627 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:12:35.791627 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:35.791627 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:35.791627 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:35.791627 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:35.791627 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:35.791627 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:35.791627 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:35.791627 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:35.791627 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:35.791627 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:35.791627 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:35.791627 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:35.792598 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:35.792598 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:35.792598 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 13:12:35.792598 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 13:12:35.792598 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 13:12:35.792598 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 13:12:35.792598 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 13:12:35.792598 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 13:12:35.792598 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 27 13:12:35.792598 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:35.792598 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 260/520] 10.222.0.52 () {56 vars in 1093 bytes} [Thu Oct 27 13:12:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:35.798352 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e6ad8-4345-4f67-ae49-c21769002e8a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:35.819151 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36688a5b-7848-4feb-8b1a-486602ec20e0 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:35.896366 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:35.942594 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e6ad8-4345-4f67-ae49-c21769002e8a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:35.952888 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36688a5b-7848-4feb-8b1a-486602ec20e0 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:35.983474 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7a92a-3cad-4813-882b-e6ab78269739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:35.984584 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7a92a-3cad-4813-882b-e6ab78269739 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:35.985355 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7a92a-3cad-4813-882b-e6ab78269739 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:35.986113 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7a92a-3cad-4813-882b-e6ab78269739 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:35.987039 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb7a92a-3cad-4813-882b-e6ab78269739 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:35.987655 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb7a92a-3cad-4813-882b-e6ab78269739 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:35.989284 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb7a92a-3cad-4813-882b-e6ab78269739 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:35.996473 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb49bb-e9db-4791-838a-2dc8a203803d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:35.997112 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb49bb-e9db-4791-838a-2dc8a203803d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:35.997389 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb49bb-e9db-4791-838a-2dc8a203803d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:35.997693 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb49bb-e9db-4791-838a-2dc8a203803d None admin] PATH_INFO: `/v3/services/network` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:35.998283 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb49bb-e9db-4791-838a-2dc8a203803d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:35.999651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb49bb-e9db-4791-838a-2dc8a203803d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:36.010858 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 261/521] 10.222.0.52 () {56 vars in 1133 bytes} [Thu Oct 27 13:12:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:36.015469 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-55fb49bb-e9db-4791-838a-2dc8a203803d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 13:12:36.015469 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:36.015469 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 13:12:36.015469 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 13:12:36.015469 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 13:12:36.015469 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 13:12:36.015469 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 13:12:36.015469 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:12:36.015469 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 13:12:36.015469 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:36.015469 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 13:12:36.015469 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:36.015469 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:36.015469 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:36.015469 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:36.015469 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:36.015469 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:36.016441 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:36.016441 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:36.016441 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:36.016441 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:36.016441 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:36.016441 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:36.016441 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 13:12:36.016441 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 13:12:36.016441 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 13:12:36.016441 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 13:12:36.016441 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:36.016441 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:36.016441 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:36.016441 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:36.016441 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:36.016441 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:36.017284 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:36.017284 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:36.017284 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:36.017284 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:36.017284 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:36.017284 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:36.017284 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:36.017284 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:36.017284 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:36.017284 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:36.017284 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 13:12:36.017284 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:12:36.017284 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 13:12:36.017284 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:36.017284 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 261/522] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Oct 27 13:12:35 2022] GET /identity/v3/services/network => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:36.019685 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7a92a-3cad-4813-882b-e6ab78269739 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:36.025954 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb49bb-e9db-4791-838a-2dc8a203803d None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:36.145892 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:36.154631 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7a92a-3cad-4813-882b-e6ab78269739 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:36.186263 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:36.199204 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ffc56-c6c2-4bfd-a165-2bb2bdf20dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:36.200217 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ffc56-c6c2-4bfd-a165-2bb2bdf20dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:36.200733 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ffc56-c6c2-4bfd-a165-2bb2bdf20dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:36.201201 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ffc56-c6c2-4bfd-a165-2bb2bdf20dd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:36.213189 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711ffc56-c6c2-4bfd-a165-2bb2bdf20dd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:36.215219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711ffc56-c6c2-4bfd-a165-2bb2bdf20dd9 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:36.230132 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb49bb-e9db-4791-838a-2dc8a203803d None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:36.232327 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-711ffc56-c6c2-4bfd-a165-2bb2bdf20dd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:36.232327 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:36.232327 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:36.232327 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:36.232327 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:36.232327 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:36.232327 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:36.232327 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:36.232327 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:36.232327 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:36.232327 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:36.232327 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:36.232327 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:12:36.232327 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:12:36.232327 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:12:36.232327 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:12:36.233278 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:36.233278 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:36.233278 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:36.233278 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:36.233278 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:36.233278 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:36.233278 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:36.233278 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:36.233278 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:36.233278 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:36.233278 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:36.233278 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:36.233278 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:36.233278 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:36.233278 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:36.233278 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:36.233278 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:12:36.234214 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:12:36.234214 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:36.234214 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:36.237104 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 262/523] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:12:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:36.243081 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ffc56-c6c2-4bfd-a165-2bb2bdf20dd9 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:36.299176 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af6b165-fad0-443e-b1d0-521fe11923bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:36.299825 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6b165-fad0-443e-b1d0-521fe11923bf None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:36.300240 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6b165-fad0-443e-b1d0-521fe11923bf None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:36.300579 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6b165-fad0-443e-b1d0-521fe11923bf None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:36.301220 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af6b165-fad0-443e-b1d0-521fe11923bf None admin] RBAC: Adding query filter params (name=network) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:36.301556 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af6b165-fad0-443e-b1d0-521fe11923bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:36.303105 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af6b165-fad0-443e-b1d0-521fe11923bf None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:36.308721 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 262/524] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Oct 27 13:12:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:36.313829 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8729f025-11d8-4fb7-b8ef-3d820d51b253 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:36.313829 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8729f025-11d8-4fb7-b8ef-3d820d51b253 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:36.313829 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8729f025-11d8-4fb7-b8ef-3d820d51b253 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:36.315893 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 263/525] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:36.316812 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8729f025-11d8-4fb7-b8ef-3d820d51b253 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:36.367772 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ffc56-c6c2-4bfd-a165-2bb2bdf20dd9 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:36.410659 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e15bb-99f9-4d15-9f07-811dbd3f6df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:36.411897 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e15bb-99f9-4d15-9f07-811dbd3f6df6 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:36.412372 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e15bb-99f9-4d15-9f07-811dbd3f6df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:36.412942 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e15bb-99f9-4d15-9f07-811dbd3f6df6 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:36.413920 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e15bb-99f9-4d15-9f07-811dbd3f6df6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:36.414222 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e15bb-99f9-4d15-9f07-811dbd3f6df6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:36.415588 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e15bb-99f9-4d15-9f07-811dbd3f6df6 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:36.429019 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8729f025-11d8-4fb7-b8ef-3d820d51b253 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:36.439046 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 263/526] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:36.440434 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758b462-6ba7-47a7-9272-e266b9d1ff23 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:36.441233 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758b462-6ba7-47a7-9272-e266b9d1ff23 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:36.441512 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758b462-6ba7-47a7-9272-e266b9d1ff23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:36.460467 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:36.466952 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-4758b462-6ba7-47a7-9272-e266b9d1ff23 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:36.468692 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4758b462-6ba7-47a7-9272-e266b9d1ff23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:36.470806 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38949e-4d48-4f9a-a93a-f0e953344103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:36.471597 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38949e-4d48-4f9a-a93a-f0e953344103 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:36.471955 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38949e-4d48-4f9a-a93a-f0e953344103 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:36.472365 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38949e-4d48-4f9a-a93a-f0e953344103 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:36.473958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38949e-4d48-4f9a-a93a-f0e953344103 None admin] RBAC: Adding query filter params (type=network) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:36.474268 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38949e-4d48-4f9a-a93a-f0e953344103 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:36.475713 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38949e-4d48-4f9a-a93a-f0e953344103 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:36.489217 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 264/527] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Oct 27 13:12:36 2022] GET /identity/v3/services?type=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:36.489217 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38949e-4d48-4f9a-a93a-f0e953344103 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:36.529949 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:36.611619 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 264/528] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:12:36.703030 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38949e-4d48-4f9a-a93a-f0e953344103 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:36.729740 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3459a7-bb0f-4703-8f0a-de5b6a0e00a6 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:36.730157 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3459a7-bb0f-4703-8f0a-de5b6a0e00a6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:36.730280 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3459a7-bb0f-4703-8f0a-de5b6a0e00a6 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:36.731930 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 265/529] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:36.737058 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20726119-51f2-4998-91f2-d0b808aa871f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:36.737317 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20726119-51f2-4998-91f2-d0b808aa871f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:36.737651 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20726119-51f2-4998-91f2-d0b808aa871f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:36.748950 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a0b36-335c-44f2-b1bf-b448517136f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:36.749627 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a0b36-335c-44f2-b1bf-b448517136f3 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:36.749914 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a0b36-335c-44f2-b1bf-b448517136f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:36.750186 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a0b36-335c-44f2-b1bf-b448517136f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:36.757502 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a0b36-335c-44f2-b1bf-b448517136f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:36.758651 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-20726119-51f2-4998-91f2-d0b808aa871f None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:36.759022 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a0b36-335c-44f2-b1bf-b448517136f3 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:36.760016 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-20726119-51f2-4998-91f2-d0b808aa871f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:36.770597 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-a50a0b36-335c-44f2-b1bf-b448517136f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:12:36.770597 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:36.770597 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:36.770597 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:36.770597 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:36.770597 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:36.770597 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:36.770597 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:36.770597 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:36.770597 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:36.770597 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:36.770597 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:36.770597 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 13:12:36.770597 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 13:12:36.770597 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 13:12:36.771690 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 13:12:36.771690 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:36.771690 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:36.771690 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:36.771690 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:36.771690 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:36.771690 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:36.771690 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:36.771690 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:36.771690 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:36.771690 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:36.771690 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:36.771690 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:36.771690 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:36.771690 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:36.771690 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:36.771690 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:36.772786 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 13:12:36.772786 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 13:12:36.772786 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 13:12:36.772786 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 13:12:36.772786 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 13:12:36.772786 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 13:12:36.772786 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:12:36.772786 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:36.772786 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 265/530] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Oct 27 13:12:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:36.777464 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a0b36-335c-44f2-b1bf-b448517136f3 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:36.851613 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:36.858621 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 266/531] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:12:36.918585 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a0b36-335c-44f2-b1bf-b448517136f3 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:36.961727 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c0868-c6f2-4541-b576-ee7548922549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:36.962332 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c0868-c6f2-4541-b576-ee7548922549 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:36.962571 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c0868-c6f2-4541-b576-ee7548922549 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:36.962842 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c0868-c6f2-4541-b576-ee7548922549 None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:36.963585 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c0868-c6f2-4541-b576-ee7548922549 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:36.963884 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c0868-c6f2-4541-b576-ee7548922549 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:36.965436 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c0868-c6f2-4541-b576-ee7548922549 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:36.967633 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20726119-51f2-4998-91f2-d0b808aa871f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:36.981943 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 266/532] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Oct 27 13:12:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:12:36.990600 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c0868-c6f2-4541-b576-ee7548922549 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:37.141939 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:37.144366 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20726119-51f2-4998-91f2-d0b808aa871f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:37.187472 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c0868-c6f2-4541-b576-ee7548922549 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:37.202450 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:37.210997 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808827c-181a-4bf1-9faa-3c0c738278b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:37.211644 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808827c-181a-4bf1-9faa-3c0c738278b2 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:37.211976 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808827c-181a-4bf1-9faa-3c0c738278b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:37.212185 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808827c-181a-4bf1-9faa-3c0c738278b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:37.224976 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6808827c-181a-4bf1-9faa-3c0c738278b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:12:37.229043 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02e66d-05c7-4163-9a39-cfdaff847a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:37.229812 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-6808827c-181a-4bf1-9faa-3c0c738278b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:12:37.229812 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:37.229812 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:37.229812 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:37.229812 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:37.229812 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:37.229812 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:37.229812 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:37.229812 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:37.229812 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:37.229812 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:37.229812 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:37.229812 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:12:37.229812 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:12:37.229812 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:12:37.229812 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:12:37.231000 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:12:37.231000 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:12:37.231000 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:12:37.231000 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:12:37.231000 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:37.231000 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:37.231000 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:37.231000 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:37.231000 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:37.231000 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:37.231000 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:37.231000 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:37.231000 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:37.231000 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:37.231000 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:37.231000 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:37.232034 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:37.232034 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:37.232034 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:37.232034 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:37.232034 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:12:37.232034 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:12:37.232034 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:12:37.232034 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:12:37.232034 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:12:37.232034 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:12:37.232034 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:12:37.232034 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:37.232034 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 267/533] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Oct 27 13:12:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:12:37.232034 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808827c-181a-4bf1-9faa-3c0c738278b2 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:37.237935 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02e66d-05c7-4163-9a39-cfdaff847a7f None admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:37.238596 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02e66d-05c7-4163-9a39-cfdaff847a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:37.239056 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02e66d-05c7-4163-9a39-cfdaff847a7f None admin] PATH_INFO: `/v3/projects/0be19dd5a0df4cf79fe2ec14d11521f0/users/719e4bf834d6490b96066e55a26fb159/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:37.241296 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02e66d-05c7-4163-9a39-cfdaff847a7f None admin] RBAC: Authorizing `identity:create_grant(project_id=0be19dd5a0df4cf79fe2ec14d11521f0, user_id=719e4bf834d6490b96066e55a26fb159, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:37.243079 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02e66d-05c7-4163-9a39-cfdaff847a7f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:37.259257 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 267/534] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Oct 27 13:12:36 2022] PUT /identity/v3/projects/0be19dd5a0df4cf79fe2ec14d11521f0/users/719e4bf834d6490b96066e55a26fb159/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:12:37.260220 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02e66d-05c7-4163-9a39-cfdaff847a7f None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:37.377413 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808827c-181a-4bf1-9faa-3c0c738278b2 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:37.419107 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17f0ec-1989-42e1-aff5-51cb9cb7dbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:37.420751 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17f0ec-1989-42e1-aff5-51cb9cb7dbab None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:37.421257 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17f0ec-1989-42e1-aff5-51cb9cb7dbab None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:37.421779 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17f0ec-1989-42e1-aff5-51cb9cb7dbab None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:37.422699 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab17f0ec-1989-42e1-aff5-51cb9cb7dbab None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:37.424330 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab17f0ec-1989-42e1-aff5-51cb9cb7dbab None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:37.447306 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 268/535] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Oct 27 13:12:37 2022] POST /identity/v3/services => generated 251 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:12:37.486614 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02e66d-05c7-4163-9a39-cfdaff847a7f None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:37.532280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16215eb6-85a7-4be4-94d4-f25ff04ad108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:37.532903 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16215eb6-85a7-4be4-94d4-f25ff04ad108 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:37.533176 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16215eb6-85a7-4be4-94d4-f25ff04ad108 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:37.533452 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16215eb6-85a7-4be4-94d4-f25ff04ad108 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:37.534150 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16215eb6-85a7-4be4-94d4-f25ff04ad108 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:37.534558 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16215eb6-85a7-4be4-94d4-f25ff04ad108 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:37.536082 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16215eb6-85a7-4be4-94d4-f25ff04ad108 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:37.545671 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 268/536] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Oct 27 13:12:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:37.551566 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17f0ec-1989-42e1-aff5-51cb9cb7dbab None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:37.579424 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:37.685749 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17f0ec-1989-42e1-aff5-51cb9cb7dbab None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:37.722239 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe16359-a124-4523-8947-fd412ea15224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:37.723394 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe16359-a124-4523-8947-fd412ea15224 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:37.723891 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe16359-a124-4523-8947-fd412ea15224 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:37.724398 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe16359-a124-4523-8947-fd412ea15224 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:37.736780 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe16359-a124-4523-8947-fd412ea15224 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:37.738752 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe16359-a124-4523-8947-fd412ea15224 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:37.754846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-fbe16359-a124-4523-8947-fd412ea15224 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:37.754846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:37.754846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:37.754846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:37.754846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:37.754846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:37.754846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:37.754846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:37.754846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:37.754846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:37.754846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:37.754846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:37.754846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:12:37.754846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:12:37.754846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:12:37.754846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:12:37.755844 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:37.755844 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:37.755844 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:37.755844 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:37.755844 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:37.755844 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:37.755844 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:37.755844 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:37.755844 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:37.755844 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:37.755844 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:37.755844 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:37.755844 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:37.755844 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:37.755844 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:37.755844 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:37.755844 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:12:37.756819 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:12:37.756819 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:37.756819 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:37.759247 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 269/537] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:12:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:37.767490 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16215eb6-85a7-4be4-94d4-f25ff04ad108 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:37.809896 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:37.891292 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16215eb6-85a7-4be4-94d4-f25ff04ad108 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:37.927804 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c11af-7262-46f8-8cbe-5caa106d15ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:37.928420 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c11af-7262-46f8-8cbe-5caa106d15ac None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:37.928696 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c11af-7262-46f8-8cbe-5caa106d15ac None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:37.928952 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c11af-7262-46f8-8cbe-5caa106d15ac None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:37.929618 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1c11af-7262-46f8-8cbe-5caa106d15ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:37.929920 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1c11af-7262-46f8-8cbe-5caa106d15ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:37.931292 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1c11af-7262-46f8-8cbe-5caa106d15ac None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:37.945504 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 269/538] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:37.950798 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe16359-a124-4523-8947-fd412ea15224 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:38.042898 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:38.094935 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe16359-a124-4523-8947-fd412ea15224 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:38.141335 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342b2bf-9ecd-43c1-a4cd-a5b4122d429b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:38.142390 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342b2bf-9ecd-43c1-a4cd-a5b4122d429b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:38.142879 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342b2bf-9ecd-43c1-a4cd-a5b4122d429b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:38.143345 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342b2bf-9ecd-43c1-a4cd-a5b4122d429b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:38.156107 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4342b2bf-9ecd-43c1-a4cd-a5b4122d429b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:38.157885 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4342b2bf-9ecd-43c1-a4cd-a5b4122d429b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:38.172583 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-4342b2bf-9ecd-43c1-a4cd-a5b4122d429b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 27 13:12:38.172583 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:38.172583 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:38.172583 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:38.172583 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:38.172583 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:38.172583 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:38.172583 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:38.172583 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:38.172583 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:38.172583 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:38.172583 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:38.172583 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 13:12:38.172583 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 13:12:38.172583 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 13:12:38.172583 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 13:12:38.175339 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:38.175339 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:38.175339 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 13:12:38.175339 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:12:38.175339 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 13:12:38.175339 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:12:38.175339 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:38.175339 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:38.175339 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:38.175339 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:38.175339 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:38.175339 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:38.175339 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:38.175339 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:38.175339 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:38.175339 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:38.175339 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:38.175339 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:38.176341 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:38.176341 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:38.176341 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 13:12:38.176341 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 13:12:38.176341 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 13:12:38.176341 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 13:12:38.176341 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 13:12:38.176341 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 13:12:38.176341 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 27 13:12:38.176341 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:38.178704 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 270/539] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Oct 27 13:12:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:38.186663 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c11af-7262-46f8-8cbe-5caa106d15ac None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:38.311953 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:38.318220 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bec70-a899-4dac-a55d-c5dde3531a85 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:38.318773 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bec70-a899-4dac-a55d-c5dde3531a85 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:38.319265 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bec70-a899-4dac-a55d-c5dde3531a85 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:38.321687 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 271/540] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:38.324782 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c11af-7262-46f8-8cbe-5caa106d15ac None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:38.326652 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306497b-fb6f-4ef7-b47c-5d6c7da3def6 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:38.327149 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306497b-fb6f-4ef7-b47c-5d6c7da3def6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:38.327479 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306497b-fb6f-4ef7-b47c-5d6c7da3def6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:38.358309 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-b306497b-fb6f-4ef7-b47c-5d6c7da3def6 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:38.363756 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b306497b-fb6f-4ef7-b47c-5d6c7da3def6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:38.392219 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f7378-cc03-459a-b70e-a36995ade622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:38.393382 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f7378-cc03-459a-b70e-a36995ade622 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:38.394710 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f7378-cc03-459a-b70e-a36995ade622 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:38.395819 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f7378-cc03-459a-b70e-a36995ade622 None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:38.396745 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764f7378-cc03-459a-b70e-a36995ade622 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:38.397410 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764f7378-cc03-459a-b70e-a36995ade622 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:38.400943 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764f7378-cc03-459a-b70e-a36995ade622 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:38.437067 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 270/541] 10.222.0.52 () {56 vars in 1135 bytes} [Thu Oct 27 13:12:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:38.443208 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f7378-cc03-459a-b70e-a36995ade622 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:38.480682 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 272/542] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:38 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 13:12:38.548664 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f7378-cc03-459a-b70e-a36995ade622 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:38.605181 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6ae4d-9257-45bf-a186-e076654809c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:38.606213 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6ae4d-9257-45bf-a186-e076654809c6 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:38.606670 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6ae4d-9257-45bf-a186-e076654809c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:38.607112 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6ae4d-9257-45bf-a186-e076654809c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:38.624536 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e6ae4d-9257-45bf-a186-e076654809c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:38.626375 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e6ae4d-9257-45bf-a186-e076654809c6 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:38.634293 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:38.646251 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-02e6ae4d-9257-45bf-a186-e076654809c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:38.646251 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:38.646251 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:38.646251 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:38.646251 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:38.646251 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:38.646251 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:38.646251 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:38.646251 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:38.646251 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:38.646251 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:38.646251 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:38.646251 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:12:38.646251 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:12:38.646251 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:12:38.646251 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:12:38.647199 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:38.647199 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:38.647199 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:38.647199 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:38.647199 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:38.647199 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:38.647199 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:38.647199 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:38.647199 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:38.647199 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:38.647199 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:38.647199 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:38.647199 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:38.647199 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:38.647199 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:38.647199 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:38.647199 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:12:38.648117 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:12:38.648117 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:38.648117 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:38.649949 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 271/543] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:12:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:38.655187 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306497b-fb6f-4ef7-b47c-5d6c7da3def6 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:38.741945 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:38.771190 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306497b-fb6f-4ef7-b47c-5d6c7da3def6 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:38.806943 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f227e37-02fd-4773-b7dc-af25a2331bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:38.807878 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f227e37-02fd-4773-b7dc-af25a2331bf7 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:38.808460 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f227e37-02fd-4773-b7dc-af25a2331bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:38.808730 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f227e37-02fd-4773-b7dc-af25a2331bf7 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:38.809372 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f227e37-02fd-4773-b7dc-af25a2331bf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:38.809707 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f227e37-02fd-4773-b7dc-af25a2331bf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:38.811079 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f227e37-02fd-4773-b7dc-af25a2331bf7 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:38.823452 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 273/544] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:38.830681 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6ae4d-9257-45bf-a186-e076654809c6 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:38.969836 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f227e37-02fd-4773-b7dc-af25a2331bf7 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:38.977572 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6ae4d-9257-45bf-a186-e076654809c6 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:39.012651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a3880-7b68-48dc-96f7-c9e4172d68d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:39.013303 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a3880-7b68-48dc-96f7-c9e4172d68d3 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:39.013684 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a3880-7b68-48dc-96f7-c9e4172d68d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:39.013963 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a3880-7b68-48dc-96f7-c9e4172d68d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:39.021651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81a3880-7b68-48dc-96f7-c9e4172d68d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:39.023194 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81a3880-7b68-48dc-96f7-c9e4172d68d3 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:39.035516 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-e81a3880-7b68-48dc-96f7-c9e4172d68d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:12:39.035516 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:39.035516 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:39.035516 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:39.035516 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:39.035516 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:39.035516 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:39.035516 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:39.035516 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:39.035516 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:39.035516 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:39.035516 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:39.035516 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 13:12:39.035516 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 13:12:39.035516 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 13:12:39.036484 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 13:12:39.036484 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:39.036484 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:39.036484 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:39.036484 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:39.036484 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:39.036484 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:39.036484 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:39.036484 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:39.036484 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:39.036484 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:39.036484 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:39.036484 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:39.036484 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:39.036484 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:39.036484 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:39.036484 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:39.037824 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 13:12:39.037824 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 13:12:39.037824 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 13:12:39.037824 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 13:12:39.037824 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 13:12:39.037824 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 13:12:39.037824 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:12:39.037824 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:39.037824 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 272/545] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Oct 27 13:12:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:39.045564 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a3880-7b68-48dc-96f7-c9e4172d68d3 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:39.105578 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:39.170401 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a3880-7b68-48dc-96f7-c9e4172d68d3 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:39.182032 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f227e37-02fd-4773-b7dc-af25a2331bf7 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:39.200659 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:39.221421 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18339b27-647c-47eb-80c6-f66253d40d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:39.221929 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e24f7-3d16-451c-856f-65db7671a165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:39.222501 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18339b27-647c-47eb-80c6-f66253d40d25 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:39.222501 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18339b27-647c-47eb-80c6-f66253d40d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:39.222679 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18339b27-647c-47eb-80c6-f66253d40d25 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:39.223429 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e24f7-3d16-451c-856f-65db7671a165 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:39.223917 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e24f7-3d16-451c-856f-65db7671a165 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:39.224616 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e24f7-3d16-451c-856f-65db7671a165 None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:39.225947 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e24f7-3d16-451c-856f-65db7671a165 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:39.226395 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e24f7-3d16-451c-856f-65db7671a165 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:39.228312 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e24f7-3d16-451c-856f-65db7671a165 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:39.234245 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18339b27-647c-47eb-80c6-f66253d40d25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:12:39.241443 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-18339b27-647c-47eb-80c6-f66253d40d25 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 13:12:39.241443 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:39.241443 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:39.241443 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:39.241443 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:39.241443 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:39.241443 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:39.241443 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:39.241443 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:39.241443 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:39.241443 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:39.241443 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:39.241443 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:12:39.241443 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:12:39.241443 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:12:39.241443 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:12:39.242466 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:12:39.242466 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:12:39.242466 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:12:39.242466 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:12:39.242466 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:39.242466 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:39.242466 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:39.242466 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:39.242466 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:39.242466 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:39.242466 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:39.242466 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:39.242466 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:39.242466 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:39.242466 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:39.242466 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:39.243302 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:39.243302 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:39.243302 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:39.243302 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:39.243302 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:12:39.243302 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:12:39.243302 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:12:39.243302 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:12:39.243302 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:12:39.243302 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:12:39.243302 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 13:12:39.243302 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:39.243302 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 274/546] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Oct 27 13:12:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:39.244080 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42049ce9-f230-4e20-88ef-594a19d70f9c None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:39.244641 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42049ce9-f230-4e20-88ef-594a19d70f9c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:39.244641 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42049ce9-f230-4e20-88ef-594a19d70f9c None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:39.246228 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 275/547] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:39.246429 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 273/548] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Oct 27 13:12:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:12:39.252124 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42049ce9-f230-4e20-88ef-594a19d70f9c None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:39.253650 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447077a-5015-4927-b0f0-8fa33e0f835c None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:39.253937 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447077a-5015-4927-b0f0-8fa33e0f835c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:39.254207 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447077a-5015-4927-b0f0-8fa33e0f835c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:39.280868 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-5447077a-5015-4927-b0f0-8fa33e0f835c None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:39.282650 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5447077a-5015-4927-b0f0-8fa33e0f835c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:39.376484 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 274/549] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:39 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 13:12:39.376484 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447077a-5015-4927-b0f0-8fa33e0f835c None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:39.378638 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42049ce9-f230-4e20-88ef-594a19d70f9c None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:39.429667 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:39.439691 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4bdf75-6802-42f0-ab68-c856b65369f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:39.440867 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4bdf75-6802-42f0-ab68-c856b65369f0 None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:39.441388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4bdf75-6802-42f0-ab68-c856b65369f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:39.441829 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4bdf75-6802-42f0-ab68-c856b65369f0 None admin] PATH_INFO: `/v3/projects/0be19dd5a0df4cf79fe2ec14d11521f0/users/62769acbfca242d6a0b0fe5a6b8bc108/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:39.447770 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4bdf75-6802-42f0-ab68-c856b65369f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=0be19dd5a0df4cf79fe2ec14d11521f0, user_id=62769acbfca242d6a0b0fe5a6b8bc108, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:39.449362 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4bdf75-6802-42f0-ab68-c856b65369f0 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:39.475690 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 276/550] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Oct 27 13:12:39 2022] PUT /identity/v3/projects/0be19dd5a0df4cf79fe2ec14d11521f0/users/62769acbfca242d6a0b0fe5a6b8bc108/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:12:39.501616 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447077a-5015-4927-b0f0-8fa33e0f835c None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:39.549119 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae7fe4-c1f7-465c-aa34-c9249671d437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:39.549817 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae7fe4-c1f7-465c-aa34-c9249671d437 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:39.550127 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae7fe4-c1f7-465c-aa34-c9249671d437 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:39.550442 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae7fe4-c1f7-465c-aa34-c9249671d437 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:39.551122 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae7fe4-c1f7-465c-aa34-c9249671d437 None admin] RBAC: Adding query filter params (name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:39.551419 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae7fe4-c1f7-465c-aa34-c9249671d437 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:39.552802 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae7fe4-c1f7-465c-aa34-c9249671d437 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:39.566070 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 275/551] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Oct 27 13:12:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:39.572305 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4bdf75-6802-42f0-ab68-c856b65369f0 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:39.625189 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:39.719261 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4bdf75-6802-42f0-ab68-c856b65369f0 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:39.759173 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64a93b-37b3-4a5b-857a-7501ce99489b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:39.760141 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64a93b-37b3-4a5b-857a-7501ce99489b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:39.760686 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64a93b-37b3-4a5b-857a-7501ce99489b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:39.761165 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64a93b-37b3-4a5b-857a-7501ce99489b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:39.768904 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae7fe4-c1f7-465c-aa34-c9249671d437 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:39.779576 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c64a93b-37b3-4a5b-857a-7501ce99489b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:39.781064 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c64a93b-37b3-4a5b-857a-7501ce99489b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:39.810560 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-4c64a93b-37b3-4a5b-857a-7501ce99489b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:39.810560 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:39.810560 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:39.810560 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:39.810560 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:39.810560 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:39.810560 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:39.810560 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:39.810560 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:39.810560 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:39.810560 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:39.810560 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:39.810560 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:12:39.810560 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:12:39.810560 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:12:39.810560 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:12:39.811540 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:39.811540 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:39.811540 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:39.811540 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:39.811540 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:39.811540 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:39.811540 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:39.811540 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:39.811540 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:39.811540 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:39.811540 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:39.811540 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:39.811540 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:39.811540 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:39.811540 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:39.811540 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:39.811540 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:12:39.812824 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:12:39.812824 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:39.812824 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:39.812824 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 277/552] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:12:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:39.819512 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64a93b-37b3-4a5b-857a-7501ce99489b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:39.953184 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae7fe4-c1f7-465c-aa34-c9249671d437 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:39.965827 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:40.003385 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:40.014043 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b0da0-daef-4bcb-b49f-a9d1103bb437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:40.014682 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b0da0-daef-4bcb-b49f-a9d1103bb437 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:40.015023 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b0da0-daef-4bcb-b49f-a9d1103bb437 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:40.015130 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64a93b-37b3-4a5b-857a-7501ce99489b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:40.015413 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b0da0-daef-4bcb-b49f-a9d1103bb437 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:40.016137 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b0da0-daef-4bcb-b49f-a9d1103bb437 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:40.017819 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b0da0-daef-4bcb-b49f-a9d1103bb437 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:40.042024 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 276/553] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Oct 27 13:12:39 2022] POST /identity/v3/services => generated 240 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:12:40.043442 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da93278-8727-425c-9465-a63763eb4a5c None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:40.043848 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da93278-8727-425c-9465-a63763eb4a5c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:40.044124 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da93278-8727-425c-9465-a63763eb4a5c None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:40.045802 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 277/554] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:40.063641 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7067c-84ae-4ba0-bfda-034a713994fc None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:40.064002 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7067c-84ae-4ba0-bfda-034a713994fc None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:40.066231 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7067c-84ae-4ba0-bfda-034a713994fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:40.067460 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be382b-62f3-45a9-af6e-de67e0c7a661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:40.068092 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be382b-62f3-45a9-af6e-de67e0c7a661 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:40.068371 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be382b-62f3-45a9-af6e-de67e0c7a661 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:40.068647 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be382b-62f3-45a9-af6e-de67e0c7a661 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:40.069513 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be382b-62f3-45a9-af6e-de67e0c7a661 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:40.069847 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be382b-62f3-45a9-af6e-de67e0c7a661 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:40.071401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be382b-62f3-45a9-af6e-de67e0c7a661 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:40.085401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 278/555] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:40.091183 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be382b-62f3-45a9-af6e-de67e0c7a661 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:40.103294 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-bca7067c-84ae-4ba0-bfda-034a713994fc None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:40.108517 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-bca7067c-84ae-4ba0-bfda-034a713994fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:40.266350 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 278/556] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 13:12:40.267183 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be382b-62f3-45a9-af6e-de67e0c7a661 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:40.272069 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a280487-9906-4f5c-98f5-0c3266c4960f None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:40.272360 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a280487-9906-4f5c-98f5-0c3266c4960f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:40.272635 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a280487-9906-4f5c-98f5-0c3266c4960f None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:40.274280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 279/557] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 13:12:40.279349 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f403bc-b0e6-4359-8ca3-d0e12fc091f4 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:40.279631 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f403bc-b0e6-4359-8ca3-d0e12fc091f4 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:40.279905 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f403bc-b0e6-4359-8ca3-d0e12fc091f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:40.298712 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-11f403bc-b0e6-4359-8ca3-d0e12fc091f4 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:40.299921 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-11f403bc-b0e6-4359-8ca3-d0e12fc091f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:40.305709 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0a27f-67b7-4861-9d05-c53104e06c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:40.306651 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0a27f-67b7-4861-9d05-c53104e06c77 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:40.307022 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0a27f-67b7-4861-9d05-c53104e06c77 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:40.307715 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0a27f-67b7-4861-9d05-c53104e06c77 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:40.317122 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a0a27f-67b7-4861-9d05-c53104e06c77 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:40.319010 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a0a27f-67b7-4861-9d05-c53104e06c77 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:40.332025 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-21a0a27f-67b7-4861-9d05-c53104e06c77 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 13:12:40.332025 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:40.332025 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:40.332025 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:40.332025 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:40.332025 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:40.332025 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:40.332025 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:40.332025 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:40.332025 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:40.332025 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:40.332025 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:40.332025 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 13:12:40.332025 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 13:12:40.332025 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 13:12:40.332025 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 13:12:40.332957 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:40.332957 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:40.332957 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 13:12:40.332957 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:12:40.332957 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 13:12:40.332957 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:12:40.332957 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:40.332957 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:40.332957 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:40.332957 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:40.332957 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:40.332957 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:40.332957 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:40.332957 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:40.332957 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:40.332957 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:40.332957 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:40.332957 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:40.334419 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:40.334419 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:40.334419 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 13:12:40.334419 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 13:12:40.334419 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 13:12:40.334419 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 13:12:40.334419 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 13:12:40.334419 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 13:12:40.334419 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 13:12:40.334419 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:40.334419 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 279/558] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Oct 27 13:12:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:12:40.340986 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0a27f-67b7-4861-9d05-c53104e06c77 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:40.368459 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:40.381510 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 280/559] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 13:12:40.453421 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0a27f-67b7-4861-9d05-c53104e06c77 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:40.488903 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd15c9-90a2-42ee-885e-b42f071c66ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:40.489925 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd15c9-90a2-42ee-885e-b42f071c66ff None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:40.490384 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd15c9-90a2-42ee-885e-b42f071c66ff None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:40.490848 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd15c9-90a2-42ee-885e-b42f071c66ff None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:40.491758 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd15c9-90a2-42ee-885e-b42f071c66ff None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:40.492238 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd15c9-90a2-42ee-885e-b42f071c66ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:40.493923 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd15c9-90a2-42ee-885e-b42f071c66ff None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:40.513611 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 280/560] 10.222.0.52 () {56 vars in 1149 bytes} [Thu Oct 27 13:12:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:40.519235 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f403bc-b0e6-4359-8ca3-d0e12fc091f4 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:40.568282 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:40.617768 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd15c9-90a2-42ee-885e-b42f071c66ff None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:40.665607 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f403bc-b0e6-4359-8ca3-d0e12fc091f4 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:40.718969 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:40.726584 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c8ab4-7281-42aa-a824-7cee169d28df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:40.727678 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c8ab4-7281-42aa-a824-7cee169d28df None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:40.728123 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c8ab4-7281-42aa-a824-7cee169d28df None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:40.729375 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c8ab4-7281-42aa-a824-7cee169d28df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:40.743359 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0c8ab4-7281-42aa-a824-7cee169d28df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:40.745403 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0c8ab4-7281-42aa-a824-7cee169d28df None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:40.760122 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd15c9-90a2-42ee-885e-b42f071c66ff None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:40.765565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-af0c8ab4-7281-42aa-a824-7cee169d28df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:40.765565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:40.765565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:40.765565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:40.765565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:40.765565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:40.765565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:40.765565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:40.765565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:40.765565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:40.765565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:40.765565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:40.765565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:12:40.765565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:12:40.765565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:12:40.765565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:12:40.766752 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:40.766752 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:40.766752 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:40.766752 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:40.766752 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:40.766752 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:40.766752 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:40.766752 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:40.766752 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:40.766752 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:40.766752 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:40.766752 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:40.766752 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:40.766752 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:40.766752 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:40.766752 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:40.766752 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:12:40.767889 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:12:40.767889 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:40.767889 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:40.774877 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 281/561] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:12:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:12:40.774877 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c8ab4-7281-42aa-a824-7cee169d28df None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:40.815739 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bfcb89-cf6a-4114-915e-82909e6c0a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:40.816574 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfcb89-cf6a-4114-915e-82909e6c0a5d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:40.816686 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfcb89-cf6a-4114-915e-82909e6c0a5d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:40.816877 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfcb89-cf6a-4114-915e-82909e6c0a5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:40.827433 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bfcb89-cf6a-4114-915e-82909e6c0a5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:12:40.832209 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-79bfcb89-cf6a-4114-915e-82909e6c0a5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:12:40.832209 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:40.832209 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:40.832209 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:40.832209 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:40.832209 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:40.832209 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:40.832209 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:40.832209 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:40.832209 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:40.832209 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:40.832209 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:40.832209 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:12:40.832209 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:12:40.832209 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:12:40.832209 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:12:40.833234 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:12:40.833234 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:12:40.833234 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:12:40.833234 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:12:40.833234 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:40.833234 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:40.833234 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:40.833234 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:40.833234 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:40.833234 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:40.833234 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:40.833234 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:40.833234 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:40.833234 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:40.833234 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:40.833234 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:40.834119 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:40.834119 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:40.834119 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:40.834119 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:40.834119 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:12:40.834119 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:12:40.834119 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:12:40.834119 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:12:40.834119 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:12:40.834119 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:12:40.834119 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:12:40.834119 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:40.834119 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 281/562] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Oct 27 13:12:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:12:40.834805 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bfcb89-cf6a-4114-915e-82909e6c0a5d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:40.889463 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:40.914525 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c8ab4-7281-42aa-a824-7cee169d28df None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:40.958357 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3b009-5d62-4ba9-a149-087eba4f25ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:40.959609 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3b009-5d62-4ba9-a149-087eba4f25ac None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:40.960443 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3b009-5d62-4ba9-a149-087eba4f25ac None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:40.961144 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3b009-5d62-4ba9-a149-087eba4f25ac None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:40.961959 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3b009-5d62-4ba9-a149-087eba4f25ac None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:40.962793 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bfcb89-cf6a-4114-915e-82909e6c0a5d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:40.963796 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3b009-5d62-4ba9-a149-087eba4f25ac None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:40.976146 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-0cf3b009-5d62-4ba9-a149-087eba4f25ac None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 13:12:40.976146 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:40.976146 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 13:12:40.976146 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 13:12:40.976146 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 13:12:40.976146 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 13:12:40.976146 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 13:12:40.976146 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:12:40.976146 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 13:12:40.976146 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:40.976146 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 13:12:40.976146 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:40.976146 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:40.976146 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:40.976146 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:40.976146 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:40.976146 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:40.977188 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:40.977188 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:40.977188 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:40.977188 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:40.977188 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:40.977188 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:40.977188 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 13:12:40.977188 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 13:12:40.977188 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 13:12:40.977188 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 13:12:40.977188 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:40.977188 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:40.977188 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:40.977188 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:40.977188 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:40.977188 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:40.978037 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:40.978037 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:40.978037 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:40.978037 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:40.978037 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:40.978037 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:40.978037 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:40.978037 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:40.978037 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:40.978037 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:40.978037 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 13:12:40.978037 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:12:40.978037 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 13:12:40.978037 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:40.982321 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 282/563] 10.222.0.52 () {56 vars in 1129 bytes} [Thu Oct 27 13:12:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:40.983281 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3b009-5d62-4ba9-a149-087eba4f25ac None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:40.994151 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:41.006658 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3343cef-15c8-4332-9331-0c493208ddfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:41.008079 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3343cef-15c8-4332-9331-0c493208ddfa None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:41.008582 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3343cef-15c8-4332-9331-0c493208ddfa None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:41.009049 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3343cef-15c8-4332-9331-0c493208ddfa None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:41.010132 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3343cef-15c8-4332-9331-0c493208ddfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:41.010985 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3343cef-15c8-4332-9331-0c493208ddfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:41.012656 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3343cef-15c8-4332-9331-0c493208ddfa None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:41.026255 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 282/564] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:41.027517 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3343cef-15c8-4332-9331-0c493208ddfa None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:41.090788 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3b009-5d62-4ba9-a149-087eba4f25ac None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:41.125841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc9ca1-d0e4-4d93-aa94-6552c01c21da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:41.126300 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc9ca1-d0e4-4d93-aa94-6552c01c21da None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:41.126578 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc9ca1-d0e4-4d93-aa94-6552c01c21da None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:41.126894 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc9ca1-d0e4-4d93-aa94-6552c01c21da None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:41.127567 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bc9ca1-d0e4-4d93-aa94-6552c01c21da None admin] RBAC: Adding query filter params (name=admin) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:41.127915 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bc9ca1-d0e4-4d93-aa94-6552c01c21da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:41.129320 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bc9ca1-d0e4-4d93-aa94-6552c01c21da None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:41.136574 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3343cef-15c8-4332-9331-0c493208ddfa None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:41.141882 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 283/565] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Oct 27 13:12:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:41.142747 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc9ca1-d0e4-4d93-aa94-6552c01c21da None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:41.155082 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:41.176399 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329079c8-0484-4cce-ba96-dcc2856daf8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:41.177480 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329079c8-0484-4cce-ba96-dcc2856daf8b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:41.177984 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329079c8-0484-4cce-ba96-dcc2856daf8b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:41.178448 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329079c8-0484-4cce-ba96-dcc2856daf8b None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:41.179282 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329079c8-0484-4cce-ba96-dcc2856daf8b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:41.179778 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329079c8-0484-4cce-ba96-dcc2856daf8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:41.181498 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329079c8-0484-4cce-ba96-dcc2856daf8b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:41.187332 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 283/566] 10.222.0.52 () {56 vars in 1124 bytes} [Thu Oct 27 13:12:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:41.188368 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329079c8-0484-4cce-ba96-dcc2856daf8b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:41.255592 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:41.273802 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc9ca1-d0e4-4d93-aa94-6552c01c21da None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:41.315709 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042dd65-87f5-487e-9a3f-9bcee95a5fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:41.316832 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042dd65-87f5-487e-9a3f-9bcee95a5fe5 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:41.317327 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042dd65-87f5-487e-9a3f-9bcee95a5fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:41.318090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042dd65-87f5-487e-9a3f-9bcee95a5fe5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:41.324174 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329079c8-0484-4cce-ba96-dcc2856daf8b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:41.327858 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042dd65-87f5-487e-9a3f-9bcee95a5fe5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:41.329556 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042dd65-87f5-487e-9a3f-9bcee95a5fe5 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:41.344006 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-c042dd65-87f5-487e-9a3f-9bcee95a5fe5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:12:41.344006 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:41.344006 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:41.344006 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:41.344006 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:41.344006 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:41.344006 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:41.344006 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:41.344006 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:41.344006 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:41.344006 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:41.344006 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:41.344006 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 13:12:41.344006 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 13:12:41.344006 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 13:12:41.344923 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 13:12:41.344923 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:41.344923 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:41.344923 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:41.344923 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:41.344923 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:41.344923 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:41.344923 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:41.344923 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:41.344923 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:41.344923 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:41.344923 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:41.344923 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:41.344923 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:41.344923 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:41.344923 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:41.344923 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:41.345851 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 13:12:41.345851 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 13:12:41.345851 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 13:12:41.345851 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 13:12:41.345851 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 13:12:41.345851 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 13:12:41.345851 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:12:41.345851 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:41.348577 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 284/567] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Oct 27 13:12:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:41.349775 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042dd65-87f5-487e-9a3f-9bcee95a5fe5 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:41.365556 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98cabb8-273b-499c-9c5a-58433e26f4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:41.366453 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98cabb8-273b-499c-9c5a-58433e26f4eb None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:41.366895 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98cabb8-273b-499c-9c5a-58433e26f4eb None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:41.367308 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98cabb8-273b-499c-9c5a-58433e26f4eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:41.379574 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98cabb8-273b-499c-9c5a-58433e26f4eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:41.381300 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98cabb8-273b-499c-9c5a-58433e26f4eb None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:41.396939 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-f98cabb8-273b-499c-9c5a-58433e26f4eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:41.396939 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:41.396939 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:41.396939 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:41.396939 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:41.396939 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:41.396939 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:41.396939 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:41.396939 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:41.396939 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:41.396939 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:41.396939 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:41.396939 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:12:41.396939 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:12:41.396939 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:12:41.396939 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:12:41.398081 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:41.398081 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:41.398081 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:41.398081 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:41.398081 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:41.398081 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:41.398081 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:41.398081 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:41.398081 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:41.398081 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:41.398081 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:41.398081 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:41.398081 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:41.398081 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:41.398081 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:41.398081 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:41.398081 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:12:41.399320 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:12:41.399320 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:41.399320 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:41.401208 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 284/568] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:12:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:41.402148 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98cabb8-273b-499c-9c5a-58433e26f4eb None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:41.434260 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:41.478695 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042dd65-87f5-487e-9a3f-9bcee95a5fe5 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:41.521658 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30620d3-c693-4841-b792-16367feac301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:41.522368 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30620d3-c693-4841-b792-16367feac301 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:41.522745 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30620d3-c693-4841-b792-16367feac301 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:41.523107 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30620d3-c693-4841-b792-16367feac301 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:41.523927 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30620d3-c693-4841-b792-16367feac301 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:41.524609 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:41.525441 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30620d3-c693-4841-b792-16367feac301 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:41.527088 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30620d3-c693-4841-b792-16367feac301 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:41.528088 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98cabb8-273b-499c-9c5a-58433e26f4eb None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:41.538558 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 285/569] 10.222.0.52 () {56 vars in 1124 bytes} [Thu Oct 27 13:12:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:41.539756 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30620d3-c693-4841-b792-16367feac301 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:41.564641 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8d41a-61eb-4f4a-bda2-cc3082c56096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:41.565524 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8d41a-61eb-4f4a-bda2-cc3082c56096 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:41.566095 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8d41a-61eb-4f4a-bda2-cc3082c56096 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:41.566563 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8d41a-61eb-4f4a-bda2-cc3082c56096 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:41.567484 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8d41a-61eb-4f4a-bda2-cc3082c56096 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:41.567995 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8d41a-61eb-4f4a-bda2-cc3082c56096 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:41.569681 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8d41a-61eb-4f4a-bda2-cc3082c56096 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:41.583057 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 285/570] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Oct 27 13:12:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:41.584194 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8d41a-61eb-4f4a-bda2-cc3082c56096 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:41.652753 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30620d3-c693-4841-b792-16367feac301 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:41.684948 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8d41a-61eb-4f4a-bda2-cc3082c56096 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:41.685334 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:41.691400 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11615f0c-7a1f-49d9-b788-3d22df8ed003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:41.692013 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11615f0c-7a1f-49d9-b788-3d22df8ed003 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:41.692290 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11615f0c-7a1f-49d9-b788-3d22df8ed003 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:41.692563 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11615f0c-7a1f-49d9-b788-3d22df8ed003 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:41.693213 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11615f0c-7a1f-49d9-b788-3d22df8ed003 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:41.693515 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11615f0c-7a1f-49d9-b788-3d22df8ed003 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:41.694992 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11615f0c-7a1f-49d9-b788-3d22df8ed003 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:41.713235 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 286/571] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:41.714215 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11615f0c-7a1f-49d9-b788-3d22df8ed003 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:41.723414 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc75347-4874-40b0-bf38-cf0ed61b8765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:41.724308 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc75347-4874-40b0-bf38-cf0ed61b8765 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:41.724800 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc75347-4874-40b0-bf38-cf0ed61b8765 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:41.725280 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc75347-4874-40b0-bf38-cf0ed61b8765 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:41.726199 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc75347-4874-40b0-bf38-cf0ed61b8765 None admin] RBAC: Adding query filter params (interface=public, service_id=2a2dcaa5e7ed4bc3b8a5d4b60d0f012b, region_id=RegionOne) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:41.726702 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc75347-4874-40b0-bf38-cf0ed61b8765 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:41.728273 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc75347-4874-40b0-bf38-cf0ed61b8765 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:41.736336 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 286/572] 10.222.0.52 () {56 vars in 1251 bytes} [Thu Oct 27 13:12:41 2022] GET /identity/v3/endpoints?service_id=2a2dcaa5e7ed4bc3b8a5d4b60d0f012b&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:41.737378 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc75347-4874-40b0-bf38-cf0ed61b8765 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:41.768515 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:41.834088 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11615f0c-7a1f-49d9-b788-3d22df8ed003 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:41.860865 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc75347-4874-40b0-bf38-cf0ed61b8765 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:41.874683 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9933c-c4bd-4463-aa3b-1e29b6e58523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:41.875375 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9933c-c4bd-4463-aa3b-1e29b6e58523 None admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:41.875653 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9933c-c4bd-4463-aa3b-1e29b6e58523 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:41.875951 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9933c-c4bd-4463-aa3b-1e29b6e58523 None admin] PATH_INFO: `/v3/projects/0be19dd5a0df4cf79fe2ec14d11521f0/users/cffe930429614615adc2e63e165b9c45/roles/75936ae3accd49cb935acc7c628e2136` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:41.892682 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9933c-c4bd-4463-aa3b-1e29b6e58523 None admin] RBAC: Authorizing `identity:create_grant(project_id=0be19dd5a0df4cf79fe2ec14d11521f0, user_id=cffe930429614615adc2e63e165b9c45, role_id=75936ae3accd49cb935acc7c628e2136)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:41.894812 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9933c-c4bd-4463-aa3b-1e29b6e58523 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:41.897045 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464f2e5-13aa-4ee0-b637-00edbefe5977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:41.897976 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464f2e5-13aa-4ee0-b637-00edbefe5977 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:41.898455 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464f2e5-13aa-4ee0-b637-00edbefe5977 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:41.898920 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464f2e5-13aa-4ee0-b637-00edbefe5977 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:41.907412 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464f2e5-13aa-4ee0-b637-00edbefe5977 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:41.909147 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464f2e5-13aa-4ee0-b637-00edbefe5977 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:41.910796 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 287/573] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Oct 27 13:12:41 2022] PUT /identity/v3/projects/0be19dd5a0df4cf79fe2ec14d11521f0/users/cffe930429614615adc2e63e165b9c45/roles/75936ae3accd49cb935acc7c628e2136 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:12:41.911880 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9933c-c4bd-4463-aa3b-1e29b6e58523 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:41.922478 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-0464f2e5-13aa-4ee0-b637-00edbefe5977 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 13:12:41.922478 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:41.922478 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:41.922478 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:41.922478 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:41.922478 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:41.922478 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:41.922478 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:41.922478 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:41.922478 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:41.922478 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:41.922478 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:41.922478 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 13:12:41.922478 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 13:12:41.922478 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 13:12:41.922478 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 13:12:41.923581 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:41.923581 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:41.923581 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 13:12:41.923581 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:12:41.923581 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 13:12:41.923581 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:12:41.923581 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:41.923581 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:41.923581 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:41.923581 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:41.923581 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:41.923581 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:41.923581 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:41.923581 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:41.923581 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:41.923581 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:41.923581 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:41.923581 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:41.924525 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:41.924525 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:41.924525 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 13:12:41.924525 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 13:12:41.924525 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 13:12:41.924525 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 13:12:41.924525 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 13:12:41.924525 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 13:12:41.924525 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 27 13:12:41.924525 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:41.926858 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 287/574] 10.222.0.52 () {56 vars in 1093 bytes} [Thu Oct 27 13:12:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:41.937570 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464f2e5-13aa-4ee0-b637-00edbefe5977 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:41.986649 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:42.052319 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:42.058488 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9933c-c4bd-4463-aa3b-1e29b6e58523 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:42.070803 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464f2e5-13aa-4ee0-b637-00edbefe5977 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:42.098302 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a7ce28-da66-44fb-a83f-326b04bd3394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:42.098708 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7ce28-da66-44fb-a83f-326b04bd3394 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:42.098980 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7ce28-da66-44fb-a83f-326b04bd3394 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:42.099247 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7ce28-da66-44fb-a83f-326b04bd3394 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:42.099909 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a7ce28-da66-44fb-a83f-326b04bd3394 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:42.101319 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a7ce28-da66-44fb-a83f-326b04bd3394 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:42.107987 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 288/575] 10.222.0.52 () {56 vars in 1087 bytes} [Thu Oct 27 13:12:41 2022] GET /identity/v3/services => generated 772 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:42.109328 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6682bf-aaaf-45ca-bf6b-2b43531eea4e None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:42.109631 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6682bf-aaaf-45ca-bf6b-2b43531eea4e None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:42.109907 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6682bf-aaaf-45ca-bf6b-2b43531eea4e None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:42.112207 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402bf911-6ad1-4af1-8b6b-a1b8ec5c533f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:42.113187 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bf911-6ad1-4af1-8b6b-a1b8ec5c533f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:42.113780 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bf911-6ad1-4af1-8b6b-a1b8ec5c533f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:42.114252 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bf911-6ad1-4af1-8b6b-a1b8ec5c533f None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:42.115210 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402bf911-6ad1-4af1-8b6b-a1b8ec5c533f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:42.115655 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 289/576] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:42.115958 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402bf911-6ad1-4af1-8b6b-a1b8ec5c533f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:42.117614 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd8d9f-80a5-4d26-b65e-daa0549b42c1 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:42.117895 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd8d9f-80a5-4d26-b65e-daa0549b42c1 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:42.118108 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402bf911-6ad1-4af1-8b6b-a1b8ec5c533f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:42.118208 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd8d9f-80a5-4d26-b65e-daa0549b42c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:42.138784 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-88fd8d9f-80a5-4d26-b65e-daa0549b42c1 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:42.140035 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 288/577] 10.222.0.52 () {56 vars in 1133 bytes} [Thu Oct 27 13:12:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:42.140148 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-88fd8d9f-80a5-4d26-b65e-daa0549b42c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:42.150627 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402bf911-6ad1-4af1-8b6b-a1b8ec5c533f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:42.230656 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 290/578] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 13:12:42.280754 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402bf911-6ad1-4af1-8b6b-a1b8ec5c533f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:42.320675 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98dc5e6-1721-409d-b189-053697d53174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:42.321706 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98dc5e6-1721-409d-b189-053697d53174 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:42.322199 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98dc5e6-1721-409d-b189-053697d53174 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:42.322661 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98dc5e6-1721-409d-b189-053697d53174 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:42.337646 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:42.402981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98dc5e6-1721-409d-b189-053697d53174 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:42.404880 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98dc5e6-1721-409d-b189-053697d53174 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:42.511021 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 289/579] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Oct 27 13:12:42 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 27 13:12:42.511742 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6253a-61cf-4bf2-a180-0ace9d8ad7cf None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:42.512197 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6253a-61cf-4bf2-a180-0ace9d8ad7cf None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:42.512357 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6253a-61cf-4bf2-a180-0ace9d8ad7cf None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:42.517559 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 291/580] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 13:12:42.518794 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98dc5e6-1721-409d-b189-053697d53174 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:42.519147 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b157c6f-b33d-4457-b715-f7a503e41815 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:42.519561 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b157c6f-b33d-4457-b715-f7a503e41815 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:42.519852 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b157c6f-b33d-4457-b715-f7a503e41815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:42.538445 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-3b157c6f-b33d-4457-b715-f7a503e41815 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:42.539843 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3b157c6f-b33d-4457-b715-f7a503e41815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:42.574718 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:42.575793 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:42.630950 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 292/581] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 13:12:42.634498 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b157c6f-b33d-4457-b715-f7a503e41815 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:42.649012 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98dc5e6-1721-409d-b189-053697d53174 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:42.691593 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b1e17-9a2e-4242-810c-3accbb8b379f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:42.692224 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b1e17-9a2e-4242-810c-3accbb8b379f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:42.692495 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b1e17-9a2e-4242-810c-3accbb8b379f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:42.692758 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b1e17-9a2e-4242-810c-3accbb8b379f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:42.714739 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b1e17-9a2e-4242-810c-3accbb8b379f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:42.718993 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b1e17-9a2e-4242-810c-3accbb8b379f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:42.753038 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-a08b1e17-9a2e-4242-810c-3accbb8b379f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:42.753038 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:42.753038 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:42.753038 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:42.753038 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:42.753038 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:42.753038 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:42.753038 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:42.753038 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:42.753038 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:42.753038 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:42.753038 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:42.753038 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:12:42.753038 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:12:42.753038 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:12:42.753038 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:12:42.754102 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:42.754102 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:42.754102 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:42.754102 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:42.754102 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:42.754102 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:42.754102 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:42.754102 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:42.754102 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:42.754102 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:42.754102 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:42.754102 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:42.754102 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:42.754102 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:42.754102 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:42.754102 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:42.754102 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:12:42.754986 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:12:42.754986 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:42.754986 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:42.754986 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 290/582] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:12:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:42.760103 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b1e17-9a2e-4242-810c-3accbb8b379f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:42.830147 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b157c6f-b33d-4457-b715-f7a503e41815 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:42.881855 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3149024-ec2b-43f8-8dfd-8450bc431d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:42.882496 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3149024-ec2b-43f8-8dfd-8450bc431d17 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:42.882773 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3149024-ec2b-43f8-8dfd-8450bc431d17 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:42.883045 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3149024-ec2b-43f8-8dfd-8450bc431d17 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:42.903138 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3149024-ec2b-43f8-8dfd-8450bc431d17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:12:42.903597 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:42.908505 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-c3149024-ec2b-43f8-8dfd-8450bc431d17 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:12:42.908505 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:42.908505 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:42.908505 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:42.908505 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:42.908505 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:42.908505 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:42.908505 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:42.908505 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:42.908505 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:42.908505 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:42.908505 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:42.908505 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:12:42.908505 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:12:42.908505 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:12:42.908505 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:12:42.909956 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:12:42.909956 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:12:42.909956 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:12:42.909956 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:12:42.909956 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:42.909956 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:42.909956 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:42.909956 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:42.909956 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:42.909956 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:42.909956 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:42.909956 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:42.909956 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:42.909956 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:42.909956 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:42.909956 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:42.911174 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:42.911174 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:42.911174 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:42.911174 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:42.911174 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:12:42.911174 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:12:42.911174 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:12:42.911174 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:12:42.911174 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:12:42.911174 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:12:42.911174 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:12:42.911174 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:42.921752 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b1e17-9a2e-4242-810c-3accbb8b379f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:42.921938 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 293/583] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Oct 27 13:12:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:42.922577 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3149024-ec2b-43f8-8dfd-8450bc431d17 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:42.969321 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:42.970865 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9b0fe-a1fe-4f91-be1c-3d47473ac131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:42.972436 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9b0fe-a1fe-4f91-be1c-3d47473ac131 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:42.973281 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9b0fe-a1fe-4f91-be1c-3d47473ac131 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:42.973584 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9b0fe-a1fe-4f91-be1c-3d47473ac131 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:42.974330 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb9b0fe-a1fe-4f91-be1c-3d47473ac131 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:42.974647 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb9b0fe-a1fe-4f91-be1c-3d47473ac131 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:42.976186 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb9b0fe-a1fe-4f91-be1c-3d47473ac131 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:42.992207 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 291/584] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:12:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:42.993202 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9b0fe-a1fe-4f91-be1c-3d47473ac131 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:43.069415 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3149024-ec2b-43f8-8dfd-8450bc431d17 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:43.112953 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9b0fe-a1fe-4f91-be1c-3d47473ac131 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:43.116906 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef119082-3ff8-447e-ab9e-fc3f2c586ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:43.117644 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef119082-3ff8-447e-ab9e-fc3f2c586ca4 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:43.117919 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef119082-3ff8-447e-ab9e-fc3f2c586ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:43.118187 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef119082-3ff8-447e-ab9e-fc3f2c586ca4 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:43.118929 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef119082-3ff8-447e-ab9e-fc3f2c586ca4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:43.119229 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef119082-3ff8-447e-ab9e-fc3f2c586ca4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:43.120660 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef119082-3ff8-447e-ab9e-fc3f2c586ca4 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:43.137635 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 294/585] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Oct 27 13:12:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:43.138540 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef119082-3ff8-447e-ab9e-fc3f2c586ca4 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:43.155900 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89230975-d92d-4af9-be71-336c65e9e13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:43.156811 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89230975-d92d-4af9-be71-336c65e9e13a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:43.157090 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89230975-d92d-4af9-be71-336c65e9e13a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:43.157367 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89230975-d92d-4af9-be71-336c65e9e13a None admin] PATH_INFO: `/v3/services/network` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:43.158082 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89230975-d92d-4af9-be71-336c65e9e13a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:43.159689 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89230975-d92d-4af9-be71-336c65e9e13a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:43.170468 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-89230975-d92d-4af9-be71-336c65e9e13a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 13:12:43.170468 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:43.170468 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 13:12:43.170468 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 13:12:43.170468 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 13:12:43.170468 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 13:12:43.170468 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 13:12:43.170468 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:12:43.170468 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 13:12:43.170468 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:43.170468 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 13:12:43.170468 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:43.170468 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:43.170468 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:43.170468 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:43.170468 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:43.170468 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:43.172833 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:43.172833 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:43.172833 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:43.172833 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:43.172833 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:43.172833 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:43.172833 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 13:12:43.172833 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 13:12:43.172833 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 13:12:43.172833 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 13:12:43.172833 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:43.172833 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:43.172833 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:43.172833 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:43.172833 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:43.172833 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:43.174916 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:43.174916 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:43.174916 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:43.174916 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:43.174916 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:43.174916 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:43.174916 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:43.174916 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:43.174916 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:43.174916 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:43.174916 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 13:12:43.174916 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:12:43.174916 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 13:12:43.174916 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:43.174916 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 292/586] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Oct 27 13:12:42 2022] GET /identity/v3/services/network => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:43.176036 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89230975-d92d-4af9-be71-336c65e9e13a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:43.200491 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:43.250349 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:43.269944 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef119082-3ff8-447e-ab9e-fc3f2c586ca4 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:43.307896 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ae910-6d80-42ef-a4f6-b52648d90f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:43.308533 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ae910-6d80-42ef-a4f6-b52648d90f46 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:43.308866 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ae910-6d80-42ef-a4f6-b52648d90f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:43.309072 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ae910-6d80-42ef-a4f6-b52648d90f46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:43.314746 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89230975-d92d-4af9-be71-336c65e9e13a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:43.316308 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ae910-6d80-42ef-a4f6-b52648d90f46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:43.318554 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ae910-6d80-42ef-a4f6-b52648d90f46 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:43.332000 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-491ae910-6d80-42ef-a4f6-b52648d90f46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:12:43.332000 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:43.332000 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:43.332000 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:43.332000 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:43.332000 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:43.332000 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:43.332000 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:43.332000 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:43.332000 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:43.332000 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:43.332000 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:43.332000 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 13:12:43.332000 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 13:12:43.332000 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 13:12:43.332900 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 13:12:43.332900 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:43.332900 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:43.332900 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:43.332900 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:43.332900 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:43.332900 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:43.332900 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:43.332900 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:43.332900 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:43.332900 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:43.332900 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:43.332900 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:43.332900 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:43.332900 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:43.332900 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:43.332900 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:43.333814 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 13:12:43.333814 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 13:12:43.333814 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 13:12:43.333814 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 13:12:43.333814 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 13:12:43.333814 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 13:12:43.333814 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:12:43.333814 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:43.334913 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 295/587] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Oct 27 13:12:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:43.334996 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ae910-6d80-42ef-a4f6-b52648d90f46 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:43.359522 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43460b47-e71b-467e-a86b-b3215824d1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:43.360761 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43460b47-e71b-467e-a86b-b3215824d1bd None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:43.361689 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43460b47-e71b-467e-a86b-b3215824d1bd None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:43.362435 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43460b47-e71b-467e-a86b-b3215824d1bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:43.376750 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43460b47-e71b-467e-a86b-b3215824d1bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:43.379070 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43460b47-e71b-467e-a86b-b3215824d1bd None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:43.398613 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-43460b47-e71b-467e-a86b-b3215824d1bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:43.398613 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:43.398613 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:43.398613 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:43.398613 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:43.398613 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:43.398613 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:43.398613 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:43.398613 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:43.398613 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:43.398613 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:43.398613 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:43.398613 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:12:43.398613 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:12:43.398613 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:12:43.398613 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:12:43.399556 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:43.399556 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:43.399556 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:43.399556 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:43.399556 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:43.399556 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:43.399556 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:43.399556 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:43.399556 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:43.399556 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:43.399556 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:43.399556 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:43.399556 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:43.399556 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:43.399556 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:43.399556 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:43.399556 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:12:43.400444 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:12:43.400444 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:43.400444 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:43.407600 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 293/588] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:12:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:43.407600 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43460b47-e71b-467e-a86b-b3215824d1bd None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:43.448161 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ae910-6d80-42ef-a4f6-b52648d90f46 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:43.484454 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2674c-4e9f-4e6f-828e-024b41f9f073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:43.484942 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2674c-4e9f-4e6f-828e-024b41f9f073 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:43.485229 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2674c-4e9f-4e6f-828e-024b41f9f073 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:43.485501 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2674c-4e9f-4e6f-828e-024b41f9f073 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:43.486154 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b2674c-4e9f-4e6f-828e-024b41f9f073 None admin] RBAC: Adding query filter params (name=network) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:43.486465 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b2674c-4e9f-4e6f-828e-024b41f9f073 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:43.488183 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b2674c-4e9f-4e6f-828e-024b41f9f073 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:43.497964 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:43.498242 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 296/589] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Oct 27 13:12:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:43.500250 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2674c-4e9f-4e6f-828e-024b41f9f073 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:43.518802 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:43.534575 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43460b47-e71b-467e-a86b-b3215824d1bd None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:43.576963 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba471f-806e-49f3-8403-46704769391d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:43.577713 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba471f-806e-49f3-8403-46704769391d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:43.578054 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba471f-806e-49f3-8403-46704769391d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:43.578386 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba471f-806e-49f3-8403-46704769391d None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:43.579453 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba471f-806e-49f3-8403-46704769391d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:43.579805 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba471f-806e-49f3-8403-46704769391d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:43.581605 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba471f-806e-49f3-8403-46704769391d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:43.597387 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 294/590] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Oct 27 13:12:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:43.598894 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba471f-806e-49f3-8403-46704769391d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:43.614095 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2674c-4e9f-4e6f-828e-024b41f9f073 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:43.649654 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0e6dc-10c6-4ec5-bddc-e81c3ee1a212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:43.650311 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0e6dc-10c6-4ec5-bddc-e81c3ee1a212 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:43.650584 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0e6dc-10c6-4ec5-bddc-e81c3ee1a212 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:43.650850 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0e6dc-10c6-4ec5-bddc-e81c3ee1a212 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:43.651536 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0e6dc-10c6-4ec5-bddc-e81c3ee1a212 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:43.651836 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0e6dc-10c6-4ec5-bddc-e81c3ee1a212 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:43.653206 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0e6dc-10c6-4ec5-bddc-e81c3ee1a212 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:43.669792 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 297/591] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:12:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:43.670653 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0e6dc-10c6-4ec5-bddc-e81c3ee1a212 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:43.717308 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba471f-806e-49f3-8403-46704769391d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:43.747549 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:43.754042 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:43.761942 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32163a-c00c-4364-a5b4-f555b6c21844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:43.763037 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32163a-c00c-4364-a5b4-f555b6c21844 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:43.763490 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32163a-c00c-4364-a5b4-f555b6c21844 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:43.764057 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32163a-c00c-4364-a5b4-f555b6c21844 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:43.765132 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32163a-c00c-4364-a5b4-f555b6c21844 None admin] RBAC: Adding query filter params (type=network) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:43.765700 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32163a-c00c-4364-a5b4-f555b6c21844 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:43.767277 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32163a-c00c-4364-a5b4-f555b6c21844 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:43.774651 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 295/592] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Oct 27 13:12:43 2022] GET /identity/v3/services?type=network => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:43.775974 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32163a-c00c-4364-a5b4-f555b6c21844 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:43.780132 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0e6dc-10c6-4ec5-bddc-e81c3ee1a212 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:43.832172 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50aca7d-06db-40ab-917f-819544e0e2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:43.832848 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50aca7d-06db-40ab-917f-819544e0e2e8 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:43.833281 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50aca7d-06db-40ab-917f-819544e0e2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:43.833545 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50aca7d-06db-40ab-917f-819544e0e2e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:43.834337 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50aca7d-06db-40ab-917f-819544e0e2e8 None admin] RBAC: Adding query filter params (role.id=93bba834c17a4aa7afdc65c002a12975, scope.project.id=0be19dd5a0df4cf79fe2ec14d11521f0, user.id=719e4bf834d6490b96066e55a26fb159) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:43.834751 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50aca7d-06db-40ab-917f-819544e0e2e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:43.836320 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50aca7d-06db-40ab-917f-819544e0e2e8 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:43.842863 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 298/593] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Oct 27 13:12:43 2022] GET /identity/v3/role_assignments?user.id=719e4bf834d6490b96066e55a26fb159&scope.project.id=0be19dd5a0df4cf79fe2ec14d11521f0&role.id=93bba834c17a4aa7afdc65c002a12975 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:43.843767 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50aca7d-06db-40ab-917f-819544e0e2e8 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:43.939984 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32163a-c00c-4364-a5b4-f555b6c21844 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:44.020315 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a77b7b-3303-42fb-aa98-c448b0ded1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:44.020962 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a77b7b-3303-42fb-aa98-c448b0ded1c7 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:44.021231 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a77b7b-3303-42fb-aa98-c448b0ded1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:44.021497 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a77b7b-3303-42fb-aa98-c448b0ded1c7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:44.034208 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a77b7b-3303-42fb-aa98-c448b0ded1c7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:44.035992 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a77b7b-3303-42fb-aa98-c448b0ded1c7 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:44.046877 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50aca7d-06db-40ab-917f-819544e0e2e8 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:44.051572 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-63a77b7b-3303-42fb-aa98-c448b0ded1c7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 27 13:12:44.051572 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:44.051572 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:44.051572 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:44.051572 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:44.051572 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:44.051572 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:44.051572 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:44.051572 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:44.051572 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:44.051572 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:44.051572 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:44.051572 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 13:12:44.051572 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 13:12:44.051572 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 13:12:44.051572 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 13:12:44.052508 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:44.052508 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:44.052508 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 13:12:44.052508 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:12:44.052508 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 13:12:44.052508 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:12:44.052508 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:44.052508 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:44.052508 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:44.052508 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:44.052508 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:44.052508 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:44.052508 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:44.052508 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:44.052508 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:44.052508 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:44.052508 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:44.052508 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:44.054098 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:44.054098 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:44.054098 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 13:12:44.054098 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 13:12:44.054098 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 13:12:44.054098 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 13:12:44.054098 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 13:12:44.054098 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 13:12:44.054098 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 27 13:12:44.054098 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:44.054098 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 296/594] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Oct 27 13:12:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:44.059553 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a77b7b-3303-42fb-aa98-c448b0ded1c7 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:44.087170 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4556eecc-4c92-47b7-bac7-5960606f0fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:44.087790 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556eecc-4c92-47b7-bac7-5960606f0fda None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:44.088066 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556eecc-4c92-47b7-bac7-5960606f0fda None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:44.088338 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556eecc-4c92-47b7-bac7-5960606f0fda None admin] PATH_INFO: `/v3/endpoints` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:44.089042 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4556eecc-4c92-47b7-bac7-5960606f0fda None admin] RBAC: Adding query filter params (interface=public, service_id=eb404b08f8ff4612a357ef5abffad466, region_id=RegionOne) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:44.089351 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4556eecc-4c92-47b7-bac7-5960606f0fda None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:44.090876 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4556eecc-4c92-47b7-bac7-5960606f0fda None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:44.096500 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:44.100385 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 299/595] 10.222.0.52 () {56 vars in 1251 bytes} [Thu Oct 27 13:12:43 2022] GET /identity/v3/endpoints?service_id=eb404b08f8ff4612a357ef5abffad466&interface=public®ion_id=RegionOne => generated 194 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:44.105997 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4556eecc-4c92-47b7-bac7-5960606f0fda None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:44.132938 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:44.184615 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a77b7b-3303-42fb-aa98-c448b0ded1c7 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:44.222188 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d1b1f-5c1b-480e-9c9c-5c75730657d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:44.222802 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d1b1f-5c1b-480e-9c9c-5c75730657d1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:44.223073 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d1b1f-5c1b-480e-9c9c-5c75730657d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:44.223327 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d1b1f-5c1b-480e-9c9c-5c75730657d1 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:44.224210 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677d1b1f-5c1b-480e-9c9c-5c75730657d1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:44.224514 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677d1b1f-5c1b-480e-9c9c-5c75730657d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:44.225995 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677d1b1f-5c1b-480e-9c9c-5c75730657d1 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:44.234645 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4556eecc-4c92-47b7-bac7-5960606f0fda None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:44.246664 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 297/596] 10.222.0.52 () {56 vars in 1135 bytes} [Thu Oct 27 13:12:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:44.252467 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d1b1f-5c1b-480e-9c9c-5c75730657d1 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:44.298706 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beaee7a-cdf4-482f-b326-bb51e973ab79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:44.299242 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beaee7a-cdf4-482f-b326-bb51e973ab79 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:44.299520 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beaee7a-cdf4-482f-b326-bb51e973ab79 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:44.299812 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beaee7a-cdf4-482f-b326-bb51e973ab79 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:44.309722 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beaee7a-cdf4-482f-b326-bb51e973ab79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:44.311425 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beaee7a-cdf4-482f-b326-bb51e973ab79 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:44.319251 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 300/597] 10.222.0.52 () {56 vars in 1087 bytes} [Thu Oct 27 13:12:44 2022] GET /identity/v3/services => generated 772 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:44.361345 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d1b1f-5c1b-480e-9c9c-5c75730657d1 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:44.376792 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:44.400022 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e421dd-1b2d-4fa5-8180-afb44092beb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:44.400637 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e421dd-1b2d-4fa5-8180-afb44092beb2 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:44.400910 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e421dd-1b2d-4fa5-8180-afb44092beb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:44.401177 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e421dd-1b2d-4fa5-8180-afb44092beb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:44.483667 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ed88f-2b30-4074-89bd-56fd752c32de None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:44.484371 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ed88f-2b30-4074-89bd-56fd752c32de None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:44.484739 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ed88f-2b30-4074-89bd-56fd752c32de None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:44.485671 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e421dd-1b2d-4fa5-8180-afb44092beb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:44.487333 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e421dd-1b2d-4fa5-8180-afb44092beb2 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:44.493362 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 301/598] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:44.495075 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded9eee-b0e4-4b90-919c-d349d31c05d3 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:44.495423 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded9eee-b0e4-4b90-919c-d349d31c05d3 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:44.495760 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded9eee-b0e4-4b90-919c-d349d31c05d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:44.540511 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-1ded9eee-b0e4-4b90-919c-d349d31c05d3 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:44.544171 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1ded9eee-b0e4-4b90-919c-d349d31c05d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:44.620465 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:44.628912 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 298/599] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Oct 27 13:12:44 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 27 13:12:44.630571 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 302/600] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 13:12:44.638282 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e421dd-1b2d-4fa5-8180-afb44092beb2 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:44.653167 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:44.663329 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492c070-c765-4c79-8f3e-5cb7014354ae None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:44.663607 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492c070-c765-4c79-8f3e-5cb7014354ae None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:44.663876 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492c070-c765-4c79-8f3e-5cb7014354ae None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:44.665360 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 303/601] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 13:12:44.670395 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc9b1c-e2e0-436d-aa59-bdfc48cd5680 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:44.670674 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc9b1c-e2e0-436d-aa59-bdfc48cd5680 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:44.670941 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc9b1c-e2e0-436d-aa59-bdfc48cd5680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:44.691140 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-7fbc9b1c-e2e0-436d-aa59-bdfc48cd5680 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:44.692855 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7fbc9b1c-e2e0-436d-aa59-bdfc48cd5680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:44.751742 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e421dd-1b2d-4fa5-8180-afb44092beb2 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:44.773943 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 304/602] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 13:12:44.786594 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40b54d-13ea-47aa-bcc8-fa1b6185b3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:44.787261 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40b54d-13ea-47aa-bcc8-fa1b6185b3e7 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:44.787533 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40b54d-13ea-47aa-bcc8-fa1b6185b3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:44.787805 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40b54d-13ea-47aa-bcc8-fa1b6185b3e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:44.798778 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec40b54d-13ea-47aa-bcc8-fa1b6185b3e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:44.800267 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec40b54d-13ea-47aa-bcc8-fa1b6185b3e7 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:44.816266 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-ec40b54d-13ea-47aa-bcc8-fa1b6185b3e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:44.816266 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:44.816266 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:44.816266 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:44.816266 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:44.816266 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:44.816266 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:44.816266 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:44.816266 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:44.816266 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:44.816266 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:44.816266 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:44.816266 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:12:44.816266 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:12:44.816266 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:12:44.816266 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:12:44.817259 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:44.817259 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:44.817259 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:44.817259 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:44.817259 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:44.817259 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:44.817259 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:44.817259 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:44.817259 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:44.817259 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:44.817259 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:44.817259 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:44.817259 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:44.817259 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:44.817259 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:44.817259 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:44.817259 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:12:44.818181 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:12:44.818181 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:44.818181 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:44.821796 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 299/603] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:12:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:44.823515 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc9b1c-e2e0-436d-aa59-bdfc48cd5680 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:44.941929 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc9b1c-e2e0-436d-aa59-bdfc48cd5680 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:44.975602 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:44.984959 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40b54d-13ea-47aa-bcc8-fa1b6185b3e7 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:44.996809 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0993f3-771c-4802-9407-d9bc54aa0d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:44.997432 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0993f3-771c-4802-9407-d9bc54aa0d64 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:44.997730 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0993f3-771c-4802-9407-d9bc54aa0d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:44.997994 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0993f3-771c-4802-9407-d9bc54aa0d64 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:44.998642 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0993f3-771c-4802-9407-d9bc54aa0d64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:44.998936 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0993f3-771c-4802-9407-d9bc54aa0d64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:45.000318 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0993f3-771c-4802-9407-d9bc54aa0d64 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:45.012764 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 305/604] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:45.031037 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0993f3-771c-4802-9407-d9bc54aa0d64 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:45.065909 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:45.104547 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40b54d-13ea-47aa-bcc8-fa1b6185b3e7 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:45.147454 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8a0be-0e6d-4377-97ae-5e12e57fc4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:45.148084 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8a0be-0e6d-4377-97ae-5e12e57fc4d5 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:45.148346 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8a0be-0e6d-4377-97ae-5e12e57fc4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:45.148967 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8a0be-0e6d-4377-97ae-5e12e57fc4d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:45.159903 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff8a0be-0e6d-4377-97ae-5e12e57fc4d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:12:45.165223 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-bff8a0be-0e6d-4377-97ae-5e12e57fc4d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 13:12:45.165223 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:45.165223 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:45.165223 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:45.165223 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:45.165223 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:45.165223 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:45.165223 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:45.165223 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:45.165223 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:45.165223 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:45.165223 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:45.165223 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:12:45.165223 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:12:45.165223 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:12:45.165223 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:12:45.166156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:12:45.166156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:12:45.166156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:12:45.166156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:12:45.166156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:45.166156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:45.166156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:45.166156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:45.166156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:45.166156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:45.166156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:45.166156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:45.166156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:45.166156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:45.166156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:45.166156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:45.167021 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:45.167021 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:45.167021 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:45.167021 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:45.167021 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:12:45.167021 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:12:45.167021 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:12:45.167021 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:12:45.167021 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:12:45.167021 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:12:45.167021 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 13:12:45.167021 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:45.167021 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 300/605] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Oct 27 13:12:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:12:45.174112 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8a0be-0e6d-4377-97ae-5e12e57fc4d5 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:45.244093 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0993f3-771c-4802-9407-d9bc54aa0d64 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:45.289361 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f477ef-2d58-47c5-8436-803cb55a78a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:45.290019 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f477ef-2d58-47c5-8436-803cb55a78a0 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:45.290294 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f477ef-2d58-47c5-8436-803cb55a78a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:45.291067 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f477ef-2d58-47c5-8436-803cb55a78a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:45.300740 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f477ef-2d58-47c5-8436-803cb55a78a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:45.302488 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f477ef-2d58-47c5-8436-803cb55a78a0 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:45.303064 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8a0be-0e6d-4377-97ae-5e12e57fc4d5 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:45.317431 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-04f477ef-2d58-47c5-8436-803cb55a78a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:12:45.317431 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:45.317431 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:45.317431 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:45.317431 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:45.317431 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:45.317431 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:45.317431 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:45.317431 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:45.317431 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:45.317431 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:45.317431 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:45.317431 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 13:12:45.317431 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 13:12:45.317431 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 13:12:45.318563 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 13:12:45.318563 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:45.318563 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:45.318563 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:45.318563 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:45.318563 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:45.318563 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:45.318563 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:45.318563 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:45.318563 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:45.318563 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:45.318563 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:45.318563 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:45.318563 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:45.318563 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:45.318563 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:45.318563 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:45.319489 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 13:12:45.319489 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 13:12:45.319489 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 13:12:45.319489 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 13:12:45.319489 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 13:12:45.319489 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 13:12:45.319489 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:12:45.319489 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:45.326836 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 306/606] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Oct 27 13:12:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:12:45.326836 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f477ef-2d58-47c5-8436-803cb55a78a0 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:45.336026 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:45.348899 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1716d-0575-448a-914d-5eec651ef612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:45.349628 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1716d-0575-448a-914d-5eec651ef612 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:45.349916 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1716d-0575-448a-914d-5eec651ef612 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:45.350179 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1716d-0575-448a-914d-5eec651ef612 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:45.350897 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae1716d-0575-448a-914d-5eec651ef612 None admin] RBAC: Adding query filter params (name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:45.351204 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae1716d-0575-448a-914d-5eec651ef612 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:45.352582 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae1716d-0575-448a-914d-5eec651ef612 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:45.361943 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 301/607] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Oct 27 13:12:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:45.367648 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1716d-0575-448a-914d-5eec651ef612 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:45.381035 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:45.437073 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f477ef-2d58-47c5-8436-803cb55a78a0 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:45.472729 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f521e2-3d2a-4e18-9d90-f6f019c60846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:45.473332 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f521e2-3d2a-4e18-9d90-f6f019c60846 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:45.473631 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f521e2-3d2a-4e18-9d90-f6f019c60846 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:45.473904 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f521e2-3d2a-4e18-9d90-f6f019c60846 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:45.474485 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f521e2-3d2a-4e18-9d90-f6f019c60846 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:45.475849 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f521e2-3d2a-4e18-9d90-f6f019c60846 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:45.482811 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1716d-0575-448a-914d-5eec651ef612 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:45.484733 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-73f521e2-3d2a-4e18-9d90-f6f019c60846 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 13:12:45.484733 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:45.484733 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 13:12:45.484733 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 13:12:45.484733 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 13:12:45.484733 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 13:12:45.484733 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 13:12:45.484733 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:12:45.484733 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 13:12:45.484733 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:45.484733 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 13:12:45.484733 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:45.484733 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:45.484733 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:45.484733 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:45.484733 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:45.484733 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:45.485743 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:45.485743 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:45.485743 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:45.485743 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:45.485743 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:45.485743 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:45.485743 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 13:12:45.485743 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 13:12:45.485743 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 13:12:45.485743 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 13:12:45.485743 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:45.485743 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:45.485743 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:45.485743 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:45.485743 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:45.485743 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:45.486595 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:45.486595 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:45.486595 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:45.486595 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:45.486595 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:45.486595 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:45.486595 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:45.486595 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:45.486595 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:45.486595 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:45.486595 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 13:12:45.486595 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:12:45.486595 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 13:12:45.486595 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:45.490801 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 307/608] 10.222.0.52 () {56 vars in 1129 bytes} [Thu Oct 27 13:12:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:45.491678 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f521e2-3d2a-4e18-9d90-f6f019c60846 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:45.524421 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee30a7-85e2-431d-864a-89cf8f408ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:45.525386 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee30a7-85e2-431d-864a-89cf8f408ace None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:45.525906 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee30a7-85e2-431d-864a-89cf8f408ace None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:45.526627 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee30a7-85e2-431d-864a-89cf8f408ace None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:45.528484 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee30a7-85e2-431d-864a-89cf8f408ace None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:45.529001 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee30a7-85e2-431d-864a-89cf8f408ace None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:45.530690 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee30a7-85e2-431d-864a-89cf8f408ace None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:45.548163 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 302/609] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Oct 27 13:12:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:45.549417 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee30a7-85e2-431d-864a-89cf8f408ace None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:45.602250 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:45.627136 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f521e2-3d2a-4e18-9d90-f6f019c60846 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:45.639730 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:45.662617 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee30a7-85e2-431d-864a-89cf8f408ace None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:45.675230 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec62f1-ff1e-4e88-8f7e-5d8c29bf8f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:45.676153 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec62f1-ff1e-4e88-8f7e-5d8c29bf8f64 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:45.676936 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec62f1-ff1e-4e88-8f7e-5d8c29bf8f64 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:45.677918 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec62f1-ff1e-4e88-8f7e-5d8c29bf8f64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:45.692963 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec62f1-ff1e-4e88-8f7e-5d8c29bf8f64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:45.695688 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec62f1-ff1e-4e88-8f7e-5d8c29bf8f64 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:45.701957 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ea7cb-c1f0-4b54-916c-32af152f262c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:45.703370 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ea7cb-c1f0-4b54-916c-32af152f262c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:45.703868 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ea7cb-c1f0-4b54-916c-32af152f262c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:45.704864 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ea7cb-c1f0-4b54-916c-32af152f262c None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:45.706133 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ea7cb-c1f0-4b54-916c-32af152f262c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:45.706742 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ea7cb-c1f0-4b54-916c-32af152f262c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:45.708295 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ea7cb-c1f0-4b54-916c-32af152f262c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:45.710695 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-f4ec62f1-ff1e-4e88-8f7e-5d8c29bf8f64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:45.710695 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:45.710695 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:45.710695 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:45.710695 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:45.710695 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:45.710695 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:45.710695 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:45.710695 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:45.710695 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:45.710695 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:45.710695 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:45.710695 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:12:45.710695 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:12:45.710695 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:12:45.710695 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:12:45.711637 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:45.711637 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:45.711637 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:45.711637 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:45.711637 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:45.711637 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:45.711637 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:45.711637 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:45.711637 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:45.711637 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:45.711637 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:45.711637 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:45.711637 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:45.711637 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:45.711637 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:45.711637 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:45.711637 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:12:45.712521 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:12:45.712521 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:45.712521 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:45.712521 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 308/610] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:12:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:45.712745 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec62f1-ff1e-4e88-8f7e-5d8c29bf8f64 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:45.716505 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 303/611] 10.222.0.52 () {56 vars in 1124 bytes} [Thu Oct 27 13:12:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:45.723243 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ea7cb-c1f0-4b54-916c-32af152f262c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:45.819276 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec62f1-ff1e-4e88-8f7e-5d8c29bf8f64 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:45.852355 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ea7cb-c1f0-4b54-916c-32af152f262c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:45.865565 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:45.865929 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629a717-53af-40f0-8d37-293a759a23da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:45.867702 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629a717-53af-40f0-8d37-293a759a23da None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:45.868186 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629a717-53af-40f0-8d37-293a759a23da None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:45.868869 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629a717-53af-40f0-8d37-293a759a23da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:45.871529 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629a717-53af-40f0-8d37-293a759a23da None admin] RBAC: Adding query filter params (role.id=93bba834c17a4aa7afdc65c002a12975, scope.project.id=0be19dd5a0df4cf79fe2ec14d11521f0, user.id=62769acbfca242d6a0b0fe5a6b8bc108) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:45.872070 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629a717-53af-40f0-8d37-293a759a23da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:45.874418 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629a717-53af-40f0-8d37-293a759a23da None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:45.883757 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 309/612] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Oct 27 13:12:45 2022] GET /identity/v3/role_assignments?user.id=62769acbfca242d6a0b0fe5a6b8bc108&scope.project.id=0be19dd5a0df4cf79fe2ec14d11521f0&role.id=93bba834c17a4aa7afdc65c002a12975 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:45.884941 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629a717-53af-40f0-8d37-293a759a23da None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:45.905251 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd363ab-f6eb-48bf-afc7-8014cd6cc283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:45.906364 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd363ab-f6eb-48bf-afc7-8014cd6cc283 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:45.906867 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd363ab-f6eb-48bf-afc7-8014cd6cc283 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:45.907340 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd363ab-f6eb-48bf-afc7-8014cd6cc283 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:45.908208 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd363ab-f6eb-48bf-afc7-8014cd6cc283 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:45.908734 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd363ab-f6eb-48bf-afc7-8014cd6cc283 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:45.910544 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd363ab-f6eb-48bf-afc7-8014cd6cc283 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:45.926173 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 304/613] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:12:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:12:45.932180 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd363ab-f6eb-48bf-afc7-8014cd6cc283 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:45.968054 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:46.043759 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd363ab-f6eb-48bf-afc7-8014cd6cc283 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:46.081946 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07912d30-e349-46ed-ab45-aaf7db73645f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:46.082727 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07912d30-e349-46ed-ab45-aaf7db73645f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:46.083008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07912d30-e349-46ed-ab45-aaf7db73645f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:46.083277 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07912d30-e349-46ed-ab45-aaf7db73645f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:46.101021 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07912d30-e349-46ed-ab45-aaf7db73645f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:46.102535 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07912d30-e349-46ed-ab45-aaf7db73645f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:46.120219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-07912d30-e349-46ed-ab45-aaf7db73645f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 13:12:46.120219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:46.120219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:46.120219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:46.120219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:46.120219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:46.120219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:46.120219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:46.120219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:46.120219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:46.120219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:46.120219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:46.120219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 13:12:46.120219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 13:12:46.120219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 13:12:46.120219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 13:12:46.121219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:46.121219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:46.121219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 13:12:46.121219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:12:46.121219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 13:12:46.121219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:12:46.121219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:46.121219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:46.121219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:46.121219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:46.121219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:46.121219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:46.121219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:46.121219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:46.121219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:46.121219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:46.121219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:46.121219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:46.122199 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:46.122199 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:46.122199 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 13:12:46.122199 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 13:12:46.122199 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 13:12:46.122199 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 13:12:46.122199 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 13:12:46.122199 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 13:12:46.122199 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 13:12:46.122199 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:46.125701 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 305/614] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Oct 27 13:12:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:12:46.127076 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07912d30-e349-46ed-ab45-aaf7db73645f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:46.127784 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629a717-53af-40f0-8d37-293a759a23da None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:46.159047 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:46.169669 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d8e67-22fc-49a7-b549-71a46ded6222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:46.171037 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d8e67-22fc-49a7-b549-71a46ded6222 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:46.171577 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d8e67-22fc-49a7-b549-71a46ded6222 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:46.172051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d8e67-22fc-49a7-b549-71a46ded6222 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:46.173242 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d8e67-22fc-49a7-b549-71a46ded6222 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:46.174093 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d8e67-22fc-49a7-b549-71a46ded6222 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:46.176194 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d8e67-22fc-49a7-b549-71a46ded6222 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:46.183621 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 310/615] 10.222.0.52 () {56 vars in 1124 bytes} [Thu Oct 27 13:12:45 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:46.189189 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d8e67-22fc-49a7-b549-71a46ded6222 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:46.237078 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07912d30-e349-46ed-ab45-aaf7db73645f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:46.274230 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a38f4-94f9-4982-a4aa-77a6e0533c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:46.274959 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a38f4-94f9-4982-a4aa-77a6e0533c09 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:46.275545 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a38f4-94f9-4982-a4aa-77a6e0533c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:46.275545 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a38f4-94f9-4982-a4aa-77a6e0533c09 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:46.276771 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5a38f4-94f9-4982-a4aa-77a6e0533c09 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:46.277144 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5a38f4-94f9-4982-a4aa-77a6e0533c09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:46.278691 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5a38f4-94f9-4982-a4aa-77a6e0533c09 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:46.299463 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 306/616] 10.222.0.52 () {56 vars in 1149 bytes} [Thu Oct 27 13:12:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:12:46.305039 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a38f4-94f9-4982-a4aa-77a6e0533c09 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:46.311139 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:46.329659 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d8e67-22fc-49a7-b549-71a46ded6222 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:46.394829 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc291fba-3260-4087-aadd-3b69a5fad4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:46.396584 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc291fba-3260-4087-aadd-3b69a5fad4f9 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:46.396876 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc291fba-3260-4087-aadd-3b69a5fad4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:46.397151 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc291fba-3260-4087-aadd-3b69a5fad4f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:46.397858 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc291fba-3260-4087-aadd-3b69a5fad4f9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:46.399242 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc291fba-3260-4087-aadd-3b69a5fad4f9 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:46.450508 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 311/617] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:12:46 2022] POST /identity/v3/endpoints => generated 346 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:12:46.455658 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04171c1a-9dcc-4974-b53e-58da283ebe48 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:46.455986 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04171c1a-9dcc-4974-b53e-58da283ebe48 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:46.456274 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04171c1a-9dcc-4974-b53e-58da283ebe48 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:46.457930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 312/618] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:46.463735 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c227a36-ff85-4ce3-ad3b-de7757f9d00b None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:46.464098 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c227a36-ff85-4ce3-ad3b-de7757f9d00b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:46.464354 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c227a36-ff85-4ce3-ad3b-de7757f9d00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:46.480141 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:46.502719 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-2c227a36-ff85-4ce3-ad3b-de7757f9d00b None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:46.504010 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2c227a36-ff85-4ce3-ad3b-de7757f9d00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:46.509812 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a38f4-94f9-4982-a4aa-77a6e0533c09 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:46.602403 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4cb5d6-05a1-440e-ab12-4ee942105956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:46.603016 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4cb5d6-05a1-440e-ab12-4ee942105956 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:46.603293 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4cb5d6-05a1-440e-ab12-4ee942105956 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:46.603559 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4cb5d6-05a1-440e-ab12-4ee942105956 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:46.611932 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 313/619] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 13:12:46.676376 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4cb5d6-05a1-440e-ab12-4ee942105956 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:46.677923 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4cb5d6-05a1-440e-ab12-4ee942105956 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:46.761430 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:46.778133 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 307/620] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Oct 27 13:12:46 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 27 13:12:46.783428 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c227a36-ff85-4ce3-ad3b-de7757f9d00b None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:46.903910 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:46.934817 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4cb5d6-05a1-440e-ab12-4ee942105956 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:46.939850 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c227a36-ff85-4ce3-ad3b-de7757f9d00b None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:47.010471 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d7a7b-81d1-442c-ad21-bdd3b03d5744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:47.011529 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d7a7b-81d1-442c-ad21-bdd3b03d5744 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:47.011810 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d7a7b-81d1-442c-ad21-bdd3b03d5744 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:47.012214 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d7a7b-81d1-442c-ad21-bdd3b03d5744 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:47.025270 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6d7a7b-81d1-442c-ad21-bdd3b03d5744 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:47.028003 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6d7a7b-81d1-442c-ad21-bdd3b03d5744 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:47.044773 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-0b6d7a7b-81d1-442c-ad21-bdd3b03d5744 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:47.044773 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:47.044773 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:47.044773 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:47.044773 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:47.044773 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:47.044773 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:47.044773 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:47.044773 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:47.044773 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:47.044773 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:47.044773 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:47.044773 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:12:47.044773 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:12:47.044773 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:12:47.044773 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:12:47.045962 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:47.045962 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:47.045962 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:47.045962 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:47.045962 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:47.045962 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:47.045962 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:47.045962 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:47.045962 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:47.045962 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:47.045962 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:47.045962 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:47.045962 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:47.045962 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:47.045962 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:47.045962 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:47.045962 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:12:47.046934 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:12:47.046934 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:47.046934 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:47.046934 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 314/621] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:12:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:47.047619 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4becddc-3725-488b-b487-62d58b3c29c6 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:47.047872 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4becddc-3725-488b-b487-62d58b3c29c6 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:47.052307 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4becddc-3725-488b-b487-62d58b3c29c6 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:47.052307 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 315/622] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:47.054767 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4becddc-3725-488b-b487-62d58b3c29c6 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:47.081393 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4cb5d6-05a1-440e-ab12-4ee942105956 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:47.117918 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8bc78f-2099-4ed8-a8d2-a1bcbf764e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:47.118755 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8bc78f-2099-4ed8-a8d2-a1bcbf764e1a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:47.119110 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8bc78f-2099-4ed8-a8d2-a1bcbf764e1a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:47.119500 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8bc78f-2099-4ed8-a8d2-a1bcbf764e1a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:47.120150 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8bc78f-2099-4ed8-a8d2-a1bcbf764e1a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:47.121638 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8bc78f-2099-4ed8-a8d2-a1bcbf764e1a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:47.131615 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-bc8bc78f-2099-4ed8-a8d2-a1bcbf764e1a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 13:12:47.131615 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:47.131615 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 13:12:47.131615 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 13:12:47.131615 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 13:12:47.131615 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 13:12:47.131615 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 13:12:47.131615 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:12:47.131615 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 13:12:47.131615 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:47.131615 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 13:12:47.131615 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:47.131615 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:47.131615 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:47.131615 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:47.131615 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:47.132914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:47.132914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:47.132914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:47.132914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:47.132914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:47.132914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:47.132914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:47.132914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 13:12:47.132914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 13:12:47.132914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 13:12:47.132914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 13:12:47.132914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:47.132914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:47.132914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:47.132914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:47.132914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:47.132914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:47.134031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:47.134031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:47.134031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:47.134031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:47.134031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:47.134031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:47.134031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:47.134031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:47.134031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:47.134031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:47.134031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 13:12:47.134031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:12:47.134031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 13:12:47.134031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:47.134794 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 308/623] 10.222.0.52 () {56 vars in 1132 bytes} [Thu Oct 27 13:12:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:12:47.135825 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98251e-8353-4f1f-be6f-68709dfc40b6 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:47.136104 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98251e-8353-4f1f-be6f-68709dfc40b6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:47.136380 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98251e-8353-4f1f-be6f-68709dfc40b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:47.156272 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-5d98251e-8353-4f1f-be6f-68709dfc40b6 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:47.157656 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5d98251e-8353-4f1f-be6f-68709dfc40b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:47.174149 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4becddc-3725-488b-b487-62d58b3c29c6 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:47.202960 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:47.214530 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd38990-fe41-4e48-a075-157b2f8d1426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:47.215515 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd38990-fe41-4e48-a075-157b2f8d1426 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:47.215998 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd38990-fe41-4e48-a075-157b2f8d1426 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:47.216487 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd38990-fe41-4e48-a075-157b2f8d1426 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:47.217365 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd38990-fe41-4e48-a075-157b2f8d1426 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:47.217890 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd38990-fe41-4e48-a075-157b2f8d1426 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:47.220181 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd38990-fe41-4e48-a075-157b2f8d1426 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:47.224675 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:47.244505 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 316/624] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:47.244505 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd38990-fe41-4e48-a075-157b2f8d1426 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:47.255599 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 309/625] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 13:12:47.256504 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98251e-8353-4f1f-be6f-68709dfc40b6 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:47.372299 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98251e-8353-4f1f-be6f-68709dfc40b6 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:47.376555 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd38990-fe41-4e48-a075-157b2f8d1426 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:47.417167 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17b147-dd5e-4808-8f07-9f7a8a36542e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:47.418349 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17b147-dd5e-4808-8f07-9f7a8a36542e None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:47.419063 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17b147-dd5e-4808-8f07-9f7a8a36542e None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:47.419549 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17b147-dd5e-4808-8f07-9f7a8a36542e None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:47.420377 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17b147-dd5e-4808-8f07-9f7a8a36542e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:47.420884 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17b147-dd5e-4808-8f07-9f7a8a36542e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:47.422962 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17b147-dd5e-4808-8f07-9f7a8a36542e None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:47.428376 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 317/626] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Oct 27 13:12:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:47.434255 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17b147-dd5e-4808-8f07-9f7a8a36542e None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:47.450284 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14847015-efb2-4057-8b0d-8565f9f4acb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:47.450949 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14847015-efb2-4057-8b0d-8565f9f4acb1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:47.451209 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14847015-efb2-4057-8b0d-8565f9f4acb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:47.451484 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14847015-efb2-4057-8b0d-8565f9f4acb1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:47.466689 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14847015-efb2-4057-8b0d-8565f9f4acb1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:47.468094 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14847015-efb2-4057-8b0d-8565f9f4acb1 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:47.488031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-14847015-efb2-4057-8b0d-8565f9f4acb1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:12:47.488031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:47.488031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:47.488031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:47.488031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:47.488031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:47.488031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:47.488031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:47.488031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:47.488031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:47.488031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:47.488031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:47.488031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 13:12:47.488031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 13:12:47.488031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 13:12:47.489020 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 13:12:47.489020 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:47.489020 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:47.489020 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:47.489020 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:47.489020 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:47.489020 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:47.489020 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:47.489020 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:47.489020 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:47.489020 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:47.489020 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:47.489020 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:47.489020 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:47.489020 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:47.489020 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:47.489020 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:47.489948 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 13:12:47.489948 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 13:12:47.489948 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 13:12:47.489948 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 13:12:47.489948 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 13:12:47.489948 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 13:12:47.489948 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:12:47.489948 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:47.489948 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 310/627] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Oct 27 13:12:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:47.494371 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:47.494844 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14847015-efb2-4057-8b0d-8565f9f4acb1 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:47.554536 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17b147-dd5e-4808-8f07-9f7a8a36542e None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:47.563326 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:47.602872 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446cc3a-bcf2-4ed9-bd4b-bc2ea462e99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:47.603477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446cc3a-bcf2-4ed9-bd4b-bc2ea462e99b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:47.605812 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446cc3a-bcf2-4ed9-bd4b-bc2ea462e99b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:47.606001 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446cc3a-bcf2-4ed9-bd4b-bc2ea462e99b None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:47.606639 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446cc3a-bcf2-4ed9-bd4b-bc2ea462e99b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:47.606941 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446cc3a-bcf2-4ed9-bd4b-bc2ea462e99b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:47.608352 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446cc3a-bcf2-4ed9-bd4b-bc2ea462e99b None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:47.619004 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 318/628] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Oct 27 13:12:47 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:47.621572 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446cc3a-bcf2-4ed9-bd4b-bc2ea462e99b None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:47.673064 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14847015-efb2-4057-8b0d-8565f9f4acb1 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:47.747879 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13d423-d31c-4699-b38e-6fb4794c2796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:47.748504 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13d423-d31c-4699-b38e-6fb4794c2796 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:47.748787 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13d423-d31c-4699-b38e-6fb4794c2796 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:47.749058 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13d423-d31c-4699-b38e-6fb4794c2796 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:47.749774 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de13d423-d31c-4699-b38e-6fb4794c2796 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:47.750081 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de13d423-d31c-4699-b38e-6fb4794c2796 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:47.751525 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de13d423-d31c-4699-b38e-6fb4794c2796 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:47.776932 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 311/629] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Oct 27 13:12:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:47.782857 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13d423-d31c-4699-b38e-6fb4794c2796 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:47.792966 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446cc3a-bcf2-4ed9-bd4b-bc2ea462e99b None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:47.815887 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:47.833779 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0fd07d-2c87-4e1f-bb4b-b6c088e3c567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:47.834433 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0fd07d-2c87-4e1f-bb4b-b6c088e3c567 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:47.834734 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0fd07d-2c87-4e1f-bb4b-b6c088e3c567 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:47.834974 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0fd07d-2c87-4e1f-bb4b-b6c088e3c567 None admin] PATH_INFO: `/v3/services/network` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:47.835577 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0fd07d-2c87-4e1f-bb4b-b6c088e3c567 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:47.837005 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0fd07d-2c87-4e1f-bb4b-b6c088e3c567 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:47.846991 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-7f0fd07d-2c87-4e1f-bb4b-b6c088e3c567 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 13:12:47.846991 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:47.846991 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 13:12:47.846991 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 13:12:47.846991 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 13:12:47.846991 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 13:12:47.846991 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 13:12:47.846991 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:12:47.846991 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 13:12:47.846991 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:47.846991 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 13:12:47.846991 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:47.846991 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:47.846991 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:47.846991 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:47.846991 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:47.846991 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:47.848031 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:47.848031 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:47.848031 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:47.848031 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:47.848031 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:47.848031 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:47.848031 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 13:12:47.848031 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 13:12:47.848031 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 13:12:47.848031 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 13:12:47.848031 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:47.848031 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:47.848031 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:47.848031 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:47.848031 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:47.848031 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:47.848863 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:47.848863 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:47.848863 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:47.848863 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:47.848863 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:47.848863 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:47.848863 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:47.848863 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:47.848863 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:47.848863 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:47.848863 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 13:12:47.848863 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:12:47.848863 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 13:12:47.848863 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:47.848863 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 319/630] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Oct 27 13:12:47 2022] GET /identity/v3/services/network => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:47.856254 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0fd07d-2c87-4e1f-bb4b-b6c088e3c567 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:47.947955 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:47.951817 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13d423-d31c-4699-b38e-6fb4794c2796 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:47.998858 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0fd07d-2c87-4e1f-bb4b-b6c088e3c567 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:48.026835 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6251e-695c-4cda-85df-5c5407b9abf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:48.027525 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6251e-695c-4cda-85df-5c5407b9abf7 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:48.027866 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6251e-695c-4cda-85df-5c5407b9abf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:48.028197 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6251e-695c-4cda-85df-5c5407b9abf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:48.028999 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6251e-695c-4cda-85df-5c5407b9abf7 None admin] RBAC: Adding query filter params (role.id=75936ae3accd49cb935acc7c628e2136, scope.project.id=0be19dd5a0df4cf79fe2ec14d11521f0, user.id=cffe930429614615adc2e63e165b9c45) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:48.029387 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6251e-695c-4cda-85df-5c5407b9abf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:48.030899 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6251e-695c-4cda-85df-5c5407b9abf7 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:48.041842 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab320714-5088-41d3-a884-190ffbb3bd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:48.042764 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab320714-5088-41d3-a884-190ffbb3bd7a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:48.043323 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab320714-5088-41d3-a884-190ffbb3bd7a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:48.043815 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab320714-5088-41d3-a884-190ffbb3bd7a None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:48.044653 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab320714-5088-41d3-a884-190ffbb3bd7a None admin] RBAC: Adding query filter params (name=network) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:48.045172 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab320714-5088-41d3-a884-190ffbb3bd7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:48.046605 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 312/631] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Oct 27 13:12:47 2022] GET /identity/v3/role_assignments?user.id=cffe930429614615adc2e63e165b9c45&scope.project.id=0be19dd5a0df4cf79fe2ec14d11521f0&role.id=75936ae3accd49cb935acc7c628e2136 => generated 608 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:12:48.047039 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab320714-5088-41d3-a884-190ffbb3bd7a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:48.053182 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 320/632] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Oct 27 13:12:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:48.058724 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6251e-695c-4cda-85df-5c5407b9abf7 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:48.214192 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6251e-695c-4cda-85df-5c5407b9abf7 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:48.257038 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a17a1-9fc0-432b-befb-0b1166947b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:48.257701 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a17a1-9fc0-432b-befb-0b1166947b16 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:48.257940 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a17a1-9fc0-432b-befb-0b1166947b16 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:48.258137 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a17a1-9fc0-432b-befb-0b1166947b16 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:48.258761 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a17a1-9fc0-432b-befb-0b1166947b16 None admin] RBAC: Adding query filter params (type=network) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:48.259059 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a17a1-9fc0-432b-befb-0b1166947b16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:48.260418 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a17a1-9fc0-432b-befb-0b1166947b16 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:48.268557 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 313/633] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Oct 27 13:12:48 2022] GET /identity/v3/services?type=network => generated 350 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:48.274095 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab320714-5088-41d3-a884-190ffbb3bd7a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:48.337578 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:48.419379 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab320714-5088-41d3-a884-190ffbb3bd7a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:48.467773 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b31bd7-bb21-408c-8fd1-25641e97996f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:48.468396 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b31bd7-bb21-408c-8fd1-25641e97996f None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:48.468740 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b31bd7-bb21-408c-8fd1-25641e97996f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:48.469040 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b31bd7-bb21-408c-8fd1-25641e97996f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:48.469750 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b31bd7-bb21-408c-8fd1-25641e97996f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:48.471397 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b31bd7-bb21-408c-8fd1-25641e97996f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:48.500844 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 321/634] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:12:48 2022] POST /identity/v3/endpoints => generated 337 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:12:48.802572 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241460d3-cd55-4764-9a11-8222d0f5d16e None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:48.803317 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241460d3-cd55-4764-9a11-8222d0f5d16e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:48.803317 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241460d3-cd55-4764-9a11-8222d0f5d16e None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:48.804425 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 314/635] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:48.810458 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba26f22-18ab-448a-9290-294cd2cf9361 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:48.810898 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba26f22-18ab-448a-9290-294cd2cf9361 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:48.811214 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba26f22-18ab-448a-9290-294cd2cf9361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:48.829982 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-eba26f22-18ab-448a-9290-294cd2cf9361 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:48.831566 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-eba26f22-18ab-448a-9290-294cd2cf9361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:48.909448 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 322/636] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:48 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 13:12:49.102661 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf87111-9b0f-4304-a440-cf42565da7b7 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:49.102849 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf87111-9b0f-4304-a440-cf42565da7b7 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:49.103127 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf87111-9b0f-4304-a440-cf42565da7b7 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:49.104630 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 315/637] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:49.110167 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76f5a9-4ee1-4db2-9e84-06f9ebb88192 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:49.110438 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76f5a9-4ee1-4db2-9e84-06f9ebb88192 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:49.110710 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76f5a9-4ee1-4db2-9e84-06f9ebb88192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:49.129740 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-cd76f5a9-4ee1-4db2-9e84-06f9ebb88192 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:49.130923 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-cd76f5a9-4ee1-4db2-9e84-06f9ebb88192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:49.152562 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:49.191164 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf87111-9b0f-4304-a440-cf42565da7b7 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:49.214285 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 323/638] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:49 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 13:12:49.231892 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:49.309342 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf87111-9b0f-4304-a440-cf42565da7b7 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:49.342288 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf347dfb-3532-45bb-8733-953686c1c0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:49.342910 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf347dfb-3532-45bb-8733-953686c1c0f2 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:49.343181 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf347dfb-3532-45bb-8733-953686c1c0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:49.343443 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf347dfb-3532-45bb-8733-953686c1c0f2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:49.344012 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf347dfb-3532-45bb-8733-953686c1c0f2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:49.345361 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf347dfb-3532-45bb-8733-953686c1c0f2 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:49.354459 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-bf347dfb-3532-45bb-8733-953686c1c0f2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 13:12:49.354459 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:49.354459 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 13:12:49.354459 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 13:12:49.354459 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 13:12:49.354459 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 13:12:49.354459 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 13:12:49.354459 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:12:49.354459 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 13:12:49.354459 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:49.354459 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 13:12:49.354459 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:49.354459 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:49.354459 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:49.354459 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:49.354459 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:49.354459 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:49.355433 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:49.355433 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:49.355433 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:49.355433 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:49.355433 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:49.355433 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:49.355433 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 13:12:49.355433 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 13:12:49.355433 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 13:12:49.355433 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 13:12:49.355433 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:49.355433 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:49.355433 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:49.355433 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:49.355433 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:49.355433 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:49.356275 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:49.356275 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:49.356275 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:49.356275 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:49.356275 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:49.356275 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:49.356275 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:49.356275 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:49.356275 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:49.356275 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:49.356275 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 13:12:49.356275 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:12:49.356275 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 13:12:49.356275 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:49.356275 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 316/639] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Oct 27 13:12:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:49.361675 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76f5a9-4ee1-4db2-9e84-06f9ebb88192 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:49.463036 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76f5a9-4ee1-4db2-9e84-06f9ebb88192 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:49.498476 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ac2e0-827d-4f0f-b73d-f91a9e0c171e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:49.499143 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ac2e0-827d-4f0f-b73d-f91a9e0c171e None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:49.499419 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ac2e0-827d-4f0f-b73d-f91a9e0c171e None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:49.499685 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ac2e0-827d-4f0f-b73d-f91a9e0c171e None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:49.500364 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ac2e0-827d-4f0f-b73d-f91a9e0c171e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:49.500665 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ac2e0-827d-4f0f-b73d-f91a9e0c171e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:49.502085 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ac2e0-827d-4f0f-b73d-f91a9e0c171e None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:49.507544 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 324/640] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Oct 27 13:12:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:49.510469 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf347dfb-3532-45bb-8733-953686c1c0f2 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:49.512929 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ac2e0-827d-4f0f-b73d-f91a9e0c171e None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:49.532630 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:49.616400 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:49.625688 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf347dfb-3532-45bb-8733-953686c1c0f2 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:49.631022 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ac2e0-827d-4f0f-b73d-f91a9e0c171e None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:49.660062 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd154730-f7a8-49bf-952c-4384a6018fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:49.660699 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd154730-f7a8-49bf-952c-4384a6018fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:49.660966 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd154730-f7a8-49bf-952c-4384a6018fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:49.661232 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd154730-f7a8-49bf-952c-4384a6018fc5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:49.661872 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd154730-f7a8-49bf-952c-4384a6018fc5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:49.663227 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd154730-f7a8-49bf-952c-4384a6018fc5 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:49.670335 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98448384-bba3-4289-b63d-7342ed8d56df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:49.671266 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98448384-bba3-4289-b63d-7342ed8d56df None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:49.671804 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98448384-bba3-4289-b63d-7342ed8d56df None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:49.671981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-dd154730-f7a8-49bf-952c-4384a6018fc5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 13:12:49.671981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:49.671981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 13:12:49.671981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 13:12:49.671981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 13:12:49.671981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 13:12:49.671981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 13:12:49.671981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:12:49.671981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 13:12:49.671981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:49.671981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 13:12:49.671981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:49.671981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:49.671981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:49.671981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:49.671981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:49.671981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:49.673008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:49.673008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:49.673008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:49.673008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:49.673008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:49.673008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:49.673008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 13:12:49.673008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 13:12:49.673008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 13:12:49.673008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 13:12:49.673008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:49.673008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:49.673008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:49.673008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:49.673008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:49.673008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:49.673893 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:49.673893 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:49.673893 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:49.673893 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:49.673893 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:49.673893 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:49.673893 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:49.673893 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:49.673893 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:49.673893 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:49.673893 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 13:12:49.673893 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:12:49.673893 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 13:12:49.673893 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:49.673893 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 317/641] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Oct 27 13:12:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:49.675266 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98448384-bba3-4289-b63d-7342ed8d56df None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:49.676130 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98448384-bba3-4289-b63d-7342ed8d56df None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:49.676636 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98448384-bba3-4289-b63d-7342ed8d56df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:49.678214 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98448384-bba3-4289-b63d-7342ed8d56df None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:49.683708 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd154730-f7a8-49bf-952c-4384a6018fc5 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:49.684999 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 325/642] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Oct 27 13:12:49 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:12:49.793857 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd154730-f7a8-49bf-952c-4384a6018fc5 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:49.830318 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a01f02-22bf-4574-9e59-387980d357ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:49.830957 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a01f02-22bf-4574-9e59-387980d357ef None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:49.831263 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a01f02-22bf-4574-9e59-387980d357ef None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:49.831532 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a01f02-22bf-4574-9e59-387980d357ef None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:49.832166 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a01f02-22bf-4574-9e59-387980d357ef None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:49.832465 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a01f02-22bf-4574-9e59-387980d357ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:49.833871 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a01f02-22bf-4574-9e59-387980d357ef None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:49.839287 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 318/643] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Oct 27 13:12:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:49.844961 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98448384-bba3-4289-b63d-7342ed8d56df None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:49.935334 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:49.957671 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98448384-bba3-4289-b63d-7342ed8d56df None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:49.995499 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bebf9e-0b3e-4b05-b9b8-b965084fdcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:49.996354 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bebf9e-0b3e-4b05-b9b8-b965084fdcee None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:49.996790 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bebf9e-0b3e-4b05-b9b8-b965084fdcee None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:49.997212 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bebf9e-0b3e-4b05-b9b8-b965084fdcee None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:49.998017 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bebf9e-0b3e-4b05-b9b8-b965084fdcee None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:49.998515 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bebf9e-0b3e-4b05-b9b8-b965084fdcee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:50.000034 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bebf9e-0b3e-4b05-b9b8-b965084fdcee None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:50.005592 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 326/644] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Oct 27 13:12:49 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:50.073907 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba65f6-f776-4691-89fe-79de7382ff67 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:50.074568 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba65f6-f776-4691-89fe-79de7382ff67 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:50.075074 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba65f6-f776-4691-89fe-79de7382ff67 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:50.076973 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 319/645] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:50.082520 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf0185-27b1-47be-ac3a-3644dc451f22 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:50.083259 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf0185-27b1-47be-ac3a-3644dc451f22 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:50.083748 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf0185-27b1-47be-ac3a-3644dc451f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:50.103978 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-c4cf0185-27b1-47be-ac3a-3644dc451f22 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:50.105728 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c4cf0185-27b1-47be-ac3a-3644dc451f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:50.188586 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 327/646] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:50 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 13:12:50.554933 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073483f-f827-4f35-8b9f-9343c4242119 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:50.556315 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073483f-f827-4f35-8b9f-9343c4242119 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:50.556995 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073483f-f827-4f35-8b9f-9343c4242119 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:50.560161 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 320/647] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:50.565150 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf03c07-d12c-43b0-afe2-37581583a7dd None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:50.565489 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf03c07-d12c-43b0-afe2-37581583a7dd None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:50.565791 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf03c07-d12c-43b0-afe2-37581583a7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:50.587992 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-8bf03c07-d12c-43b0-afe2-37581583a7dd None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:50.589182 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8bf03c07-d12c-43b0-afe2-37581583a7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:50.611370 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073483f-f827-4f35-8b9f-9343c4242119 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:50.631900 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:50.683878 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 328/648] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:50 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 13:12:50.732054 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073483f-f827-4f35-8b9f-9343c4242119 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:50.766402 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540aff0-53b5-4d2f-aacb-3d45288c8a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:50.767338 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540aff0-53b5-4d2f-aacb-3d45288c8a8d None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:50.767829 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540aff0-53b5-4d2f-aacb-3d45288c8a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:50.768289 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540aff0-53b5-4d2f-aacb-3d45288c8a8d None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:50.769191 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540aff0-53b5-4d2f-aacb-3d45288c8a8d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:50.770780 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540aff0-53b5-4d2f-aacb-3d45288c8a8d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:50.791336 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 321/649] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Oct 27 13:12:50 2022] POST /identity/v3/services => generated 269 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:12:50.980441 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf03c07-d12c-43b0-afe2-37581583a7dd None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:50.989318 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:51.092155 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf03c07-d12c-43b0-afe2-37581583a7dd None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:51.145883 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6254e-342d-4909-8fa9-67c02eed8483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:51.146525 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6254e-342d-4909-8fa9-67c02eed8483 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:51.146799 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6254e-342d-4909-8fa9-67c02eed8483 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:51.147069 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6254e-342d-4909-8fa9-67c02eed8483 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:51.157518 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf6254e-342d-4909-8fa9-67c02eed8483 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:12:51.162345 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-8cf6254e-342d-4909-8fa9-67c02eed8483 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 13:12:51.162345 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:51.162345 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:51.162345 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:51.162345 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:51.162345 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:51.162345 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:51.162345 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:51.162345 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:51.162345 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:51.162345 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:51.162345 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:51.162345 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:12:51.162345 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:12:51.162345 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:12:51.162345 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:12:51.163288 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:12:51.163288 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:12:51.163288 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:12:51.163288 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:12:51.163288 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:51.163288 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:51.163288 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:51.163288 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:51.163288 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:51.163288 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:51.163288 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:51.163288 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:51.163288 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:51.163288 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:51.163288 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:51.163288 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:51.164119 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:51.164119 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:51.164119 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:51.164119 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:51.164119 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:12:51.164119 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:12:51.164119 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:12:51.164119 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:12:51.164119 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:12:51.164119 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:12:51.164119 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 13:12:51.164119 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:51.164119 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 329/650] 10.222.0.52 () {56 vars in 1120 bytes} [Thu Oct 27 13:12:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:51.169624 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540aff0-53b5-4d2f-aacb-3d45288c8a8d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:51.255947 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:51.284762 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540aff0-53b5-4d2f-aacb-3d45288c8a8d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:51.320051 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a88e9e-4a10-458f-b6d0-d1f38884d8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:51.320714 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a88e9e-4a10-458f-b6d0-d1f38884d8b7 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:51.320998 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a88e9e-4a10-458f-b6d0-d1f38884d8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:51.321269 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a88e9e-4a10-458f-b6d0-d1f38884d8b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:51.321968 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a88e9e-4a10-458f-b6d0-d1f38884d8b7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:51.322275 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a88e9e-4a10-458f-b6d0-d1f38884d8b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:51.323640 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a88e9e-4a10-458f-b6d0-d1f38884d8b7 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:51.332752 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 322/651] 10.222.0.52 () {56 vars in 1115 bytes} [Thu Oct 27 13:12:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:51.338008 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6254e-342d-4909-8fa9-67c02eed8483 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:51.400216 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:51.439895 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6254e-342d-4909-8fa9-67c02eed8483 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:51.474419 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2302f-37f1-4b0a-a3d9-87473af478af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:51.475047 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2302f-37f1-4b0a-a3d9-87473af478af None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:51.475318 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2302f-37f1-4b0a-a3d9-87473af478af None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:51.475582 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2302f-37f1-4b0a-a3d9-87473af478af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:51.485970 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e2302f-37f1-4b0a-a3d9-87473af478af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:51.487460 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e2302f-37f1-4b0a-a3d9-87473af478af None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:51.503227 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-d0e2302f-37f1-4b0a-a3d9-87473af478af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:51.503227 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:51.503227 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:51.503227 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:51.503227 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:51.503227 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:51.503227 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:51.503227 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:51.503227 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:51.503227 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:51.503227 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:51.503227 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:51.503227 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:12:51.503227 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:12:51.503227 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:12:51.503227 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:12:51.504205 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:51.504205 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:51.504205 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:51.504205 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:51.504205 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:51.504205 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:51.504205 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:51.504205 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:51.504205 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:51.504205 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:51.504205 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:51.504205 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:51.504205 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:51.504205 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:51.504205 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:51.504205 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:51.504205 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:12:51.505089 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:12:51.505089 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:51.505089 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:51.505089 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 330/652] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:12:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:51.510117 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a88e9e-4a10-458f-b6d0-d1f38884d8b7 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:51.615030 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a88e9e-4a10-458f-b6d0-d1f38884d8b7 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:51.648715 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0f24f-e1b1-4757-af1b-eceac2a174ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:51.649324 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0f24f-e1b1-4757-af1b-eceac2a174ad None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:51.649626 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0f24f-e1b1-4757-af1b-eceac2a174ad None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:51.649894 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0f24f-e1b1-4757-af1b-eceac2a174ad None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:51.650534 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0f24f-e1b1-4757-af1b-eceac2a174ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:51.650831 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0f24f-e1b1-4757-af1b-eceac2a174ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:51.652188 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0f24f-e1b1-4757-af1b-eceac2a174ad None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:51.661692 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:51.665361 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 323/653] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:12:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:12:51.671009 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2302f-37f1-4b0a-a3d9-87473af478af None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:51.773956 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2302f-37f1-4b0a-a3d9-87473af478af None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:51.795126 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:51.815754 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11432666-0779-4c37-8470-889de31917b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:51.816392 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11432666-0779-4c37-8470-889de31917b1 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:51.816659 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11432666-0779-4c37-8470-889de31917b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:51.816920 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11432666-0779-4c37-8470-889de31917b1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:51.824791 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11432666-0779-4c37-8470-889de31917b1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:51.826263 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11432666-0779-4c37-8470-889de31917b1 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:51.837636 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-11432666-0779-4c37-8470-889de31917b1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 13:12:51.837636 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:51.837636 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:51.837636 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:51.837636 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:51.837636 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:51.837636 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:51.837636 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:51.837636 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:51.837636 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:51.837636 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:51.837636 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:51.837636 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 13:12:51.837636 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 13:12:51.837636 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 13:12:51.837636 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 13:12:51.838608 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:51.838608 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:51.838608 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 13:12:51.838608 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:12:51.838608 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 13:12:51.838608 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:12:51.838608 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:51.838608 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:51.838608 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:51.838608 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:51.838608 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:51.838608 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:51.838608 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:51.838608 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:51.838608 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:51.838608 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:51.838608 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:51.838608 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:51.839550 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:51.839550 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:51.839550 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 13:12:51.839550 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 13:12:51.839550 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 13:12:51.839550 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 13:12:51.839550 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 13:12:51.839550 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 13:12:51.839550 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 13:12:51.839550 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:51.843380 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 331/654] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Oct 27 13:12:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:51.844727 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0f24f-e1b1-4757-af1b-eceac2a174ad None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:51.954970 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0f24f-e1b1-4757-af1b-eceac2a174ad None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:51.990071 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6295bb1-e184-42ec-b022-8dd3b2cf4bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:51.990731 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6295bb1-e184-42ec-b022-8dd3b2cf4bc2 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:51.991004 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6295bb1-e184-42ec-b022-8dd3b2cf4bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:51.991314 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6295bb1-e184-42ec-b022-8dd3b2cf4bc2 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:51.992045 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6295bb1-e184-42ec-b022-8dd3b2cf4bc2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:51.992346 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6295bb1-e184-42ec-b022-8dd3b2cf4bc2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:51.993805 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6295bb1-e184-42ec-b022-8dd3b2cf4bc2 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:52.011545 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 324/655] 10.222.0.52 () {56 vars in 1149 bytes} [Thu Oct 27 13:12:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:52.017106 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11432666-0779-4c37-8470-889de31917b1 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:52.050288 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece5120-068f-49d2-8377-440214607206 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:52.050466 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece5120-068f-49d2-8377-440214607206 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:52.050735 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece5120-068f-49d2-8377-440214607206 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:52.052558 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 325/656] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 13:12:52.058087 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87808af5-e985-4741-bb38-07f0ccf98f81 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:52.058522 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87808af5-e985-4741-bb38-07f0ccf98f81 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:52.058923 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87808af5-e985-4741-bb38-07f0ccf98f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:52.077037 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-87808af5-e985-4741-bb38-07f0ccf98f81 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:52.078622 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-87808af5-e985-4741-bb38-07f0ccf98f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:52.128479 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11432666-0779-4c37-8470-889de31917b1 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:52.134660 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:52.157841 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 326/657] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:52 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 13:12:52.167426 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda9111-7b0e-44ed-8491-1f2bd854ee68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:52.168194 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda9111-7b0e-44ed-8491-1f2bd854ee68 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:52.168564 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda9111-7b0e-44ed-8491-1f2bd854ee68 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:52.168931 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda9111-7b0e-44ed-8491-1f2bd854ee68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:52.180056 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cda9111-7b0e-44ed-8491-1f2bd854ee68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:52.181767 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cda9111-7b0e-44ed-8491-1f2bd854ee68 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:52.196958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-7cda9111-7b0e-44ed-8491-1f2bd854ee68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:52.196958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:52.196958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:52.196958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:52.196958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:52.196958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:52.196958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:52.196958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:52.196958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:52.196958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:52.196958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:52.196958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:52.196958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:12:52.196958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:12:52.196958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:12:52.196958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:12:52.197987 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:52.197987 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:52.197987 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:52.197987 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:52.197987 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:52.197987 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:52.197987 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:52.197987 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:52.197987 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:52.197987 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:52.197987 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:52.197987 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:52.197987 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:52.197987 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:52.197987 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:52.197987 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:52.197987 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:12:52.198900 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:12:52.198900 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:52.198900 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:52.202690 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 332/658] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:12:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:52.204052 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87808af5-e985-4741-bb38-07f0ccf98f81 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:52.304684 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87808af5-e985-4741-bb38-07f0ccf98f81 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:52.340886 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0510192-bb8a-4bff-96ec-0841aa49c709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:52.341496 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0510192-bb8a-4bff-96ec-0841aa49c709 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:52.341805 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0510192-bb8a-4bff-96ec-0841aa49c709 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:52.342072 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0510192-bb8a-4bff-96ec-0841aa49c709 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:52.342707 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0510192-bb8a-4bff-96ec-0841aa49c709 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:52.343000 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0510192-bb8a-4bff-96ec-0841aa49c709 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:52.344359 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0510192-bb8a-4bff-96ec-0841aa49c709 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:52.360499 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 327/659] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:12:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:52.361888 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda9111-7b0e-44ed-8491-1f2bd854ee68 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:52.390564 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:52.433863 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0510192-bb8a-4bff-96ec-0841aa49c709 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:52.469205 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda9111-7b0e-44ed-8491-1f2bd854ee68 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:52.503832 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:52.510691 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816bafd-f896-4dd3-b0f5-2b842e0808fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:52.511522 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816bafd-f896-4dd3-b0f5-2b842e0808fc None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:52.511897 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816bafd-f896-4dd3-b0f5-2b842e0808fc None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:52.512264 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816bafd-f896-4dd3-b0f5-2b842e0808fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:52.522168 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816bafd-f896-4dd3-b0f5-2b842e0808fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:52.523842 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816bafd-f896-4dd3-b0f5-2b842e0808fc None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:52.538958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-6816bafd-f896-4dd3-b0f5-2b842e0808fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:12:52.538958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:52.538958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:52.538958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:52.538958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:52.538958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:52.538958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:52.538958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:52.538958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:52.538958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:52.538958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:52.538958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:52.538958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 13:12:52.538958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 13:12:52.538958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 13:12:52.540024 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 13:12:52.540024 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:52.540024 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:52.540024 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:52.540024 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:52.540024 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:52.540024 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:52.540024 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:52.540024 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:52.540024 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:52.540024 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:52.540024 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:52.540024 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:52.540024 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:52.540024 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:52.540024 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:52.540024 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:52.540916 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 13:12:52.540916 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 13:12:52.540916 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 13:12:52.540916 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 13:12:52.540916 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 13:12:52.540916 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 13:12:52.540916 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:12:52.540916 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:52.545195 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 333/660] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Oct 27 13:12:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:52.547175 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816bafd-f896-4dd3-b0f5-2b842e0808fc None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:52.573868 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0510192-bb8a-4bff-96ec-0841aa49c709 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:52.615944 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004bf5d8-2a3f-486e-9e98-500a51a2f038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:52.616586 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004bf5d8-2a3f-486e-9e98-500a51a2f038 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:52.616818 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004bf5d8-2a3f-486e-9e98-500a51a2f038 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:52.617077 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004bf5d8-2a3f-486e-9e98-500a51a2f038 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:52.617812 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004bf5d8-2a3f-486e-9e98-500a51a2f038 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:52.619117 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004bf5d8-2a3f-486e-9e98-500a51a2f038 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:52.636249 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 328/661] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Oct 27 13:12:52 2022] POST /identity/v3/services => generated 241 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:12:52.638351 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f1128-72c0-400c-ad7b-6fb90ce2f442 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:52.638856 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f1128-72c0-400c-ad7b-6fb90ce2f442 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:52.639346 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f1128-72c0-400c-ad7b-6fb90ce2f442 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:52.641951 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 329/662] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:52.649447 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aaf106-fda7-4097-9387-dad06676c4c1 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:52.650691 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:52.651142 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aaf106-fda7-4097-9387-dad06676c4c1 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:52.651660 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aaf106-fda7-4097-9387-dad06676c4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:52.668664 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816bafd-f896-4dd3-b0f5-2b842e0808fc None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:52.675347 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-11aaf106-fda7-4097-9387-dad06676c4c1 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:52.677823 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-11aaf106-fda7-4097-9387-dad06676c4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:52.713194 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99061c-5ef5-4cd6-955f-42952d33d979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:52.713855 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99061c-5ef5-4cd6-955f-42952d33d979 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:52.714134 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99061c-5ef5-4cd6-955f-42952d33d979 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:52.714408 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99061c-5ef5-4cd6-955f-42952d33d979 None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:52.715174 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df99061c-5ef5-4cd6-955f-42952d33d979 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:52.715475 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df99061c-5ef5-4cd6-955f-42952d33d979 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:52.716981 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df99061c-5ef5-4cd6-955f-42952d33d979 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:52.731819 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 334/663] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Oct 27 13:12:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:52.737776 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99061c-5ef5-4cd6-955f-42952d33d979 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:52.769585 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 330/664] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:52 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 13:12:52.863290 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99061c-5ef5-4cd6-955f-42952d33d979 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:52.898362 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3ac1c-3a5f-426a-8a9e-1c46694ae6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:52.899028 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3ac1c-3a5f-426a-8a9e-1c46694ae6a0 None admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:52.899299 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3ac1c-3a5f-426a-8a9e-1c46694ae6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:52.899564 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3ac1c-3a5f-426a-8a9e-1c46694ae6a0 None admin] PATH_INFO: `/v3/projects/0be19dd5a0df4cf79fe2ec14d11521f0/users/cffe930429614615adc2e63e165b9c45/roles/9bda48922f54416c9673d1efc1d45673` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:52.901696 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d3ac1c-3a5f-426a-8a9e-1c46694ae6a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=0be19dd5a0df4cf79fe2ec14d11521f0, user_id=cffe930429614615adc2e63e165b9c45, role_id=9bda48922f54416c9673d1efc1d45673)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:52.903160 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d3ac1c-3a5f-426a-8a9e-1c46694ae6a0 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:52.918126 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 335/665] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Oct 27 13:12:52 2022] PUT /identity/v3/projects/0be19dd5a0df4cf79fe2ec14d11521f0/users/cffe930429614615adc2e63e165b9c45/roles/9bda48922f54416c9673d1efc1d45673 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:12:53.042543 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aaf106-fda7-4097-9387-dad06676c4c1 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:53.088947 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:53.157555 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aaf106-fda7-4097-9387-dad06676c4c1 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:53.167453 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099a9b5-69f6-4ce6-ba17-6446ef7253a3 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:53.167949 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099a9b5-69f6-4ce6-ba17-6446ef7253a3 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:53.168024 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099a9b5-69f6-4ce6-ba17-6446ef7253a3 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:53.173393 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 336/666] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:53.174704 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f2e08-b887-4be3-bb77-2bbd18952439 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:53.174984 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f2e08-b887-4be3-bb77-2bbd18952439 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:53.175259 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f2e08-b887-4be3-bb77-2bbd18952439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:53.194211 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:53.196952 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a8457-f0fe-4bdb-b001-93991697b49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:53.197217 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-ed5f2e08-b887-4be3-bb77-2bbd18952439 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:53.197633 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a8457-f0fe-4bdb-b001-93991697b49c None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:53.197910 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a8457-f0fe-4bdb-b001-93991697b49c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:53.198232 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a8457-f0fe-4bdb-b001-93991697b49c None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:53.199013 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a8457-f0fe-4bdb-b001-93991697b49c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:53.199239 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ed5f2e08-b887-4be3-bb77-2bbd18952439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:53.200970 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a8457-f0fe-4bdb-b001-93991697b49c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:53.229888 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 331/667] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Oct 27 13:12:53 2022] POST /identity/v3/services => generated 251 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:12:53.285935 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 337/668] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 13:12:53.559127 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a8457-f0fe-4bdb-b001-93991697b49c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:53.663343 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:53.668576 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a8457-f0fe-4bdb-b001-93991697b49c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:53.704637 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca1509-f8e9-4ea1-a636-ab05eaa27611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:53.705317 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca1509-f8e9-4ea1-a636-ab05eaa27611 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:53.705697 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca1509-f8e9-4ea1-a636-ab05eaa27611 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:53.706033 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca1509-f8e9-4ea1-a636-ab05eaa27611 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:53.706624 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca1509-f8e9-4ea1-a636-ab05eaa27611 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:53.708003 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca1509-f8e9-4ea1-a636-ab05eaa27611 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:53.716930 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-90ca1509-f8e9-4ea1-a636-ab05eaa27611 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 13:12:53.716930 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:53.716930 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 13:12:53.716930 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 13:12:53.716930 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 13:12:53.716930 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 13:12:53.716930 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 13:12:53.716930 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:12:53.716930 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 13:12:53.716930 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:53.716930 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 13:12:53.716930 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:53.716930 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:53.716930 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:53.716930 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:53.716930 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:53.717899 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:53.717899 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:53.717899 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:53.717899 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:53.717899 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:53.717899 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:53.717899 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:53.717899 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 13:12:53.717899 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 13:12:53.717899 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 13:12:53.717899 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 13:12:53.717899 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:53.717899 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:53.717899 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:53.717899 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:53.717899 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:53.717899 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:53.719172 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:53.719172 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:53.719172 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:53.719172 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:53.719172 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:53.719172 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:53.719172 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:53.719172 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:53.719172 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:53.719172 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:53.719172 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 13:12:53.719172 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:12:53.719172 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 13:12:53.719172 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:53.719172 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 332/669] 10.222.0.52 () {56 vars in 1132 bytes} [Thu Oct 27 13:12:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:53.724462 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f2e08-b887-4be3-bb77-2bbd18952439 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:53.836932 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f2e08-b887-4be3-bb77-2bbd18952439 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:53.867771 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:53.876588 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c53895-e351-4f56-8b87-b3ba77f49118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:53.877210 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c53895-e351-4f56-8b87-b3ba77f49118 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:53.877483 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c53895-e351-4f56-8b87-b3ba77f49118 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:53.877840 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c53895-e351-4f56-8b87-b3ba77f49118 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:53.878830 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c53895-e351-4f56-8b87-b3ba77f49118 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:53.879129 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c53895-e351-4f56-8b87-b3ba77f49118 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:53.880556 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c53895-e351-4f56-8b87-b3ba77f49118 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:53.886362 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 338/670] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Oct 27 13:12:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:53.895324 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca1509-f8e9-4ea1-a636-ab05eaa27611 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:53.997749 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca1509-f8e9-4ea1-a636-ab05eaa27611 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:54.032445 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcbe0c6-0a82-48f1-950b-e32a565b5c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:54.033059 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbe0c6-0a82-48f1-950b-e32a565b5c42 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:54.033340 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbe0c6-0a82-48f1-950b-e32a565b5c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:54.033640 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbe0c6-0a82-48f1-950b-e32a565b5c42 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:54.034369 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcbe0c6-0a82-48f1-950b-e32a565b5c42 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:54.034675 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcbe0c6-0a82-48f1-950b-e32a565b5c42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:54.036042 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcbe0c6-0a82-48f1-950b-e32a565b5c42 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:54.041255 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 333/671] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Oct 27 13:12:53 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:54.047150 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c53895-e351-4f56-8b87-b3ba77f49118 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:54.148089 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c53895-e351-4f56-8b87-b3ba77f49118 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:54.182122 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28483f-ed27-4b92-932c-ccec20a54843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:54.183079 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28483f-ed27-4b92-932c-ccec20a54843 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:54.183320 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28483f-ed27-4b92-932c-ccec20a54843 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:54.183579 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28483f-ed27-4b92-932c-ccec20a54843 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:54.184278 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28483f-ed27-4b92-932c-ccec20a54843 None admin] RBAC: Adding query filter params (interface=public, service_id=df493ddd37b14630ad81d7c5ed4671b8, region_id=RegionOne) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:54.184727 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28483f-ed27-4b92-932c-ccec20a54843 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:54.186143 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28483f-ed27-4b92-932c-ccec20a54843 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:54.191627 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 339/672] 10.222.0.52 () {56 vars in 1251 bytes} [Thu Oct 27 13:12:54 2022] GET /identity/v3/endpoints?service_id=df493ddd37b14630ad81d7c5ed4671b8&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:54.197422 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcbe0c6-0a82-48f1-950b-e32a565b5c42 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:54.227654 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:54.298830 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcbe0c6-0a82-48f1-950b-e32a565b5c42 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:54.333072 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b396da02-b2ad-40ae-be9c-8e970e9e0cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:54.333700 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396da02-b2ad-40ae-be9c-8e970e9e0cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:54.333979 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396da02-b2ad-40ae-be9c-8e970e9e0cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:54.334246 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396da02-b2ad-40ae-be9c-8e970e9e0cd2 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:54.334848 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b396da02-b2ad-40ae-be9c-8e970e9e0cd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:54.336210 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b396da02-b2ad-40ae-be9c-8e970e9e0cd2 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:54.342564 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 334/673] 10.222.0.52 () {56 vars in 1087 bytes} [Thu Oct 27 13:12:54 2022] GET /identity/v3/services => generated 1497 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:12:54.954067 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5ebd8-6879-47bc-a2cd-c4d6522dc982 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:54.954773 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5ebd8-6879-47bc-a2cd-c4d6522dc982 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:54.955274 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5ebd8-6879-47bc-a2cd-c4d6522dc982 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:54.957161 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 340/674] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:54.962852 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d843b0-5c9e-4acb-b808-3533348bab92 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:54.963712 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d843b0-5c9e-4acb-b808-3533348bab92 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:54.964175 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d843b0-5c9e-4acb-b808-3533348bab92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:54.982879 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-25d843b0-5c9e-4acb-b808-3533348bab92 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:54.984433 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-25d843b0-5c9e-4acb-b808-3533348bab92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:55.058271 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 335/675] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 13:12:55.208332 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea338f31-aa50-40cd-97a6-ec3d1e9dbd32 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:55.208898 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea338f31-aa50-40cd-97a6-ec3d1e9dbd32 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:55.208898 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea338f31-aa50-40cd-97a6-ec3d1e9dbd32 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:55.210563 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 341/676] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:55.223249 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7f3fd-6c5d-4569-994b-a2cdb0f0e94a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:55.223830 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7f3fd-6c5d-4569-994b-a2cdb0f0e94a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:55.224302 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7f3fd-6c5d-4569-994b-a2cdb0f0e94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:55.243479 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-b6d7f3fd-6c5d-4569-994b-a2cdb0f0e94a None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:55.245035 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b6d7f3fd-6c5d-4569-994b-a2cdb0f0e94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:55.261042 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:55.328033 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 336/677] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 13:12:55.353313 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea338f31-aa50-40cd-97a6-ec3d1e9dbd32 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:55.417631 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:55.476913 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea338f31-aa50-40cd-97a6-ec3d1e9dbd32 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:55.517556 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1583e-2d93-4eda-a72c-ad405c104afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:55.518214 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1583e-2d93-4eda-a72c-ad405c104afe None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:55.518510 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1583e-2d93-4eda-a72c-ad405c104afe None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:55.518782 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1583e-2d93-4eda-a72c-ad405c104afe None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:55.519372 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f1583e-2d93-4eda-a72c-ad405c104afe None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:55.520786 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f1583e-2d93-4eda-a72c-ad405c104afe None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:55.530965 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-95f1583e-2d93-4eda-a72c-ad405c104afe None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 13:12:55.530965 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:55.530965 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 13:12:55.530965 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 13:12:55.530965 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 13:12:55.530965 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 13:12:55.530965 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 13:12:55.530965 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:12:55.530965 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 13:12:55.530965 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:55.530965 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 13:12:55.530965 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:55.530965 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:55.530965 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:55.530965 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:55.530965 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:55.530965 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:55.531995 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:55.531995 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:55.531995 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:55.531995 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:55.531995 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:55.531995 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:55.531995 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 13:12:55.531995 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 13:12:55.531995 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 13:12:55.531995 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 13:12:55.531995 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:55.531995 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:55.531995 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:55.531995 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:55.531995 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:55.531995 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:55.533280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:55.533280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:55.533280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:55.533280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:55.533280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:55.533280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:55.533280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:55.533280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:55.533280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:55.533280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:55.533280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 13:12:55.533280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:12:55.533280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 13:12:55.533280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:55.533280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 342/678] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Oct 27 13:12:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:55.543288 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7f3fd-6c5d-4569-994b-a2cdb0f0e94a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:55.589612 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff8d72-f931-4984-87a9-87f5259f0852 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:55.589975 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff8d72-f931-4984-87a9-87f5259f0852 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:55.590336 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff8d72-f931-4984-87a9-87f5259f0852 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:55.593161 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 343/679] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 13:12:55.597904 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fa26d-ce92-470b-9469-39e582491d78 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:55.598596 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fa26d-ce92-470b-9469-39e582491d78 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:55.598596 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fa26d-ce92-470b-9469-39e582491d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:55.621796 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-ce7fa26d-ce92-470b-9469-39e582491d78 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:55.622984 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ce7fa26d-ce92-470b-9469-39e582491d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:55.679414 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7f3fd-6c5d-4569-994b-a2cdb0f0e94a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:55.710415 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 344/680] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 13:12:55.711089 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7fa26d-ce92-470b-9469-39e582491d78 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:55.730682 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298f715-b0a4-4b0e-9b76-1622288965d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:55.731756 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298f715-b0a4-4b0e-9b76-1622288965d9 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:55.732231 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298f715-b0a4-4b0e-9b76-1622288965d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:55.732782 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298f715-b0a4-4b0e-9b76-1622288965d9 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:55.733687 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298f715-b0a4-4b0e-9b76-1622288965d9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:55.734199 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298f715-b0a4-4b0e-9b76-1622288965d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:55.736047 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298f715-b0a4-4b0e-9b76-1622288965d9 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:55.743478 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 337/681] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Oct 27 13:12:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:55.752188 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298f715-b0a4-4b0e-9b76-1622288965d9 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:55.765345 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:55.778093 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:55.824104 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7fa26d-ce92-470b-9469-39e582491d78 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:55.860496 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da1c5f-bcf9-4d70-b305-d90a7af4f66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:55.861077 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da1c5f-bcf9-4d70-b305-d90a7af4f66b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:55.861350 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da1c5f-bcf9-4d70-b305-d90a7af4f66b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:55.861761 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da1c5f-bcf9-4d70-b305-d90a7af4f66b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:55.876547 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51da1c5f-bcf9-4d70-b305-d90a7af4f66b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:12:55.882763 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-51da1c5f-bcf9-4d70-b305-d90a7af4f66b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 13:12:55.882763 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:55.882763 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:55.882763 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:55.882763 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:55.882763 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:55.882763 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:55.882763 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:55.882763 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:55.882763 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:55.882763 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:55.882763 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:55.882763 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:12:55.882763 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:12:55.882763 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:12:55.882763 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:12:55.883694 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:12:55.883694 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:12:55.883694 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:12:55.883694 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:12:55.883694 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:55.883694 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:55.883694 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:55.883694 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:55.883694 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:55.883694 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:55.883694 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:55.883694 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:55.883694 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:55.883694 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:55.883694 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:55.883694 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:55.884545 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:55.884545 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:55.884545 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:55.884545 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:55.884545 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:12:55.884545 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:12:55.884545 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:12:55.884545 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:12:55.884545 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:12:55.884545 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:12:55.884545 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 13:12:55.884545 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:55.886889 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 345/682] 10.222.0.52 () {56 vars in 1120 bytes} [Thu Oct 27 13:12:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:55.892583 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da1c5f-bcf9-4d70-b305-d90a7af4f66b None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:55.915538 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298f715-b0a4-4b0e-9b76-1622288965d9 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:55.955890 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a833e5-ddd1-4a60-aa34-70d5f661a257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:55.956464 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a833e5-ddd1-4a60-aa34-70d5f661a257 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:55.956743 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a833e5-ddd1-4a60-aa34-70d5f661a257 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:55.957015 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a833e5-ddd1-4a60-aa34-70d5f661a257 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:55.957672 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a833e5-ddd1-4a60-aa34-70d5f661a257 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:55.958096 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a833e5-ddd1-4a60-aa34-70d5f661a257 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:55.959511 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a833e5-ddd1-4a60-aa34-70d5f661a257 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:55.970162 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 338/683] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Oct 27 13:12:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:12:55.972395 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a833e5-ddd1-4a60-aa34-70d5f661a257 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:56.014290 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da1c5f-bcf9-4d70-b305-d90a7af4f66b None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:56.026147 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:56.054111 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b408be-823b-4db1-ba65-7066c086b0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:56.054725 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b408be-823b-4db1-ba65-7066c086b0e2 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:56.054998 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b408be-823b-4db1-ba65-7066c086b0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:56.055264 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b408be-823b-4db1-ba65-7066c086b0e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:56.055924 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b408be-823b-4db1-ba65-7066c086b0e2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:56.056221 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b408be-823b-4db1-ba65-7066c086b0e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:56.057941 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b408be-823b-4db1-ba65-7066c086b0e2 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:56.061670 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:56.069583 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 346/684] 10.222.0.52 () {56 vars in 1115 bytes} [Thu Oct 27 13:12:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:12:56.069583 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b408be-823b-4db1-ba65-7066c086b0e2 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:56.091038 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a833e5-ddd1-4a60-aa34-70d5f661a257 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:56.127413 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95588b13-d2a5-4c52-aebe-58c69b1f3181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:56.128454 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95588b13-d2a5-4c52-aebe-58c69b1f3181 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:56.128972 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95588b13-d2a5-4c52-aebe-58c69b1f3181 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:56.129398 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95588b13-d2a5-4c52-aebe-58c69b1f3181 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:56.130261 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95588b13-d2a5-4c52-aebe-58c69b1f3181 None admin] RBAC: Adding query filter params (interface=public, service_id=c8621104cbb14f738d26426143d2c436, region_id=RegionOne) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:56.130740 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95588b13-d2a5-4c52-aebe-58c69b1f3181 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:56.132396 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95588b13-d2a5-4c52-aebe-58c69b1f3181 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:56.142308 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 339/685] 10.222.0.52 () {56 vars in 1251 bytes} [Thu Oct 27 13:12:55 2022] GET /identity/v3/endpoints?service_id=c8621104cbb14f738d26426143d2c436&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:56.142750 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95588b13-d2a5-4c52-aebe-58c69b1f3181 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:56.170125 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b408be-823b-4db1-ba65-7066c086b0e2 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:56.205699 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3eef5-aac5-474e-bc16-71ee7600d8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:56.206354 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3eef5-aac5-474e-bc16-71ee7600d8c6 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:56.206628 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3eef5-aac5-474e-bc16-71ee7600d8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:56.206890 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3eef5-aac5-474e-bc16-71ee7600d8c6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:56.207466 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b3eef5-aac5-474e-bc16-71ee7600d8c6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:56.208843 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b3eef5-aac5-474e-bc16-71ee7600d8c6 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:56.217959 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-87b3eef5-aac5-474e-bc16-71ee7600d8c6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 13:12:56.217959 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:56.217959 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 13:12:56.217959 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 13:12:56.217959 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 13:12:56.217959 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 13:12:56.217959 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 13:12:56.217959 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:12:56.217959 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 13:12:56.217959 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:56.217959 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 13:12:56.217959 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:56.217959 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:56.217959 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:56.217959 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:56.217959 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:56.217959 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:56.221800 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:56.221800 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:56.221800 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:56.221800 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:56.221800 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:56.221800 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:56.221800 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 13:12:56.221800 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 13:12:56.221800 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 13:12:56.221800 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 13:12:56.221800 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:56.221800 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:56.221800 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:56.221800 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:56.221800 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:56.221800 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:56.222661 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:56.222661 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:56.222661 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:56.222661 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:56.222661 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:56.222661 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:56.222661 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:56.222661 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:56.222661 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:56.222661 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:56.222661 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 13:12:56.222661 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:12:56.222661 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 13:12:56.222661 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:56.222661 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 347/686] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Oct 27 13:12:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:56.223436 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3eef5-aac5-474e-bc16-71ee7600d8c6 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:56.257996 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:56.267605 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95588b13-d2a5-4c52-aebe-58c69b1f3181 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:56.306095 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa03b1fe-535b-42a9-9403-8954cfe1724c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:56.306961 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03b1fe-535b-42a9-9403-8954cfe1724c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:56.307244 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03b1fe-535b-42a9-9403-8954cfe1724c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:56.307836 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03b1fe-535b-42a9-9403-8954cfe1724c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:56.318533 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa03b1fe-535b-42a9-9403-8954cfe1724c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:56.319975 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa03b1fe-535b-42a9-9403-8954cfe1724c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:56.322267 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:56.327467 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3eef5-aac5-474e-bc16-71ee7600d8c6 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:56.338325 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-aa03b1fe-535b-42a9-9403-8954cfe1724c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:56.338325 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:56.338325 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:56.338325 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:56.338325 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:56.338325 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:56.338325 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:56.338325 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:56.338325 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:56.338325 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:56.338325 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:56.338325 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:56.338325 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:12:56.338325 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:12:56.338325 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:12:56.338325 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:12:56.339308 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:56.339308 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:56.339308 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:56.339308 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:56.339308 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:56.339308 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:56.339308 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:56.339308 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:56.339308 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:56.339308 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:56.339308 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:56.339308 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:56.339308 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:56.339308 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:56.339308 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:56.339308 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:56.339308 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:12:56.340176 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:12:56.340176 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:56.340176 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:56.344438 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 340/687] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:12:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:56.345286 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa03b1fe-535b-42a9-9403-8954cfe1724c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:56.364602 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11332b95-700e-4625-88de-f70667d8dd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:56.365236 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11332b95-700e-4625-88de-f70667d8dd9b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:56.365515 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11332b95-700e-4625-88de-f70667d8dd9b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:56.365827 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11332b95-700e-4625-88de-f70667d8dd9b None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:56.366487 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11332b95-700e-4625-88de-f70667d8dd9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:56.367870 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11332b95-700e-4625-88de-f70667d8dd9b None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:56.374391 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 348/688] 10.222.0.52 () {56 vars in 1087 bytes} [Thu Oct 27 13:12:56 2022] GET /identity/v3/services => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:12:56.374988 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11332b95-700e-4625-88de-f70667d8dd9b None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:56.490528 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:56.493012 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa03b1fe-535b-42a9-9403-8954cfe1724c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:56.494141 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11332b95-700e-4625-88de-f70667d8dd9b None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:56.537012 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a7a30-4dae-49e3-a9cb-e6616da317dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:56.537835 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a7a30-4dae-49e3-a9cb-e6616da317dc None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:56.538209 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a7a30-4dae-49e3-a9cb-e6616da317dc None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:56.538596 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a7a30-4dae-49e3-a9cb-e6616da317dc None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:56.539467 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a7a30-4dae-49e3-a9cb-e6616da317dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:56.539760 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a7a30-4dae-49e3-a9cb-e6616da317dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:56.541287 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a7a30-4dae-49e3-a9cb-e6616da317dc None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:56.546780 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971f6db-9949-444d-bdd2-4f63be8431a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:56.547638 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971f6db-9949-444d-bdd2-4f63be8431a8 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:56.548077 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971f6db-9949-444d-bdd2-4f63be8431a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:56.548488 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971f6db-9949-444d-bdd2-4f63be8431a8 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:56.550050 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971f6db-9949-444d-bdd2-4f63be8431a8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:56.550551 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971f6db-9949-444d-bdd2-4f63be8431a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:56.552693 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971f6db-9949-444d-bdd2-4f63be8431a8 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:56.559355 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 341/689] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Oct 27 13:12:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:56.564536 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 349/690] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:56.564666 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971f6db-9949-444d-bdd2-4f63be8431a8 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:56.566783 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a7a30-4dae-49e3-a9cb-e6616da317dc None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:56.630289 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:56.676845 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971f6db-9949-444d-bdd2-4f63be8431a8 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:56.686774 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a7a30-4dae-49e3-a9cb-e6616da317dc None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:56.713301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492529b-5fed-4e2d-8c93-93c87a547599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:56.713964 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492529b-5fed-4e2d-8c93-93c87a547599 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:56.714245 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492529b-5fed-4e2d-8c93-93c87a547599 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:56.714646 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492529b-5fed-4e2d-8c93-93c87a547599 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:56.722598 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa54f5-ec4c-4cc1-8bd3-9ee89e92a5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:56.722859 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7492529b-5fed-4e2d-8c93-93c87a547599 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:56.723260 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa54f5-ec4c-4cc1-8bd3-9ee89e92a5f5 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:56.723533 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa54f5-ec4c-4cc1-8bd3-9ee89e92a5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:56.723799 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa54f5-ec4c-4cc1-8bd3-9ee89e92a5f5 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:56.724251 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7492529b-5fed-4e2d-8c93-93c87a547599 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:56.724423 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa54f5-ec4c-4cc1-8bd3-9ee89e92a5f5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:56.724719 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa54f5-ec4c-4cc1-8bd3-9ee89e92a5f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:56.726114 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa54f5-ec4c-4cc1-8bd3-9ee89e92a5f5 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:56.731104 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 350/691] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Oct 27 13:12:56 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:56.732268 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d9630-510c-45de-a7c4-bacf36caccd5 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:56.732540 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d9630-510c-45de-a7c4-bacf36caccd5 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:56.732807 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d9630-510c-45de-a7c4-bacf36caccd5 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:56.734183 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 351/692] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:56.738963 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d9630-510c-45de-a7c4-bacf36caccd5 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:56.741846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-7492529b-5fed-4e2d-8c93-93c87a547599 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 13:12:56.741846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:56.741846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:56.741846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:56.741846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:56.741846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:56.741846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:56.741846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:56.741846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:56.741846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:56.741846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:56.741846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:56.741846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 13:12:56.741846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 13:12:56.741846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 13:12:56.741846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 13:12:56.742952 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:56.742952 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:56.742952 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 13:12:56.742952 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:12:56.742952 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 13:12:56.742952 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:12:56.742952 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:56.742952 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:56.742952 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:56.742952 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:56.742952 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:56.742952 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:56.742952 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:56.742952 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:56.742952 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:56.742952 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:56.742952 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:56.742952 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:56.744012 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:56.744012 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:56.744012 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 13:12:56.744012 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 13:12:56.744012 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 13:12:56.744012 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 13:12:56.744012 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 13:12:56.744012 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 13:12:56.744012 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 13:12:56.744012 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:56.750486 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 342/693] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Oct 27 13:12:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:56.752015 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7acebb-14bb-4dac-851f-9a3b6f6aa5b4 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:56.752456 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7acebb-14bb-4dac-851f-9a3b6f6aa5b4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:56.752830 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7acebb-14bb-4dac-851f-9a3b6f6aa5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:56.766563 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:56.771559 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-af7acebb-14bb-4dac-851f-9a3b6f6aa5b4 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:56.772800 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-af7acebb-14bb-4dac-851f-9a3b6f6aa5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:56.853226 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 343/694] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 13:12:56.853799 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d9630-510c-45de-a7c4-bacf36caccd5 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:56.854178 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7acebb-14bb-4dac-851f-9a3b6f6aa5b4 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:56.902910 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a18276-3093-4b42-9e15-d58bb1a2b33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:56.903527 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a18276-3093-4b42-9e15-d58bb1a2b33d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:56.903812 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a18276-3093-4b42-9e15-d58bb1a2b33d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:56.904155 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a18276-3093-4b42-9e15-d58bb1a2b33d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:56.904837 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a18276-3093-4b42-9e15-d58bb1a2b33d None admin] RBAC: Adding query filter params (interface=public, service_id=d529a426304d4a949fee6d1cc48776b7, region_id=RegionOne) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:56.905145 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a18276-3093-4b42-9e15-d58bb1a2b33d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:56.906314 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:56.907339 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a18276-3093-4b42-9e15-d58bb1a2b33d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:56.915597 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 352/695] 10.222.0.52 () {56 vars in 1251 bytes} [Thu Oct 27 13:12:56 2022] GET /identity/v3/endpoints?service_id=d529a426304d4a949fee6d1cc48776b7&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:56.921171 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a18276-3093-4b42-9e15-d58bb1a2b33d None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:56.979524 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7acebb-14bb-4dac-851f-9a3b6f6aa5b4 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:57.016617 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d3832-e1ad-4231-93a9-cfdde0e4e202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:57.017446 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d3832-e1ad-4231-93a9-cfdde0e4e202 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:57.017912 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d3832-e1ad-4231-93a9-cfdde0e4e202 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:57.018362 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d3832-e1ad-4231-93a9-cfdde0e4e202 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:57.019418 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3d3832-e1ad-4231-93a9-cfdde0e4e202 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:57.019880 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3d3832-e1ad-4231-93a9-cfdde0e4e202 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:57.021510 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3d3832-e1ad-4231-93a9-cfdde0e4e202 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:57.028492 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:57.039563 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 344/696] 10.222.0.52 () {56 vars in 1149 bytes} [Thu Oct 27 13:12:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:57.044456 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a18276-3093-4b42-9e15-d58bb1a2b33d None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:57.047678 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d3832-e1ad-4231-93a9-cfdde0e4e202 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:57.087079 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52222775-9f89-4e37-836f-ebfe110a7c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:57.087752 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52222775-9f89-4e37-836f-ebfe110a7c8b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:57.088032 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52222775-9f89-4e37-836f-ebfe110a7c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:57.088305 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52222775-9f89-4e37-836f-ebfe110a7c8b None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:57.089374 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52222775-9f89-4e37-836f-ebfe110a7c8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:57.091058 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52222775-9f89-4e37-836f-ebfe110a7c8b None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:57.101708 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 353/697] 10.222.0.52 () {56 vars in 1087 bytes} [Thu Oct 27 13:12:56 2022] GET /identity/v3/services => generated 1497 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 13:12:57.145979 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52222775-9f89-4e37-836f-ebfe110a7c8b None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:57.178860 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d3832-e1ad-4231-93a9-cfdde0e4e202 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:57.189933 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:57.230050 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa58fa-c792-4886-bf7d-0c5b6ce8acad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:57.231093 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa58fa-c792-4886-bf7d-0c5b6ce8acad None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:57.231630 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa58fa-c792-4886-bf7d-0c5b6ce8acad None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:57.232106 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa58fa-c792-4886-bf7d-0c5b6ce8acad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:57.282690 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52222775-9f89-4e37-836f-ebfe110a7c8b None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:57.319070 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa58fa-c792-4886-bf7d-0c5b6ce8acad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:57.320571 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa58fa-c792-4886-bf7d-0c5b6ce8acad None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:57.326286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2c9b7-34ec-4637-b93b-a38a5d6cac7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:57.327318 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2c9b7-34ec-4637-b93b-a38a5d6cac7a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:57.327786 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2c9b7-34ec-4637-b93b-a38a5d6cac7a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:57.328242 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2c9b7-34ec-4637-b93b-a38a5d6cac7a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:57.329054 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf2c9b7-34ec-4637-b93b-a38a5d6cac7a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:57.330964 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf2c9b7-34ec-4637-b93b-a38a5d6cac7a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:57.344061 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-edf2c9b7-34ec-4637-b93b-a38a5d6cac7a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 13:12:57.344061 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:57.344061 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 13:12:57.344061 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 13:12:57.344061 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 13:12:57.344061 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 13:12:57.344061 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 13:12:57.344061 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:12:57.344061 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 13:12:57.344061 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:57.344061 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 13:12:57.344061 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:57.344061 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:57.344061 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:57.344061 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:57.344061 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:57.345061 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:57.345061 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:57.345061 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:57.345061 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:57.345061 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:57.345061 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:57.345061 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:57.345061 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 13:12:57.345061 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 13:12:57.345061 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 13:12:57.345061 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 13:12:57.345061 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:57.345061 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:57.345061 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:57.345061 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:57.345061 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:57.345061 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:57.346069 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:57.346069 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:57.346069 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:57.346069 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:57.346069 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:57.346069 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:57.346069 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:57.346069 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:57.346069 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:57.346069 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:57.346069 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 13:12:57.346069 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:12:57.346069 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 13:12:57.346069 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:57.349631 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 354/698] 10.222.0.52 () {56 vars in 1132 bytes} [Thu Oct 27 13:12:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:12:57.351478 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2c9b7-34ec-4637-b93b-a38a5d6cac7a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:57.370231 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:57.443071 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 345/699] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Oct 27 13:12:57 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 27 13:12:57.448746 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa58fa-c792-4886-bf7d-0c5b6ce8acad None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:57.455465 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2c9b7-34ec-4637-b93b-a38a5d6cac7a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:57.456777 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:57.494018 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c95b3-d537-4ad4-b624-200574e38c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:57.495150 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c95b3-d537-4ad4-b624-200574e38c94 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:57.495614 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c95b3-d537-4ad4-b624-200574e38c94 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:57.496147 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c95b3-d537-4ad4-b624-200574e38c94 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:57.496942 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7c95b3-d537-4ad4-b624-200574e38c94 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:57.497412 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7c95b3-d537-4ad4-b624-200574e38c94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:57.499093 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7c95b3-d537-4ad4-b624-200574e38c94 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:57.509418 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 355/700] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Oct 27 13:12:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:12:57.511099 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c95b3-d537-4ad4-b624-200574e38c94 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:57.555404 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa58fa-c792-4886-bf7d-0c5b6ce8acad None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:57.592121 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f1cfa-1316-41d3-9f6d-1742ab717ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:57.592755 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f1cfa-1316-41d3-9f6d-1742ab717ee7 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:57.593034 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f1cfa-1316-41d3-9f6d-1742ab717ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:57.593301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f1cfa-1316-41d3-9f6d-1742ab717ee7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:57.599317 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:57.605381 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f1cfa-1316-41d3-9f6d-1742ab717ee7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:57.607511 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f1cfa-1316-41d3-9f6d-1742ab717ee7 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:57.623185 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c95b3-d537-4ad4-b624-200574e38c94 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:57.623830 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-ad5f1cfa-1316-41d3-9f6d-1742ab717ee7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:57.623830 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:57.623830 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:57.623830 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:57.623830 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:57.623830 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:57.623830 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:57.623830 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:57.623830 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:57.623830 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:57.623830 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:57.623830 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:57.623830 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:12:57.623830 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:12:57.623830 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:12:57.623830 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:12:57.624741 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:57.624741 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:57.624741 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:57.624741 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:57.624741 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:57.624741 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:57.624741 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:57.624741 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:57.624741 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:57.624741 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:57.624741 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:57.624741 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:57.624741 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:57.624741 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:57.624741 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:57.624741 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:57.624741 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:12:57.625732 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:12:57.625732 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:12:57.625732 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:57.630058 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 346/701] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:12:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:12:57.631120 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f1cfa-1316-41d3-9f6d-1742ab717ee7 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:57.672358 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aacaf8-1075-4840-ade0-aef938c8d70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:57.672980 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aacaf8-1075-4840-ade0-aef938c8d70e None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:57.673259 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aacaf8-1075-4840-ade0-aef938c8d70e None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:57.673557 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aacaf8-1075-4840-ade0-aef938c8d70e None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:57.674220 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aacaf8-1075-4840-ade0-aef938c8d70e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:57.674500 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aacaf8-1075-4840-ade0-aef938c8d70e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:57.676068 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aacaf8-1075-4840-ade0-aef938c8d70e None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:57.687362 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 356/702] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Oct 27 13:12:57 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:12:57.690067 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aacaf8-1075-4840-ade0-aef938c8d70e None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:57.712097 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:57.765016 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f1cfa-1316-41d3-9f6d-1742ab717ee7 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:57.818357 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df72b49-46f2-44fc-8d27-6b3958c88dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:57.818976 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df72b49-46f2-44fc-8d27-6b3958c88dcc None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:57.819255 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df72b49-46f2-44fc-8d27-6b3958c88dcc None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:57.819529 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df72b49-46f2-44fc-8d27-6b3958c88dcc None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:57.820434 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df72b49-46f2-44fc-8d27-6b3958c88dcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:57.820746 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df72b49-46f2-44fc-8d27-6b3958c88dcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:57.822844 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df72b49-46f2-44fc-8d27-6b3958c88dcc None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:57.827514 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aacaf8-1075-4840-ade0-aef938c8d70e None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:57.838741 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 347/703] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:12:57.843929 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df72b49-46f2-44fc-8d27-6b3958c88dcc None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:57.873986 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad7a74-f189-4deb-b445-ffa4658f5430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:57.874689 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad7a74-f189-4deb-b445-ffa4658f5430 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:57.874971 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad7a74-f189-4deb-b445-ffa4658f5430 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:57.875242 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad7a74-f189-4deb-b445-ffa4658f5430 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:57.876216 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad7a74-f189-4deb-b445-ffa4658f5430 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:57.878504 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad7a74-f189-4deb-b445-ffa4658f5430 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:57.899035 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:57.913735 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 357/704] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:12:57 2022] POST /identity/v3/endpoints => generated 347 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:12:57.964903 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df72b49-46f2-44fc-8d27-6b3958c88dcc None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:57.985996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:58.013108 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604629a7-0a96-4d3c-9f37-27c3904cd096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:58.013788 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604629a7-0a96-4d3c-9f37-27c3904cd096 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:58.014064 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604629a7-0a96-4d3c-9f37-27c3904cd096 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:58.014484 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604629a7-0a96-4d3c-9f37-27c3904cd096 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:58.022570 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604629a7-0a96-4d3c-9f37-27c3904cd096 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:58.024037 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604629a7-0a96-4d3c-9f37-27c3904cd096 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:58.036548 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-604629a7-0a96-4d3c-9f37-27c3904cd096 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:12:58.036548 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:58.036548 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:58.036548 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:58.036548 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:58.036548 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:58.036548 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:58.036548 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:58.036548 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:58.036548 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:58.036548 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:58.036548 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:58.036548 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 13:12:58.036548 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 13:12:58.036548 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 13:12:58.037513 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 13:12:58.037513 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:58.037513 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:58.037513 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:58.037513 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:58.037513 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:58.037513 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:58.037513 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:58.037513 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:58.037513 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:58.037513 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:58.037513 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:58.037513 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:58.037513 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:58.037513 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:58.037513 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:58.037513 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:58.038828 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 13:12:58.038828 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 13:12:58.038828 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 13:12:58.038828 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 13:12:58.038828 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 13:12:58.038828 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 13:12:58.038828 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:12:58.038828 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:12:58.038828 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 348/705] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Oct 27 13:12:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:12:58.043932 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad7a74-f189-4deb-b445-ffa4658f5430 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:58.156949 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad7a74-f189-4deb-b445-ffa4658f5430 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:58.193421 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c5247-2d5d-4271-b6f6-442463f21d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:58.194419 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c5247-2d5d-4271-b6f6-442463f21d7b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:58.194889 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c5247-2d5d-4271-b6f6-442463f21d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:58.195363 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c5247-2d5d-4271-b6f6-442463f21d7b None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:58.196252 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c5247-2d5d-4271-b6f6-442463f21d7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:58.196742 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c5247-2d5d-4271-b6f6-442463f21d7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:58.198411 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c5247-2d5d-4271-b6f6-442463f21d7b None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:58.212268 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 358/706] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Oct 27 13:12:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:58.217985 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604629a7-0a96-4d3c-9f37-27c3904cd096 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:58.327093 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604629a7-0a96-4d3c-9f37-27c3904cd096 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:58.362572 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e5e79-e885-4371-adf3-138e9d5d14d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:58.363238 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e5e79-e885-4371-adf3-138e9d5d14d4 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:58.363515 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e5e79-e885-4371-adf3-138e9d5d14d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:58.363784 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e5e79-e885-4371-adf3-138e9d5d14d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:58.364558 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e5e79-e885-4371-adf3-138e9d5d14d4 None admin] RBAC: Adding query filter params (role.id=9bda48922f54416c9673d1efc1d45673, scope.project.id=0be19dd5a0df4cf79fe2ec14d11521f0, user.id=cffe930429614615adc2e63e165b9c45) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:58.364861 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e5e79-e885-4371-adf3-138e9d5d14d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:58.366318 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e5e79-e885-4371-adf3-138e9d5d14d4 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:58.372748 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 349/707] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Oct 27 13:12:58 2022] GET /identity/v3/role_assignments?user.id=cffe930429614615adc2e63e165b9c45&scope.project.id=0be19dd5a0df4cf79fe2ec14d11521f0&role.id=9bda48922f54416c9673d1efc1d45673 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:12:58.629365 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c740554-82cf-4d24-a7ea-610dd8cb1898 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:58.629940 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c740554-82cf-4d24-a7ea-610dd8cb1898 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:58.629940 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c740554-82cf-4d24-a7ea-610dd8cb1898 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:58.631556 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 359/708] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:58.636896 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1586bd-13b4-4f36-bccd-aeb7275248d9 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:58.637179 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1586bd-13b4-4f36-bccd-aeb7275248d9 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:58.637453 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1586bd-13b4-4f36-bccd-aeb7275248d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:58.660320 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-ec1586bd-13b4-4f36-bccd-aeb7275248d9 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:58.661488 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ec1586bd-13b4-4f36-bccd-aeb7275248d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:58.693357 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:58.734412 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 350/709] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 13:12:59.010698 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c740554-82cf-4d24-a7ea-610dd8cb1898 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:59.073448 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:59.116747 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c740554-82cf-4d24-a7ea-610dd8cb1898 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:59.152110 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198ca91-b195-468e-b2b5-a99a56707fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:59.152804 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198ca91-b195-468e-b2b5-a99a56707fc6 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:59.153087 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198ca91-b195-468e-b2b5-a99a56707fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:59.153358 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198ca91-b195-468e-b2b5-a99a56707fc6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:59.154681 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198ca91-b195-468e-b2b5-a99a56707fc6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:59.156187 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198ca91-b195-468e-b2b5-a99a56707fc6 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:59.165903 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-f198ca91-b195-468e-b2b5-a99a56707fc6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 13:12:59.165903 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:59.165903 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 13:12:59.165903 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 13:12:59.165903 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 13:12:59.165903 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 13:12:59.165903 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 13:12:59.165903 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:12:59.165903 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 13:12:59.165903 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:59.165903 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 13:12:59.165903 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:59.165903 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:59.165903 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:59.165903 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:59.165903 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:59.165903 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:59.166936 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:59.166936 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:59.166936 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:59.166936 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:59.166936 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:59.166936 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:59.166936 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 13:12:59.166936 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 13:12:59.166936 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 13:12:59.166936 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 13:12:59.166936 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:59.166936 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:59.166936 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:59.166936 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:59.166936 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:59.166936 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:59.167778 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:59.167778 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:59.167778 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:59.167778 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:59.167778 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:59.167778 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:59.167778 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:59.167778 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:59.167778 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:59.167778 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:59.167778 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 13:12:59.167778 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:12:59.167778 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 13:12:59.167778 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:59.167778 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 360/710] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Oct 27 13:12:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:59.173410 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1586bd-13b4-4f36-bccd-aeb7275248d9 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:59.279553 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1586bd-13b4-4f36-bccd-aeb7275248d9 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:59.314827 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c015e-babe-497f-aa94-b32c3f893792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:59.315918 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c015e-babe-497f-aa94-b32c3f893792 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:59.316474 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c015e-babe-497f-aa94-b32c3f893792 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:59.316944 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c015e-babe-497f-aa94-b32c3f893792 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:59.317798 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08c015e-babe-497f-aa94-b32c3f893792 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:59.318299 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08c015e-babe-497f-aa94-b32c3f893792 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:59.319874 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08c015e-babe-497f-aa94-b32c3f893792 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:59.325521 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 351/711] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Oct 27 13:12:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:59.336135 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198ca91-b195-468e-b2b5-a99a56707fc6 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:59.350335 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d04c4-9648-4303-b6b8-417d49b2ed87 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:59.351008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d04c4-9648-4303-b6b8-417d49b2ed87 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:59.351431 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d04c4-9648-4303-b6b8-417d49b2ed87 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:59.353303 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 352/712] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:12:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:12:59.358718 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616af5ca-4cc9-4715-b733-07e0125413fe None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:59.359004 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616af5ca-4cc9-4715-b733-07e0125413fe None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:59.359277 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616af5ca-4cc9-4715-b733-07e0125413fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:59.378951 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-616af5ca-4cc9-4715-b733-07e0125413fe None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:12:59.380123 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-616af5ca-4cc9-4715-b733-07e0125413fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:12:59.433887 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:59.442055 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198ca91-b195-468e-b2b5-a99a56707fc6 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:59.456208 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 353/713] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:12:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 13:12:59.472619 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:12:59.488059 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7426253-a856-4041-818e-b6f65efc2b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:59.488671 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7426253-a856-4041-818e-b6f65efc2b19 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:59.488947 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7426253-a856-4041-818e-b6f65efc2b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:59.489216 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7426253-a856-4041-818e-b6f65efc2b19 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:59.489875 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7426253-a856-4041-818e-b6f65efc2b19 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:12:59.490175 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7426253-a856-4041-818e-b6f65efc2b19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:59.491553 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7426253-a856-4041-818e-b6f65efc2b19 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:59.497201 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 361/714] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Oct 27 13:12:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:12:59.502711 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616af5ca-4cc9-4715-b733-07e0125413fe None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:59.602116 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616af5ca-4cc9-4715-b733-07e0125413fe None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:59.636691 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89b204-20f7-4652-93f9-8ce3bad563c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:59.637308 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89b204-20f7-4652-93f9-8ce3bad563c0 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:59.637608 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89b204-20f7-4652-93f9-8ce3bad563c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:59.637882 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89b204-20f7-4652-93f9-8ce3bad563c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:59.638559 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a89b204-20f7-4652-93f9-8ce3bad563c0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:59.639933 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a89b204-20f7-4652-93f9-8ce3bad563c0 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:59.664094 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 354/715] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:12:59 2022] POST /identity/v3/endpoints => generated 349 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:12:59.729662 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7426253-a856-4041-818e-b6f65efc2b19 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:59.844762 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7426253-a856-4041-818e-b6f65efc2b19 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:12:59.888046 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37673d36-b81c-496f-bbae-0ece7be8776d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:12:59.888600 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37673d36-b81c-496f-bbae-0ece7be8776d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:12:59.888876 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37673d36-b81c-496f-bbae-0ece7be8776d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:12:59.889147 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37673d36-b81c-496f-bbae-0ece7be8776d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:12:59.889883 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37673d36-b81c-496f-bbae-0ece7be8776d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:12:59.891249 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37673d36-b81c-496f-bbae-0ece7be8776d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:12:59.900780 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-37673d36-b81c-496f-bbae-0ece7be8776d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 13:12:59.900780 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:59.900780 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 13:12:59.900780 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 13:12:59.900780 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 13:12:59.900780 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 13:12:59.900780 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 13:12:59.900780 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:12:59.900780 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 13:12:59.900780 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:59.900780 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 13:12:59.900780 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:59.900780 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:12:59.900780 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:12:59.900780 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:12:59.900780 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:12:59.900780 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:12:59.901815 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:12:59.901815 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:12:59.901815 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:12:59.901815 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:12:59.901815 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:12:59.901815 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:12:59.901815 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 13:12:59.901815 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 13:12:59.901815 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 13:12:59.901815 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 13:12:59.901815 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:12:59.901815 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:12:59.901815 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:12:59.901815 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:12:59.901815 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:12:59.901815 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:12:59.902668 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:12:59.902668 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:12:59.902668 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:12:59.902668 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:12:59.902668 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:12:59.902668 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:12:59.902668 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:12:59.902668 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:12:59.902668 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:12:59.902668 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:12:59.902668 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 13:12:59.902668 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:12:59.902668 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 13:12:59.902668 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:12:59.902668 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 362/716] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Oct 27 13:12:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:12:59.908246 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89b204-20f7-4652-93f9-8ce3bad563c0 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:12:59.930258 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:00.012461 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89b204-20f7-4652-93f9-8ce3bad563c0 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:00.050569 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682fbb82-75f5-4af0-88ae-897e94499bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:00.051553 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fbb82-75f5-4af0-88ae-897e94499bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:00.052078 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fbb82-75f5-4af0-88ae-897e94499bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:00.052549 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fbb82-75f5-4af0-88ae-897e94499bc7 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:00.053376 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682fbb82-75f5-4af0-88ae-897e94499bc7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:13:00.053899 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682fbb82-75f5-4af0-88ae-897e94499bc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:00.055475 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682fbb82-75f5-4af0-88ae-897e94499bc7 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:00.061427 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 355/717] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Oct 27 13:12:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:00.073457 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37673d36-b81c-496f-bbae-0ece7be8776d None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:00.130151 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:00.184988 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37673d36-b81c-496f-bbae-0ece7be8776d None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:00.192293 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33060885-2c61-48e3-86ad-2ef2aefb97c7 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:00.192833 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33060885-2c61-48e3-86ad-2ef2aefb97c7 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:00.192833 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33060885-2c61-48e3-86ad-2ef2aefb97c7 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:00.195516 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 356/718] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 13:13:00.199604 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7157eb-77e1-4921-bda9-e09fdca290a3 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:00.200042 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7157eb-77e1-4921-bda9-e09fdca290a3 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:00.200325 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7157eb-77e1-4921-bda9-e09fdca290a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:00.219164 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-1c7157eb-77e1-4921-bda9-e09fdca290a3 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:13:00.220372 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1c7157eb-77e1-4921-bda9-e09fdca290a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:13:00.222732 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f19afe-155a-4c7a-ab37-07ff58a01473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:00.223350 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f19afe-155a-4c7a-ab37-07ff58a01473 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:00.223624 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f19afe-155a-4c7a-ab37-07ff58a01473 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:00.223894 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f19afe-155a-4c7a-ab37-07ff58a01473 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:00.224530 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f19afe-155a-4c7a-ab37-07ff58a01473 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:13:00.224828 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f19afe-155a-4c7a-ab37-07ff58a01473 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:00.226272 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f19afe-155a-4c7a-ab37-07ff58a01473 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:00.234243 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 363/719] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Oct 27 13:13:00 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:00.239402 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f19afe-155a-4c7a-ab37-07ff58a01473 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:00.305518 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 357/720] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:13:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 13:13:00.351105 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f19afe-155a-4c7a-ab37-07ff58a01473 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:00.364879 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:00.386433 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8e344-5ae6-4736-af3f-a1ac228245a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:00.387042 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8e344-5ae6-4736-af3f-a1ac228245a9 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:00.387318 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8e344-5ae6-4736-af3f-a1ac228245a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:00.387590 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8e344-5ae6-4736-af3f-a1ac228245a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:00.388261 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b8e344-5ae6-4736-af3f-a1ac228245a9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:00.389668 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b8e344-5ae6-4736-af3f-a1ac228245a9 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:00.411821 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 364/721] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:13:00 2022] POST /identity/v3/endpoints => generated 346 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:13:00.568571 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7157eb-77e1-4921-bda9-e09fdca290a3 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:00.583698 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:00.680230 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7157eb-77e1-4921-bda9-e09fdca290a3 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:00.724422 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875ff4c-e21f-4968-8498-fccebe898c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:00.725060 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875ff4c-e21f-4968-8498-fccebe898c4c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:00.725335 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875ff4c-e21f-4968-8498-fccebe898c4c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:00.725636 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875ff4c-e21f-4968-8498-fccebe898c4c None admin] PATH_INFO: `/v3/services/compute` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:00.726217 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6875ff4c-e21f-4968-8498-fccebe898c4c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:00.727586 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6875ff4c-e21f-4968-8498-fccebe898c4c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:00.733286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13ea80-2851-4a1d-9f76-eb43adcfea70 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:00.733777 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13ea80-2851-4a1d-9f76-eb43adcfea70 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:00.733856 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13ea80-2851-4a1d-9f76-eb43adcfea70 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:00.735432 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 365/722] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:13:00.736658 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-6875ff4c-e21f-4968-8498-fccebe898c4c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 13:13:00.736658 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:13:00.736658 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 13:13:00.736658 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 13:13:00.736658 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 13:13:00.736658 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 13:13:00.736658 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 13:13:00.736658 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:13:00.736658 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 13:13:00.736658 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:13:00.736658 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 13:13:00.736658 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:13:00.736658 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:13:00.736658 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:13:00.736658 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:13:00.736658 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:13:00.736658 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:13:00.737694 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:13:00.737694 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:13:00.737694 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:13:00.737694 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:13:00.737694 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:13:00.737694 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:13:00.737694 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 13:13:00.737694 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 13:13:00.737694 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 13:13:00.737694 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 13:13:00.737694 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:13:00.737694 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:13:00.737694 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:13:00.737694 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:13:00.737694 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:13:00.737694 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:13:00.739097 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:13:00.739097 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:13:00.739097 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:13:00.739097 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:13:00.739097 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:13:00.739097 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:13:00.739097 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:13:00.739097 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:13:00.739097 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:13:00.739097 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:13:00.739097 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 13:13:00.739097 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:13:00.739097 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 13:13:00.739097 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:13:00.739097 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 358/723] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Oct 27 13:13:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:13:00.740485 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0f3eb-fe9e-4d38-b5db-f481881310be None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:00.740771 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0f3eb-fe9e-4d38-b5db-f481881310be None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:00.741061 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0f3eb-fe9e-4d38-b5db-f481881310be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:00.746656 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875ff4c-e21f-4968-8498-fccebe898c4c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:00.760919 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-0af0f3eb-fe9e-4d38-b5db-f481881310be None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:13:00.762151 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0af0f3eb-fe9e-4d38-b5db-f481881310be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:13:00.841742 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:00.844424 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 366/724] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:13:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 13:13:00.879725 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875ff4c-e21f-4968-8498-fccebe898c4c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:00.914296 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da7fc2-1f93-48bd-b2bb-d76b53f66cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:00.914912 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da7fc2-1f93-48bd-b2bb-d76b53f66cbc None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:00.915193 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da7fc2-1f93-48bd-b2bb-d76b53f66cbc None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:00.915467 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da7fc2-1f93-48bd-b2bb-d76b53f66cbc None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:00.916096 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da7fc2-1f93-48bd-b2bb-d76b53f66cbc None admin] RBAC: Adding query filter params (name=compute) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:13:00.916398 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da7fc2-1f93-48bd-b2bb-d76b53f66cbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:00.917807 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da7fc2-1f93-48bd-b2bb-d76b53f66cbc None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:00.923037 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 359/725] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Oct 27 13:13:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:13:00.932409 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0f3eb-fe9e-4d38-b5db-f481881310be None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:01.031882 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:01.036011 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0f3eb-fe9e-4d38-b5db-f481881310be None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:01.073014 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ed491-56b5-45bb-9abe-c51a07d80180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:01.073684 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ed491-56b5-45bb-9abe-c51a07d80180 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:01.073968 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ed491-56b5-45bb-9abe-c51a07d80180 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:01.074246 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ed491-56b5-45bb-9abe-c51a07d80180 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:01.074882 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605ed491-56b5-45bb-9abe-c51a07d80180 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:13:01.075184 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605ed491-56b5-45bb-9abe-c51a07d80180 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:01.076567 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605ed491-56b5-45bb-9abe-c51a07d80180 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:01.081741 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 367/726] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Oct 27 13:13:00 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:01.118327 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da7fc2-1f93-48bd-b2bb-d76b53f66cbc None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:01.239668 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da7fc2-1f93-48bd-b2bb-d76b53f66cbc None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:01.280829 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c52529-d9fc-4679-a705-186b3e63d074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:01.281924 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c52529-d9fc-4679-a705-186b3e63d074 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:01.282400 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c52529-d9fc-4679-a705-186b3e63d074 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:01.282718 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c52529-d9fc-4679-a705-186b3e63d074 None admin] PATH_INFO: `/v3/services/image` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:01.283255 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c52529-d9fc-4679-a705-186b3e63d074 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:01.284676 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c52529-d9fc-4679-a705-186b3e63d074 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:01.294124 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-82c52529-d9fc-4679-a705-186b3e63d074 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 13:13:01.294124 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:13:01.294124 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 13:13:01.294124 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 13:13:01.294124 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 13:13:01.294124 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 13:13:01.294124 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 13:13:01.294124 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:13:01.294124 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 13:13:01.294124 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:13:01.294124 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 13:13:01.294124 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:13:01.294124 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:13:01.294124 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:13:01.294124 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:13:01.294124 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:13:01.294124 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:13:01.295210 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:13:01.295210 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:13:01.295210 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:13:01.295210 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:13:01.295210 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:13:01.295210 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:13:01.295210 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 13:13:01.295210 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 13:13:01.295210 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 13:13:01.295210 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 13:13:01.295210 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:13:01.295210 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:13:01.295210 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:13:01.295210 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:13:01.295210 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:13:01.295210 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:13:01.296056 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:13:01.296056 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:13:01.296056 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:13:01.296056 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:13:01.296056 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:13:01.296056 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:13:01.296056 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:13:01.296056 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:13:01.296056 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:13:01.296056 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:13:01.296056 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 13:13:01.296056 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:13:01.296056 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 13:13:01.296056 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:13:01.296056 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 360/727] 10.222.0.52 () {56 vars in 1105 bytes} [Thu Oct 27 13:13:01 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:13:01.297596 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:01.302046 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ed491-56b5-45bb-9abe-c51a07d80180 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:01.404828 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ed491-56b5-45bb-9abe-c51a07d80180 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:01.442710 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283f750-74fa-4b45-88e1-c6c7c2d66889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:01.443339 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283f750-74fa-4b45-88e1-c6c7c2d66889 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:01.443617 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283f750-74fa-4b45-88e1-c6c7c2d66889 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:01.443886 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283f750-74fa-4b45-88e1-c6c7c2d66889 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:01.444522 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283f750-74fa-4b45-88e1-c6c7c2d66889 None admin] RBAC: Adding query filter params (name=image) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:13:01.444825 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283f750-74fa-4b45-88e1-c6c7c2d66889 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:01.446229 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283f750-74fa-4b45-88e1-c6c7c2d66889 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:01.451616 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 368/728] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:13:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:01.457497 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c52529-d9fc-4679-a705-186b3e63d074 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:01.560903 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c52529-d9fc-4679-a705-186b3e63d074 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:01.594943 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fd846-e139-47a8-8f22-ba8ac5e34dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:01.595549 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fd846-e139-47a8-8f22-ba8ac5e34dc0 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:01.595828 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fd846-e139-47a8-8f22-ba8ac5e34dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:01.596101 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fd846-e139-47a8-8f22-ba8ac5e34dc0 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:01.596759 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10fd846-e139-47a8-8f22-ba8ac5e34dc0 None admin] RBAC: Adding query filter params (type=image) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:13:01.597058 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10fd846-e139-47a8-8f22-ba8ac5e34dc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:01.598445 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10fd846-e139-47a8-8f22-ba8ac5e34dc0 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:01.603349 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 361/729] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:13:01 2022] GET /identity/v3/services?type=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:01.987355 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0df25-b95f-4104-b36e-c30e66977f52 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:01.988097 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0df25-b95f-4104-b36e-c30e66977f52 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:01.988097 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0df25-b95f-4104-b36e-c30e66977f52 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:01.989585 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 369/730] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:13:01.994897 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c34c4-8712-4cfa-b87c-cf51d47ea84e None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:01.995182 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c34c4-8712-4cfa-b87c-cf51d47ea84e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:01.995456 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c34c4-8712-4cfa-b87c-cf51d47ea84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:02.013879 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-597c34c4-8712-4cfa-b87c-cf51d47ea84e None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:13:02.015041 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-597c34c4-8712-4cfa-b87c-cf51d47ea84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:13:02.073441 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:02.082347 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 362/731] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:13:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 13:13:02.345387 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0df25-b95f-4104-b36e-c30e66977f52 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:02.373395 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:02.451566 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0df25-b95f-4104-b36e-c30e66977f52 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:02.489883 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6b6e8-32a2-4aa4-b8cb-7a53efc34f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:02.490526 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6b6e8-32a2-4aa4-b8cb-7a53efc34f1b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:02.490808 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6b6e8-32a2-4aa4-b8cb-7a53efc34f1b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:02.491084 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6b6e8-32a2-4aa4-b8cb-7a53efc34f1b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:02.491673 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec6b6e8-32a2-4aa4-b8cb-7a53efc34f1b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:02.493061 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec6b6e8-32a2-4aa4-b8cb-7a53efc34f1b None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:02.502287 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-5ec6b6e8-32a2-4aa4-b8cb-7a53efc34f1b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 13:13:02.502287 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:13:02.502287 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 13:13:02.502287 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 13:13:02.502287 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 13:13:02.502287 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 13:13:02.502287 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 13:13:02.502287 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:13:02.502287 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 13:13:02.502287 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:13:02.502287 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 13:13:02.502287 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:13:02.502287 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:13:02.502287 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:13:02.502287 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:13:02.502287 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:13:02.502287 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:13:02.503320 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:13:02.503320 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:13:02.503320 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:13:02.503320 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:13:02.503320 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:13:02.503320 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:13:02.503320 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 13:13:02.503320 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 13:13:02.503320 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 13:13:02.503320 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 13:13:02.503320 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:13:02.503320 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:13:02.503320 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:13:02.503320 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:13:02.503320 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:13:02.503320 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:13:02.504465 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:13:02.504465 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:13:02.504465 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:13:02.504465 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:13:02.504465 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:13:02.504465 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:13:02.504465 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:13:02.504465 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:13:02.504465 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:13:02.504465 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:13:02.504465 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 13:13:02.504465 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:13:02.504465 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 13:13:02.504465 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:13:02.504465 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 370/732] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Oct 27 13:13:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:13:02.509837 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c34c4-8712-4cfa-b87c-cf51d47ea84e None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:02.617882 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c34c4-8712-4cfa-b87c-cf51d47ea84e None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:02.654089 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bfc0b6-8791-4a2a-b10b-04ca0f8fad17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:02.654753 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfc0b6-8791-4a2a-b10b-04ca0f8fad17 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:02.655035 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfc0b6-8791-4a2a-b10b-04ca0f8fad17 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:02.655306 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfc0b6-8791-4a2a-b10b-04ca0f8fad17 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:02.655930 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bfc0b6-8791-4a2a-b10b-04ca0f8fad17 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:13:02.656231 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bfc0b6-8791-4a2a-b10b-04ca0f8fad17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:02.657625 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bfc0b6-8791-4a2a-b10b-04ca0f8fad17 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:02.662859 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 363/733] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Oct 27 13:13:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:02.668633 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6b6e8-32a2-4aa4-b8cb-7a53efc34f1b None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:02.716091 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae16100-bfa6-4210-a4e7-0b994ec0be72 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:02.716448 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae16100-bfa6-4210-a4e7-0b994ec0be72 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:02.716796 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae16100-bfa6-4210-a4e7-0b994ec0be72 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:02.718378 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 364/734] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 13:13:02.723800 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439a04e-285c-446c-9b24-f92ded188e2a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:02.724073 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439a04e-285c-446c-9b24-f92ded188e2a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:02.724339 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439a04e-285c-446c-9b24-f92ded188e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:02.743276 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-3439a04e-285c-446c-9b24-f92ded188e2a None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:13:02.744441 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3439a04e-285c-446c-9b24-f92ded188e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:13:02.765266 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:02.776500 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6b6e8-32a2-4aa4-b8cb-7a53efc34f1b None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:02.815460 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385e446-8f81-4954-9237-a9ddbca925b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:02.816637 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385e446-8f81-4954-9237-a9ddbca925b7 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:02.817286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385e446-8f81-4954-9237-a9ddbca925b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:02.818128 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385e446-8f81-4954-9237-a9ddbca925b7 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:02.819244 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385e446-8f81-4954-9237-a9ddbca925b7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:13:02.819911 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385e446-8f81-4954-9237-a9ddbca925b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:02.821801 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:02.822378 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385e446-8f81-4954-9237-a9ddbca925b7 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:02.826271 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 365/735] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:13:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 13:13:02.828529 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 371/736] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Oct 27 13:13:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:02.836575 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439a04e-285c-446c-9b24-f92ded188e2a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:02.939951 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439a04e-285c-446c-9b24-f92ded188e2a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:02.975511 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641ccd4-d542-4ec8-9802-fe2e871943f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:02.976377 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641ccd4-d542-4ec8-9802-fe2e871943f3 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:02.976804 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641ccd4-d542-4ec8-9802-fe2e871943f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:02.977216 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641ccd4-d542-4ec8-9802-fe2e871943f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:02.978162 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641ccd4-d542-4ec8-9802-fe2e871943f3 None admin] RBAC: Adding query filter params (interface=admin, service_id=c8621104cbb14f738d26426143d2c436, region_id=RegionOne) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:13:02.978671 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641ccd4-d542-4ec8-9802-fe2e871943f3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:02.980222 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641ccd4-d542-4ec8-9802-fe2e871943f3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:02.986243 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 366/737] 10.222.0.52 () {56 vars in 1249 bytes} [Thu Oct 27 13:13:02 2022] GET /identity/v3/endpoints?service_id=c8621104cbb14f738d26426143d2c436&interface=admin®ion_id=RegionOne => generated 193 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:13:02.994477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385e446-8f81-4954-9237-a9ddbca925b7 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:03.095677 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385e446-8f81-4954-9237-a9ddbca925b7 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:03.099511 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641ccd4-d542-4ec8-9802-fe2e871943f3 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:03.132463 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4061fd-3ceb-4f3a-acb5-abe0017f7067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:03.133073 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4061fd-3ceb-4f3a-acb5-abe0017f7067 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:03.133454 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4061fd-3ceb-4f3a-acb5-abe0017f7067 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:03.133757 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4061fd-3ceb-4f3a-acb5-abe0017f7067 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:03.134480 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4061fd-3ceb-4f3a-acb5-abe0017f7067 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:03.135855 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4061fd-3ceb-4f3a-acb5-abe0017f7067 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:03.142727 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 372/738] 10.222.0.52 () {56 vars in 1087 bytes} [Thu Oct 27 13:13:02 2022] GET /identity/v3/services => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:13:03.162227 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:03.218600 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641ccd4-d542-4ec8-9802-fe2e871943f3 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:03.256599 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a088e1-c272-4aa5-ac68-853b694d8862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:03.257632 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a088e1-c272-4aa5-ac68-853b694d8862 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:03.258118 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a088e1-c272-4aa5-ac68-853b694d8862 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:03.258589 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a088e1-c272-4aa5-ac68-853b694d8862 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:03.259543 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a088e1-c272-4aa5-ac68-853b694d8862 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:03.261217 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a088e1-c272-4aa5-ac68-853b694d8862 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:03.264211 dv-cinder-862432-3-smb devstack@keystone.service[81481]: WARNING keystone.server.flask.common [None req-37a088e1-c272-4aa5-ac68-853b694d8862 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 27 13:13:03.285237 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.sql.core [None req-37a088e1-c272-4aa5-ac68-853b694d8862 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 27 13:13:03.285237 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 27 13:13:03.285237 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [parameters: {'id': 'b8d90fea206042138983c765a0bcde7f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 27 13:13:03.285237 dv-cinder-862432-3-smb devstack@keystone.service[81481]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81481) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 27 13:13:03.294153 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-37a088e1-c272-4aa5-ac68-853b694d8862 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b8d90fea206042138983c765a0bcde7f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b8d90fea206042138983c765a0bcde7f. Oct 27 13:13:03.294153 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:13:03.294153 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 13:13:03.294153 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 27 13:13:03.294153 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 13:13:03.294153 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 27 13:13:03.294153 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 13:13:03.294153 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application result = self._query(query) Oct 27 13:13:03.294153 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 13:13:03.294153 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application conn.query(q) Oct 27 13:13:03.294153 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 13:13:03.294153 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 13:13:03.294153 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 13:13:03.295066 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application result.read() Oct 27 13:13:03.295066 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 13:13:03.295066 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 27 13:13:03.295066 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 13:13:03.295066 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 27 13:13:03.295066 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 13:13:03.295066 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 27 13:13:03.295066 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 13:13:03.295066 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 27 13:13:03.295066 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 27 13:13:03.295066 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:13:03.295066 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 27 13:13:03.295066 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:13:03.295066 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:13:03.295066 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 27 13:13:03.295066 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 27 13:13:03.295066 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 27 13:13:03.295066 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 27 13:13:03.296156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 27 13:13:03.296156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application next(self.gen) Oct 27 13:13:03.296156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 27 13:13:03.296156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application yield resource Oct 27 13:13:03.296156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 27 13:13:03.296156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application next(self.gen) Oct 27 13:13:03.296156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 27 13:13:03.296156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self.session.rollback() Oct 27 13:13:03.296156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 13:13:03.296156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self.force_reraise() Oct 27 13:13:03.296156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 13:13:03.296156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise self.value Oct 27 13:13:03.296156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 27 13:13:03.296156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 27 13:13:03.296156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 27 13:13:03.296156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application session.commit() Oct 27 13:13:03.296156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 27 13:13:03.297072 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 27 13:13:03.297072 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 27 13:13:03.297072 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._prepare_impl() Oct 27 13:13:03.297072 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 27 13:13:03.297072 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self.session.flush() Oct 27 13:13:03.297072 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 27 13:13:03.297072 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._flush(objects) Oct 27 13:13:03.297072 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 27 13:13:03.297072 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 27 13:13:03.297072 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 27 13:13:03.297072 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application compat.raise_( Oct 27 13:13:03.297072 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 13:13:03.297072 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception Oct 27 13:13:03.297072 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 27 13:13:03.297072 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application flush_context.execute() Oct 27 13:13:03.297072 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 27 13:13:03.297072 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rec.execute(self) Oct 27 13:13:03.298031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 27 13:13:03.298031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 27 13:13:03.298031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 27 13:13:03.298031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 27 13:13:03.298031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 27 13:13:03.298031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 27 13:13:03.298031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 27 13:13:03.298031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 27 13:13:03.298031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 27 13:13:03.298031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 27 13:13:03.298031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 27 13:13:03.298031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 27 13:13:03.298031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 27 13:13:03.298031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 27 13:13:03.298031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 27 13:13:03.298854 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 27 13:13:03.298854 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 13:13:03.298854 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception Oct 27 13:13:03.298854 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 13:13:03.298854 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 27 13:13:03.298854 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 13:13:03.298854 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 27 13:13:03.298854 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 13:13:03.298854 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application result = self._query(query) Oct 27 13:13:03.298854 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 13:13:03.298854 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application conn.query(q) Oct 27 13:13:03.298854 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 13:13:03.298854 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 13:13:03.298854 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 13:13:03.298854 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application result.read() Oct 27 13:13:03.298854 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 13:13:03.298854 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 27 13:13:03.299894 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 13:13:03.299894 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 27 13:13:03.299894 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 13:13:03.299894 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 27 13:13:03.299894 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 13:13:03.299894 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 27 13:13:03.299894 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 27 13:13:03.299894 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 27 13:13:03.299894 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [parameters: {'id': 'b8d90fea206042138983c765a0bcde7f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 27 13:13:03.299894 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 27 13:13:03.299894 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:13:03.299894 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 13:13:03.299894 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:13:03.299894 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:13:03.299894 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 27 13:13:03.301009 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 27 13:13:03.301009 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 27 13:13:03.301009 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 27 13:13:03.301009 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 27 13:13:03.301009 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:13:03.301009 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 13:13:03.301009 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:13:03.301009 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:13:03.301009 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:13:03.301009 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:13:03.301009 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:13:03.301009 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:13:03.301009 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:13:03.301009 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:13:03.301009 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:13:03.301009 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:13:03.301009 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:13:03.303904 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:13:03.303904 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 27 13:13:03.303904 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 27 13:13:03.303904 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:13:03.303904 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:13:03.303904 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 27 13:13:03.303904 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 27 13:13:03.303904 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b8d90fea206042138983c765a0bcde7f. Oct 27 13:13:03.303904 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:13:03.307234 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 367/739] 10.222.0.52 () {60 vars in 1140 bytes} [Thu Oct 27 13:13:03 2022] POST /identity/v3/projects => generated 262 bytes in 208 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:13:03.313956 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4061fd-3ceb-4f3a-acb5-abe0017f7067 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:03.337877 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:03.422300 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f96722-6775-4482-a354-9c256bebd8ed None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:03.422636 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f96722-6775-4482-a354-9c256bebd8ed None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:03.422836 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f96722-6775-4482-a354-9c256bebd8ed None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:03.425840 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4061fd-3ceb-4f3a-acb5-abe0017f7067 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:03.427447 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 368/740] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:13:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 13:13:03.433036 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db42b8f-2f74-4b6e-abab-0df5add313a3 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:03.433314 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db42b8f-2f74-4b6e-abab-0df5add313a3 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:03.433626 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db42b8f-2f74-4b6e-abab-0df5add313a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:03.452164 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-8db42b8f-2f74-4b6e-abab-0df5add313a3 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:13:03.453696 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8db42b8f-2f74-4b6e-abab-0df5add313a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:13:03.469094 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314236e3-12e6-4245-b763-60520c00384e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:03.469783 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314236e3-12e6-4245-b763-60520c00384e None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:03.470059 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314236e3-12e6-4245-b763-60520c00384e None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:03.470923 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314236e3-12e6-4245-b763-60520c00384e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:03.478024 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314236e3-12e6-4245-b763-60520c00384e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:03.479757 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314236e3-12e6-4245-b763-60520c00384e None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:03.492090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-314236e3-12e6-4245-b763-60520c00384e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:13:03.492090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:13:03.492090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:13:03.492090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:13:03.492090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:13:03.492090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:13:03.492090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:13:03.492090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:13:03.492090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:13:03.492090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:13:03.492090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:13:03.492090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:13:03.492090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 13:13:03.492090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 13:13:03.492090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 13:13:03.493017 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 13:13:03.493017 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:13:03.493017 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:13:03.493017 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:13:03.493017 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:13:03.493017 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:13:03.493017 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:13:03.493017 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:13:03.493017 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:13:03.493017 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:13:03.493017 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:13:03.493017 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:13:03.493017 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:13:03.493017 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:13:03.493017 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:13:03.493017 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:13:03.493017 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:13:03.493969 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 13:13:03.493969 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 13:13:03.493969 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 13:13:03.493969 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 13:13:03.493969 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 13:13:03.493969 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 13:13:03.493969 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:13:03.493969 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:13:03.493969 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 373/741] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Oct 27 13:13:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:13:03.499312 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314236e3-12e6-4245-b763-60520c00384e None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:03.533584 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 369/742] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:13:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 13:13:03.583154 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:03.606852 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314236e3-12e6-4245-b763-60520c00384e None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:03.642323 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba349c-3b84-49a1-bada-93bd4c113b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:03.642958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba349c-3b84-49a1-bada-93bd4c113b06 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:03.643274 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba349c-3b84-49a1-bada-93bd4c113b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:03.643547 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba349c-3b84-49a1-bada-93bd4c113b06 None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:03.644240 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba349c-3b84-49a1-bada-93bd4c113b06 None admin] RBAC: Adding query filter params (name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:13:03.644545 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba349c-3b84-49a1-bada-93bd4c113b06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:03.646035 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba349c-3b84-49a1-bada-93bd4c113b06 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:03.664004 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 374/743] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Oct 27 13:13:03 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:13:03.802634 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db42b8f-2f74-4b6e-abab-0df5add313a3 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:03.844659 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:03.917271 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db42b8f-2f74-4b6e-abab-0df5add313a3 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:03.953083 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab23314-d127-458e-a5b1-b46b20ba6b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:03.953731 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab23314-d127-458e-a5b1-b46b20ba6b72 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:03.954010 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab23314-d127-458e-a5b1-b46b20ba6b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:03.954287 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab23314-d127-458e-a5b1-b46b20ba6b72 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:03.954969 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab23314-d127-458e-a5b1-b46b20ba6b72 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:03.956895 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab23314-d127-458e-a5b1-b46b20ba6b72 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:03.974701 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 370/744] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Oct 27 13:13:03 2022] POST /identity/v3/services => generated 242 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:13:04.008242 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c9565-56ad-4fe0-b96d-8fdfa35e4160 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:04.008809 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c9565-56ad-4fe0-b96d-8fdfa35e4160 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:04.008809 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c9565-56ad-4fe0-b96d-8fdfa35e4160 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:04.010475 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 375/745] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:13:04.016129 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd26160-bbf5-474f-bd4a-892dd53abc7b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:04.016653 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd26160-bbf5-474f-bd4a-892dd53abc7b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:04.017078 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd26160-bbf5-474f-bd4a-892dd53abc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:04.037296 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-dcd26160-bbf5-474f-bd4a-892dd53abc7b None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:13:04.038784 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-dcd26160-bbf5-474f-bd4a-892dd53abc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:13:04.126520 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 371/746] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:13:04 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 13:13:04.395722 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c9565-56ad-4fe0-b96d-8fdfa35e4160 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:04.505720 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c9565-56ad-4fe0-b96d-8fdfa35e4160 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:04.543408 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0cfcb-8d62-49bf-9563-bab00127bdb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:04.544397 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0cfcb-8d62-49bf-9563-bab00127bdb5 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:04.544879 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0cfcb-8d62-49bf-9563-bab00127bdb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:04.545373 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0cfcb-8d62-49bf-9563-bab00127bdb5 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:04.546273 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0cfcb-8d62-49bf-9563-bab00127bdb5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:04.547944 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0cfcb-8d62-49bf-9563-bab00127bdb5 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:04.563135 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:04.577996 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 376/747] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Oct 27 13:13:04 2022] POST /identity/v3/services => generated 242 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:13:05.375391 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676b691-0667-4276-b050-f97e723de022 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:05.375920 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676b691-0667-4276-b050-f97e723de022 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:05.375920 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676b691-0667-4276-b050-f97e723de022 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:05.377587 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 372/748] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:13:05.383267 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023025c3-6903-4f30-b3ac-b83e83241dea None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:05.383703 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023025c3-6903-4f30-b3ac-b83e83241dea None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:05.383783 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023025c3-6903-4f30-b3ac-b83e83241dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:05.403413 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-023025c3-6903-4f30-b3ac-b83e83241dea None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:13:05.404600 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-023025c3-6903-4f30-b3ac-b83e83241dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:13:05.479431 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 377/749] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:13:05 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 13:13:05.741859 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676b691-0667-4276-b050-f97e723de022 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:05.767124 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:05.854229 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676b691-0667-4276-b050-f97e723de022 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:05.891016 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72900e98-9864-42cb-a8a0-f7c855045b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:05.891650 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72900e98-9864-42cb-a8a0-f7c855045b63 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:05.891917 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72900e98-9864-42cb-a8a0-f7c855045b63 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:05.892185 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72900e98-9864-42cb-a8a0-f7c855045b63 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:05.892792 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72900e98-9864-42cb-a8a0-f7c855045b63 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:05.894451 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72900e98-9864-42cb-a8a0-f7c855045b63 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:05.904352 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-72900e98-9864-42cb-a8a0-f7c855045b63 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 13:13:05.904352 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:13:05.904352 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 13:13:05.904352 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 13:13:05.904352 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 13:13:05.904352 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 13:13:05.904352 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 13:13:05.904352 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:13:05.904352 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 13:13:05.904352 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:13:05.904352 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 13:13:05.904352 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:13:05.904352 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:13:05.904352 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:13:05.904352 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:13:05.904352 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:13:05.904352 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:13:05.905424 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:13:05.905424 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:13:05.905424 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:13:05.905424 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:13:05.905424 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:13:05.905424 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:13:05.905424 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 13:13:05.905424 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 13:13:05.905424 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 13:13:05.905424 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 13:13:05.905424 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:13:05.905424 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:13:05.905424 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:13:05.905424 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:13:05.905424 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:13:05.905424 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:13:05.906314 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:13:05.906314 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:13:05.906314 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:13:05.906314 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:13:05.906314 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:13:05.906314 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:13:05.906314 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:13:05.906314 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:13:05.906314 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:13:05.906314 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:13:05.906314 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 13:13:05.906314 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:13:05.906314 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 13:13:05.906314 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:13:05.906314 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 373/750] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Oct 27 13:13:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:13:05.914371 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023025c3-6903-4f30-b3ac-b83e83241dea None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:06.024588 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4ee11-2990-43b2-8fbe-ceb71450f37d None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:06.024768 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4ee11-2990-43b2-8fbe-ceb71450f37d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:06.025039 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4ee11-2990-43b2-8fbe-ceb71450f37d None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:06.027674 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 374/751] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:13:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 13:13:06.028477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023025c3-6903-4f30-b3ac-b83e83241dea None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:06.031850 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e061f7-2bc8-4032-8f8b-25645c47b52f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:06.031850 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e061f7-2bc8-4032-8f8b-25645c47b52f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:06.032064 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e061f7-2bc8-4032-8f8b-25645c47b52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:06.050225 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d3e061f7-2bc8-4032-8f8b-25645c47b52f None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:13:06.051394 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d3e061f7-2bc8-4032-8f8b-25645c47b52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:13:06.055094 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:06.067747 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97917f-27c8-4275-aa8c-51484a7fe106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:06.068775 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97917f-27c8-4275-aa8c-51484a7fe106 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:06.069252 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97917f-27c8-4275-aa8c-51484a7fe106 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:06.069852 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97917f-27c8-4275-aa8c-51484a7fe106 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:06.070814 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97917f-27c8-4275-aa8c-51484a7fe106 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:13:06.071360 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97917f-27c8-4275-aa8c-51484a7fe106 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:06.072994 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97917f-27c8-4275-aa8c-51484a7fe106 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:06.079732 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 378/752] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Oct 27 13:13:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:06.086290 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97917f-27c8-4275-aa8c-51484a7fe106 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:06.129650 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 375/753] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:13:06 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 13:13:06.191517 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499da20-9aa6-46c2-a4b1-86e1a20d3fb4 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:06.191851 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499da20-9aa6-46c2-a4b1-86e1a20d3fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:06.192067 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499da20-9aa6-46c2-a4b1-86e1a20d3fb4 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:06.193715 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 376/754] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:13:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 13:13:06.194770 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97917f-27c8-4275-aa8c-51484a7fe106 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:06.198758 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0760f5-2afd-4063-8223-c78b29652b70 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:06.199035 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0760f5-2afd-4063-8223-c78b29652b70 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:06.199302 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0760f5-2afd-4063-8223-c78b29652b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:06.218856 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-0d0760f5-2afd-4063-8223-c78b29652b70 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:13:06.220096 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0d0760f5-2afd-4063-8223-c78b29652b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:13:06.235533 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040a9f8-e71b-41a1-bbb9-56209742b7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:06.236336 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:06.237141 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040a9f8-e71b-41a1-bbb9-56209742b7b9 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:06.238015 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040a9f8-e71b-41a1-bbb9-56209742b7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:06.238533 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040a9f8-e71b-41a1-bbb9-56209742b7b9 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:06.239561 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5040a9f8-e71b-41a1-bbb9-56209742b7b9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:13:06.240083 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5040a9f8-e71b-41a1-bbb9-56209742b7b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:06.241960 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5040a9f8-e71b-41a1-bbb9-56209742b7b9 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:06.247603 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 379/755] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Oct 27 13:13:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:13:06.253219 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040a9f8-e71b-41a1-bbb9-56209742b7b9 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:06.302976 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 377/756] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:13:06 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 13:13:06.317917 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:06.364266 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040a9f8-e71b-41a1-bbb9-56209742b7b9 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:06.393768 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0760f5-2afd-4063-8223-c78b29652b70 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:06.401437 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5f828-dabc-457e-92f6-3d03c3762864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:06.402090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5f828-dabc-457e-92f6-3d03c3762864 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:06.402363 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5f828-dabc-457e-92f6-3d03c3762864 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:06.402633 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5f828-dabc-457e-92f6-3d03c3762864 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:06.403402 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5f828-dabc-457e-92f6-3d03c3762864 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:06.404772 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5f828-dabc-457e-92f6-3d03c3762864 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:06.427927 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 380/757] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:13:06 2022] POST /identity/v3/endpoints => generated 325 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:13:06.525584 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0760f5-2afd-4063-8223-c78b29652b70 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:06.570714 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298abf0f-844e-4aa1-8004-224c6d2d31f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:06.571355 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298abf0f-844e-4aa1-8004-224c6d2d31f9 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:06.571766 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298abf0f-844e-4aa1-8004-224c6d2d31f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:06.572039 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298abf0f-844e-4aa1-8004-224c6d2d31f9 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:06.572706 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298abf0f-844e-4aa1-8004-224c6d2d31f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:06.574229 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298abf0f-844e-4aa1-8004-224c6d2d31f9 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:06.584220 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5f828-dabc-457e-92f6-3d03c3762864 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:06.592400 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.sql.core [None req-298abf0f-844e-4aa1-8004-224c6d2d31f9 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 27 13:13:06.592400 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 27 13:13:06.592400 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [parameters: {'user_id': 'd47293bd99e54063af3b0c0811a8660d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 27 13:13:06.592400 dv-cinder-862432-3-smb devstack@keystone.service[81481]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81481) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 27 13:13:06.602734 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-298abf0f-844e-4aa1-8004-224c6d2d31f9 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 27 13:13:06.602734 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:13:06.602734 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 13:13:06.602734 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 27 13:13:06.602734 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 13:13:06.602734 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 27 13:13:06.602734 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 13:13:06.602734 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application result = self._query(query) Oct 27 13:13:06.602734 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 13:13:06.602734 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application conn.query(q) Oct 27 13:13:06.602734 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 13:13:06.602734 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 13:13:06.602734 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 13:13:06.602734 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application result.read() Oct 27 13:13:06.602734 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 13:13:06.603728 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 27 13:13:06.603728 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 13:13:06.603728 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 27 13:13:06.603728 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 13:13:06.603728 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 27 13:13:06.603728 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 13:13:06.603728 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 27 13:13:06.603728 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 27 13:13:06.603728 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:13:06.603728 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 27 13:13:06.603728 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:13:06.603728 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:13:06.603728 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 27 13:13:06.603728 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 27 13:13:06.603728 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 27 13:13:06.603728 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 27 13:13:06.603728 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 27 13:13:06.603728 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application next(self.gen) Oct 27 13:13:06.604714 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 27 13:13:06.604714 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application yield resource Oct 27 13:13:06.604714 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 27 13:13:06.604714 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application next(self.gen) Oct 27 13:13:06.604714 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 27 13:13:06.604714 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self.session.rollback() Oct 27 13:13:06.604714 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 13:13:06.604714 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self.force_reraise() Oct 27 13:13:06.604714 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 13:13:06.604714 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise self.value Oct 27 13:13:06.604714 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 27 13:13:06.604714 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 27 13:13:06.604714 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 27 13:13:06.604714 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application session.commit() Oct 27 13:13:06.604714 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 27 13:13:06.604714 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 27 13:13:06.604714 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 27 13:13:06.605632 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._prepare_impl() Oct 27 13:13:06.605632 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 27 13:13:06.605632 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self.session.flush() Oct 27 13:13:06.605632 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 27 13:13:06.605632 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._flush(objects) Oct 27 13:13:06.605632 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 27 13:13:06.605632 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 27 13:13:06.605632 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 27 13:13:06.605632 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application compat.raise_( Oct 27 13:13:06.605632 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 13:13:06.605632 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception Oct 27 13:13:06.605632 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 27 13:13:06.605632 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application flush_context.execute() Oct 27 13:13:06.605632 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 27 13:13:06.605632 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rec.execute(self) Oct 27 13:13:06.605632 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 27 13:13:06.605632 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 27 13:13:06.606554 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 27 13:13:06.606554 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 27 13:13:06.606554 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 27 13:13:06.606554 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 27 13:13:06.606554 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 27 13:13:06.606554 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 27 13:13:06.606554 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 27 13:13:06.606554 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 27 13:13:06.606554 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 27 13:13:06.606554 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 27 13:13:06.606554 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 27 13:13:06.606554 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 27 13:13:06.606554 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 27 13:13:06.606554 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 27 13:13:06.606554 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 13:13:06.606554 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception Oct 27 13:13:06.608636 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 13:13:06.608636 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 27 13:13:06.608636 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 13:13:06.608636 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 27 13:13:06.608636 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 13:13:06.608636 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application result = self._query(query) Oct 27 13:13:06.608636 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 13:13:06.608636 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application conn.query(q) Oct 27 13:13:06.608636 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 13:13:06.608636 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 13:13:06.608636 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 13:13:06.608636 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application result.read() Oct 27 13:13:06.608636 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 13:13:06.608636 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 27 13:13:06.608636 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 13:13:06.608636 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 27 13:13:06.611024 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 13:13:06.611024 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 27 13:13:06.611024 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 13:13:06.611024 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 27 13:13:06.611024 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 27 13:13:06.611024 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 27 13:13:06.611024 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [parameters: {'user_id': 'd47293bd99e54063af3b0c0811a8660d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 27 13:13:06.611024 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 27 13:13:06.611024 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:13:06.611024 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 13:13:06.611024 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:13:06.611024 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:13:06.611024 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:13:06.611024 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:13:06.611024 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:13:06.612988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:13:06.612988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:13:06.612988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:13:06.612988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:13:06.612988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:13:06.612988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:13:06.612988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:13:06.612988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 27 13:13:06.612988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 27 13:13:06.612988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:13:06.612988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:13:06.612988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 13:13:06.612988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:13:06.612988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 13:13:06.612988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:13:06.612988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 27 13:13:06.612988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 27 13:13:06.614963 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 27 13:13:06.614963 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 27 13:13:06.614963 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 27 13:13:06.614963 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 27 13:13:06.614963 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 27 13:13:06.614963 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:13:06.617525 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 378/758] 10.222.0.52 () {60 vars in 1131 bytes} [Thu Oct 27 13:13:06 2022] POST /identity/v3/users => generated 160 bytes in 224 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:13:06.625283 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298abf0f-844e-4aa1-8004-224c6d2d31f9 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:06.636341 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:06.729164 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5f828-dabc-457e-92f6-3d03c3762864 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:06.746423 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298abf0f-844e-4aa1-8004-224c6d2d31f9 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:06.753895 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:06.783234 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fec96-c906-41da-93fd-d4865be2d0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:06.784385 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fec96-c906-41da-93fd-d4865be2d0ac None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:06.784894 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fec96-c906-41da-93fd-d4865be2d0ac None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:06.785365 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fec96-c906-41da-93fd-d4865be2d0ac None admin] PATH_INFO: `/v3/services/compute` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:06.787409 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027fec96-c906-41da-93fd-d4865be2d0ac None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:06.789041 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027fec96-c906-41da-93fd-d4865be2d0ac None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:06.790086 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015eb1a7-1502-43b3-9538-6e4388a27479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:06.790719 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015eb1a7-1502-43b3-9538-6e4388a27479 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:06.790997 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015eb1a7-1502-43b3-9538-6e4388a27479 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:06.791269 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015eb1a7-1502-43b3-9538-6e4388a27479 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:06.799159 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015eb1a7-1502-43b3-9538-6e4388a27479 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:06.800869 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015eb1a7-1502-43b3-9538-6e4388a27479 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:06.801501 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-027fec96-c906-41da-93fd-d4865be2d0ac None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 13:13:06.801501 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:13:06.801501 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 13:13:06.801501 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 13:13:06.801501 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 13:13:06.801501 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 13:13:06.801501 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 13:13:06.801501 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:13:06.801501 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 13:13:06.801501 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:13:06.801501 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 13:13:06.801501 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:13:06.801501 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:13:06.801501 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:13:06.801501 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:13:06.801501 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:13:06.801501 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:13:06.802743 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:13:06.802743 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:13:06.802743 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:13:06.802743 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:13:06.802743 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:13:06.802743 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:13:06.802743 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 13:13:06.802743 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 13:13:06.802743 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 13:13:06.802743 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 13:13:06.802743 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:13:06.802743 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:13:06.802743 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:13:06.802743 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:13:06.802743 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:13:06.802743 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:13:06.803779 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:13:06.803779 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:13:06.803779 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:13:06.803779 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:13:06.803779 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:13:06.803779 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:13:06.803779 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:13:06.803779 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:13:06.803779 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:13:06.803779 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:13:06.803779 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 13:13:06.803779 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:13:06.803779 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 13:13:06.803779 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:13:06.806315 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 381/759] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Oct 27 13:13:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:13:06.809011 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ee517-aa48-4c0f-a58e-7c868bab7ee1 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:06.809011 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ee517-aa48-4c0f-a58e-7c868bab7ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:06.809152 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ee517-aa48-4c0f-a58e-7c868bab7ee1 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:06.813688 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 382/760] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:13:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:13:06.813688 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ee517-aa48-4c0f-a58e-7c868bab7ee1 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:06.822876 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-015eb1a7-1502-43b3-9538-6e4388a27479 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 27 13:13:06.822876 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:13:06.822876 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:13:06.822876 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:13:06.822876 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:13:06.822876 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:13:06.822876 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:13:06.822876 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:13:06.822876 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:13:06.822876 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:13:06.822876 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:13:06.822876 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:13:06.822876 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 13:13:06.822876 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 13:13:06.822876 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 13:13:06.822876 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 13:13:06.823829 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:13:06.823829 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:13:06.823829 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 13:13:06.823829 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:13:06.823829 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 13:13:06.823829 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:13:06.823829 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:13:06.823829 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:13:06.823829 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:13:06.823829 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:13:06.823829 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:13:06.823829 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:13:06.823829 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:13:06.823829 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:13:06.823829 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:13:06.823829 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:13:06.823829 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:13:06.823829 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:13:06.824782 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:13:06.824782 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:13:06.824782 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 13:13:06.824782 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 13:13:06.824782 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 13:13:06.824782 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 13:13:06.824782 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 13:13:06.824782 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 13:13:06.824782 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 27 13:13:06.824782 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:13:06.824782 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 379/761] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Oct 27 13:13:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:13:06.825938 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d7ccb-10ec-4d3b-84b3-3742e5becbbe None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:06.825938 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d7ccb-10ec-4d3b-84b3-3742e5becbbe None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:06.826114 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d7ccb-10ec-4d3b-84b3-3742e5becbbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:06.846500 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-065d7ccb-10ec-4d3b-84b3-3742e5becbbe None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:13:06.848343 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-065d7ccb-10ec-4d3b-84b3-3742e5becbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:13:06.913704 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:06.924621 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 380/762] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:13:06 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 13:13:06.924801 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ee517-aa48-4c0f-a58e-7c868bab7ee1 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:06.925304 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d7ccb-10ec-4d3b-84b3-3742e5becbbe None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:06.965887 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a254677-6a2b-4dc4-bb50-b2d956cc1520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:06.966813 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a254677-6a2b-4dc4-bb50-b2d956cc1520 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:06.967223 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a254677-6a2b-4dc4-bb50-b2d956cc1520 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:06.967631 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a254677-6a2b-4dc4-bb50-b2d956cc1520 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:06.968267 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a254677-6a2b-4dc4-bb50-b2d956cc1520 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:13:06.968572 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a254677-6a2b-4dc4-bb50-b2d956cc1520 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:06.970215 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a254677-6a2b-4dc4-bb50-b2d956cc1520 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:06.977027 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 383/763] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Oct 27 13:13:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:06.982037 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a254677-6a2b-4dc4-bb50-b2d956cc1520 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:07.027936 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:07.046807 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d7ccb-10ec-4d3b-84b3-3742e5becbbe None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:07.094586 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a254677-6a2b-4dc4-bb50-b2d956cc1520 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:07.095531 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff40297-d47b-41a0-bb49-a110b328d7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:07.097555 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff40297-d47b-41a0-bb49-a110b328d7d4 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:07.098052 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff40297-d47b-41a0-bb49-a110b328d7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:07.098524 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff40297-d47b-41a0-bb49-a110b328d7d4 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:07.099424 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff40297-d47b-41a0-bb49-a110b328d7d4 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:13:07.099925 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff40297-d47b-41a0-bb49-a110b328d7d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:07.101601 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff40297-d47b-41a0-bb49-a110b328d7d4 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:07.129455 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb6dba-5289-429f-b728-e36f4e01c071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:07.130089 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb6dba-5289-429f-b728-e36f4e01c071 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:07.130366 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb6dba-5289-429f-b728-e36f4e01c071 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:07.130635 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb6dba-5289-429f-b728-e36f4e01c071 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:07.131266 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb6dba-5289-429f-b728-e36f4e01c071 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:13:07.131569 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb6dba-5289-429f-b728-e36f4e01c071 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:07.133038 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb6dba-5289-429f-b728-e36f4e01c071 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:07.141924 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 384/764] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Oct 27 13:13:06 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:07.144369 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb6dba-5289-429f-b728-e36f4e01c071 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:07.151076 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 381/765] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Oct 27 13:13:06 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:07.194299 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff40297-d47b-41a0-bb49-a110b328d7d4 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:07.255556 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:07.264561 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb6dba-5289-429f-b728-e36f4e01c071 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:07.267365 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:07.304630 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056e54f-fc7b-4bb3-a783-6183bbae0774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:07.306616 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056e54f-fc7b-4bb3-a783-6183bbae0774 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:07.307067 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056e54f-fc7b-4bb3-a783-6183bbae0774 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:07.308447 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056e54f-fc7b-4bb3-a783-6183bbae0774 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:07.309348 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4056e54f-fc7b-4bb3-a783-6183bbae0774 None admin] RBAC: Adding query filter params (interface=public, service_id=f524b6e609c547d081900a51efd7817c, region_id=RegionOne) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:13:07.310103 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4056e54f-fc7b-4bb3-a783-6183bbae0774 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:07.311657 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4056e54f-fc7b-4bb3-a783-6183bbae0774 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:07.312005 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff40297-d47b-41a0-bb49-a110b328d7d4 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:07.324143 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 385/766] 10.222.0.52 () {56 vars in 1251 bytes} [Thu Oct 27 13:13:07 2022] GET /identity/v3/endpoints?service_id=f524b6e609c547d081900a51efd7817c&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:07.326634 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056e54f-fc7b-4bb3-a783-6183bbae0774 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:07.355712 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1273a03-925e-43a1-8e42-3f6f1a5685c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:07.356312 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1273a03-925e-43a1-8e42-3f6f1a5685c0 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:07.356596 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1273a03-925e-43a1-8e42-3f6f1a5685c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:07.356871 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1273a03-925e-43a1-8e42-3f6f1a5685c0 None admin] PATH_INFO: `/v3/services/image` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:07.357622 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1273a03-925e-43a1-8e42-3f6f1a5685c0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:07.359109 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1273a03-925e-43a1-8e42-3f6f1a5685c0 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:07.368583 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-e1273a03-925e-43a1-8e42-3f6f1a5685c0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 13:13:07.368583 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:13:07.368583 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 13:13:07.368583 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 13:13:07.368583 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 13:13:07.368583 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 13:13:07.368583 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 13:13:07.368583 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:13:07.368583 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 13:13:07.368583 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:13:07.368583 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 13:13:07.368583 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:13:07.368583 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:13:07.368583 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:13:07.368583 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:13:07.368583 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:13:07.368583 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:13:07.369632 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:13:07.369632 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:13:07.369632 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:13:07.369632 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:13:07.369632 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:13:07.369632 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:13:07.369632 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 13:13:07.369632 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 13:13:07.369632 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 13:13:07.369632 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 13:13:07.369632 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:13:07.369632 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:13:07.369632 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:13:07.369632 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:13:07.369632 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:13:07.369632 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:13:07.370856 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:13:07.370856 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:13:07.370856 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:13:07.370856 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:13:07.370856 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:13:07.370856 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:13:07.370856 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:13:07.370856 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:13:07.370856 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:13:07.370856 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:13:07.370856 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 13:13:07.370856 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:13:07.370856 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 13:13:07.370856 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:13:07.370856 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 382/767] 10.222.0.52 () {56 vars in 1105 bytes} [Thu Oct 27 13:13:07 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:13:07.375942 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1273a03-925e-43a1-8e42-3f6f1a5685c0 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:07.466214 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056e54f-fc7b-4bb3-a783-6183bbae0774 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:07.513124 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087a359-882f-4c90-bacf-0e756432d875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:07.513476 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1273a03-925e-43a1-8e42-3f6f1a5685c0 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:07.513918 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087a359-882f-4c90-bacf-0e756432d875 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:07.514145 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087a359-882f-4c90-bacf-0e756432d875 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:07.514549 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087a359-882f-4c90-bacf-0e756432d875 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:07.515223 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2087a359-882f-4c90-bacf-0e756432d875 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:07.516670 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2087a359-882f-4c90-bacf-0e756432d875 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:07.529573 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 386/768] 10.222.0.52 () {56 vars in 1087 bytes} [Thu Oct 27 13:13:07 2022] GET /identity/v3/services => generated 1957 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:13:07.533845 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:07.549308 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e7c4e-d82b-4cce-afad-6a2da654b765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:07.550021 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e7c4e-d82b-4cce-afad-6a2da654b765 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:07.550300 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e7c4e-d82b-4cce-afad-6a2da654b765 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:07.550571 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e7c4e-d82b-4cce-afad-6a2da654b765 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:07.551213 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e7c4e-d82b-4cce-afad-6a2da654b765 None admin] RBAC: Adding query filter params (name=image) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:13:07.551516 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e7c4e-d82b-4cce-afad-6a2da654b765 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:07.552934 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e7c4e-d82b-4cce-afad-6a2da654b765 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:07.560049 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 383/769] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:13:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:07.565216 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087a359-882f-4c90-bacf-0e756432d875 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:07.600405 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:07.680168 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087a359-882f-4c90-bacf-0e756432d875 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:07.718664 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806bc496-c970-4e89-a5de-36c95d149ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:07.719283 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bc496-c970-4e89-a5de-36c95d149ceb None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:07.719619 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bc496-c970-4e89-a5de-36c95d149ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:07.719901 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bc496-c970-4e89-a5de-36c95d149ceb None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:07.720535 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806bc496-c970-4e89-a5de-36c95d149ceb None admin] RBAC: Adding query filter params (type=image) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:13:07.720841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806bc496-c970-4e89-a5de-36c95d149ceb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:07.722393 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806bc496-c970-4e89-a5de-36c95d149ceb None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:07.727723 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 387/770] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:13:07 2022] GET /identity/v3/services?type=image => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:07.733870 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e7c4e-d82b-4cce-afad-6a2da654b765 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:07.841181 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e7c4e-d82b-4cce-afad-6a2da654b765 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:07.875971 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00169b-4bd8-4e5d-ac11-2a30ebffa147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:07.876567 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00169b-4bd8-4e5d-ac11-2a30ebffa147 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:07.876839 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00169b-4bd8-4e5d-ac11-2a30ebffa147 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:07.877105 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00169b-4bd8-4e5d-ac11-2a30ebffa147 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:07.877838 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00169b-4bd8-4e5d-ac11-2a30ebffa147 None admin] RBAC: Adding query filter params (interface=public, service_id=07df75986bdc47839ab87aab714392e9, region_id=RegionOne) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:13:07.878143 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00169b-4bd8-4e5d-ac11-2a30ebffa147 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:07.879500 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00169b-4bd8-4e5d-ac11-2a30ebffa147 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:07.884733 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 384/771] 10.222.0.52 () {56 vars in 1251 bytes} [Thu Oct 27 13:13:07 2022] GET /identity/v3/endpoints?service_id=07df75986bdc47839ab87aab714392e9&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:07.890464 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806bc496-c970-4e89-a5de-36c95d149ceb None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:07.986066 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:07.992936 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806bc496-c970-4e89-a5de-36c95d149ceb None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:08.027061 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43adc77-88ad-4c80-81b6-fb2f42678ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:08.027670 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43adc77-88ad-4c80-81b6-fb2f42678ef1 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:08.027941 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43adc77-88ad-4c80-81b6-fb2f42678ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:08.028203 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43adc77-88ad-4c80-81b6-fb2f42678ef1 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:08.028799 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43adc77-88ad-4c80-81b6-fb2f42678ef1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:08.030203 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43adc77-88ad-4c80-81b6-fb2f42678ef1 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:08.037119 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 388/772] 10.222.0.52 () {56 vars in 1087 bytes} [Thu Oct 27 13:13:07 2022] GET /identity/v3/services => generated 1957 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:13:08.701554 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c99a4-857a-4bbf-92f9-9f4cfd3efba5 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:08.702135 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c99a4-857a-4bbf-92f9-9f4cfd3efba5 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:08.702135 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c99a4-857a-4bbf-92f9-9f4cfd3efba5 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:08.703666 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 385/773] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:13:08.708899 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47db182-b869-4b2c-a5f6-9cbd24ce049d None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:08.709322 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47db182-b869-4b2c-a5f6-9cbd24ce049d None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:08.709613 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47db182-b869-4b2c-a5f6-9cbd24ce049d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:08.729192 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-e47db182-b869-4b2c-a5f6-9cbd24ce049d None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:13:08.730412 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e47db182-b869-4b2c-a5f6-9cbd24ce049d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:13:08.811431 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 389/774] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:13:08 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 13:13:09.072973 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c99a4-857a-4bbf-92f9-9f4cfd3efba5 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:09.123489 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:09.180334 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c99a4-857a-4bbf-92f9-9f4cfd3efba5 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:09.214772 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518a414-0aab-4891-81fc-0ec8527064c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:09.215399 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518a414-0aab-4891-81fc-0ec8527064c5 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:09.215671 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518a414-0aab-4891-81fc-0ec8527064c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:09.215939 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518a414-0aab-4891-81fc-0ec8527064c5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:09.217042 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e518a414-0aab-4891-81fc-0ec8527064c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:09.218491 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e518a414-0aab-4891-81fc-0ec8527064c5 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:09.220208 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 386/775] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:13:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:09.226137 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47db182-b869-4b2c-a5f6-9cbd24ce049d None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:09.320548 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:09.331721 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47db182-b869-4b2c-a5f6-9cbd24ce049d None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:09.366831 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef475371-f618-4ba7-824f-0434b5fc196a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:09.367429 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef475371-f618-4ba7-824f-0434b5fc196a None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:09.367701 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef475371-f618-4ba7-824f-0434b5fc196a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:09.367966 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef475371-f618-4ba7-824f-0434b5fc196a None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:09.368622 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef475371-f618-4ba7-824f-0434b5fc196a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:09.370084 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef475371-f618-4ba7-824f-0434b5fc196a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:09.400142 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 390/776] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Oct 27 13:13:09 2022] POST /identity/v3/projects => generated 311 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:13:09.681011 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2f3fc-dc11-425e-9de1-cca80784f13b None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:09.681417 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2f3fc-dc11-425e-9de1-cca80784f13b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:09.681517 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2f3fc-dc11-425e-9de1-cca80784f13b None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:09.683462 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 387/777] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:13:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:13:09.688802 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78452e-6e94-46d4-8ef8-e8f314ce5cd3 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:09.689158 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78452e-6e94-46d4-8ef8-e8f314ce5cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:09.689500 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78452e-6e94-46d4-8ef8-e8f314ce5cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:09.708470 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-7d78452e-6e94-46d4-8ef8-e8f314ce5cd3 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:13:09.709678 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7d78452e-6e94-46d4-8ef8-e8f314ce5cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:13:09.777508 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 391/778] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:13:09 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 13:13:10.040923 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f2f3fc-dc11-425e-9de1-cca80784f13b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:10.151190 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f2f3fc-dc11-425e-9de1-cca80784f13b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:10.165279 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:10.178523 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ce608-937b-4e42-b42c-873ab66096de None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:10.178880 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ce608-937b-4e42-b42c-873ab66096de None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:10.179355 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ce608-937b-4e42-b42c-873ab66096de None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:10.180777 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 392/779] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:13:10.186301 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d71b5-8e7b-4252-a4f8-a055f791d43c None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:10.186609 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d71b5-8e7b-4252-a4f8-a055f791d43c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:10.186876 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d71b5-8e7b-4252-a4f8-a055f791d43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:10.187172 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd48a4-024f-46e1-bf0f-2a1c30317a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:10.187826 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd48a4-024f-46e1-bf0f-2a1c30317a45 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:10.188101 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd48a4-024f-46e1-bf0f-2a1c30317a45 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:10.188372 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd48a4-024f-46e1-bf0f-2a1c30317a45 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:10.188947 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd48a4-024f-46e1-bf0f-2a1c30317a45 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:10.190414 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd48a4-024f-46e1-bf0f-2a1c30317a45 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:10.200056 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-b1cd48a4-024f-46e1-bf0f-2a1c30317a45 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 13:13:10.200056 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:13:10.200056 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 13:13:10.200056 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 13:13:10.200056 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 13:13:10.200056 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 13:13:10.200056 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 13:13:10.200056 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:13:10.200056 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 13:13:10.200056 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:13:10.200056 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 13:13:10.200056 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:13:10.200056 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:13:10.200056 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:13:10.200056 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:13:10.200056 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:13:10.200056 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:13:10.201019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:13:10.201019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:13:10.201019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:13:10.201019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:13:10.201019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:13:10.201019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:13:10.201019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 13:13:10.201019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 13:13:10.201019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 13:13:10.201019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 13:13:10.201019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:13:10.201019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:13:10.201019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:13:10.201019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:13:10.201019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:13:10.201019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:13:10.201925 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:13:10.201925 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:13:10.201925 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:13:10.201925 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:13:10.201925 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:13:10.201925 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:13:10.201925 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:13:10.201925 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:13:10.201925 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:13:10.201925 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:13:10.201925 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 13:13:10.201925 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:13:10.201925 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 13:13:10.201925 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:13:10.201925 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 388/780] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Oct 27 13:13:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:13:10.207009 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd48a4-024f-46e1-bf0f-2a1c30317a45 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:10.207366 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-4a2d71b5-8e7b-4252-a4f8-a055f791d43c None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:13:10.208609 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-4a2d71b5-8e7b-4252-a4f8-a055f791d43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:13:10.289517 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 393/781] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:13:10 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 13:13:10.314742 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd48a4-024f-46e1-bf0f-2a1c30317a45 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:10.349707 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54caad4-b0f5-417a-9e45-49aded829b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:10.350302 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54caad4-b0f5-417a-9e45-49aded829b5c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:10.350546 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54caad4-b0f5-417a-9e45-49aded829b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:10.350844 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54caad4-b0f5-417a-9e45-49aded829b5c None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:10.351455 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54caad4-b0f5-417a-9e45-49aded829b5c None admin] RBAC: Adding query filter params (name=compute) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:13:10.351752 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54caad4-b0f5-417a-9e45-49aded829b5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:10.353206 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54caad4-b0f5-417a-9e45-49aded829b5c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:10.363359 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 389/782] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Oct 27 13:13:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:13:10.364401 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d71b5-8e7b-4252-a4f8-a055f791d43c None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:10.367045 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:10.465590 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d71b5-8e7b-4252-a4f8-a055f791d43c None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:10.499873 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868df32d-2383-4a99-8437-4deeb95f337c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:10.500477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868df32d-2383-4a99-8437-4deeb95f337c None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:10.500756 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868df32d-2383-4a99-8437-4deeb95f337c None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:10.501022 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868df32d-2383-4a99-8437-4deeb95f337c None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:10.501664 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868df32d-2383-4a99-8437-4deeb95f337c None admin] RBAC: Adding query filter params (type=compute) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:13:10.501966 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868df32d-2383-4a99-8437-4deeb95f337c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:10.503379 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868df32d-2383-4a99-8437-4deeb95f337c None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:10.508572 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 394/783] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Oct 27 13:13:10 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:13:10.514224 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54caad4-b0f5-417a-9e45-49aded829b5c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:10.550438 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868df32d-2383-4a99-8437-4deeb95f337c None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:10.558705 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:10.619467 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54caad4-b0f5-417a-9e45-49aded829b5c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:10.625594 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:10.654601 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03fe18e-ec21-428a-b093-cca6c16b5c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:10.655211 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03fe18e-ec21-428a-b093-cca6c16b5c7f None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:10.655475 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03fe18e-ec21-428a-b093-cca6c16b5c7f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:10.655740 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03fe18e-ec21-428a-b093-cca6c16b5c7f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:10.656408 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03fe18e-ec21-428a-b093-cca6c16b5c7f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:10.657793 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03fe18e-ec21-428a-b093-cca6c16b5c7f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:10.664035 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868df32d-2383-4a99-8437-4deeb95f337c None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:10.678980 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 390/784] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:13:10 2022] POST /identity/v3/endpoints => generated 334 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:13:10.711240 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfd5af-c44f-4427-b262-dfe9c83b6621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:10.711947 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfd5af-c44f-4427-b262-dfe9c83b6621 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:10.712129 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfd5af-c44f-4427-b262-dfe9c83b6621 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:10.712426 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfd5af-c44f-4427-b262-dfe9c83b6621 None admin] PATH_INFO: `/v3/services/image` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:10.713024 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dfd5af-c44f-4427-b262-dfe9c83b6621 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:10.714614 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dfd5af-c44f-4427-b262-dfe9c83b6621 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:10.725120 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-d3dfd5af-c44f-4427-b262-dfe9c83b6621 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 13:13:10.725120 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:13:10.725120 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 13:13:10.725120 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 13:13:10.725120 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 13:13:10.725120 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 13:13:10.725120 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 13:13:10.725120 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:13:10.725120 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 13:13:10.725120 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:13:10.725120 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 13:13:10.725120 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:13:10.725120 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:13:10.725120 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:13:10.725120 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:13:10.725120 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:13:10.725120 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:13:10.726275 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:13:10.726275 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:13:10.726275 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:13:10.726275 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:13:10.726275 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:13:10.726275 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:13:10.726275 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 13:13:10.726275 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 13:13:10.726275 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 13:13:10.726275 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 13:13:10.726275 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:13:10.726275 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:13:10.726275 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:13:10.726275 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:13:10.726275 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:13:10.726275 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:13:10.730625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:13:10.730625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:13:10.730625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:13:10.730625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:13:10.730625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:13:10.730625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:13:10.730625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:13:10.730625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:13:10.730625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:13:10.730625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:13:10.730625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 13:13:10.730625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:13:10.730625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 13:13:10.730625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:13:10.730625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 395/785] 10.222.0.52 () {56 vars in 1105 bytes} [Thu Oct 27 13:13:10 2022] GET /identity/v3/services/image => generated 86 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:13:10.734699 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03fe18e-ec21-428a-b093-cca6c16b5c7f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:10.845998 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:10.851153 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03fe18e-ec21-428a-b093-cca6c16b5c7f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:10.885583 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332879df-d38b-4734-b4e4-99e6435b6d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:10.886103 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332879df-d38b-4734-b4e4-99e6435b6d0b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:10.886378 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332879df-d38b-4734-b4e4-99e6435b6d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:10.886646 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332879df-d38b-4734-b4e4-99e6435b6d0b None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:10.887269 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332879df-d38b-4734-b4e4-99e6435b6d0b None admin] RBAC: Adding query filter params (name=image) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:13:10.887566 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332879df-d38b-4734-b4e4-99e6435b6d0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:10.888973 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332879df-d38b-4734-b4e4-99e6435b6d0b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:10.894426 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 391/786] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:13:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:10.900114 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfd5af-c44f-4427-b262-dfe9c83b6621 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:11.005246 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfd5af-c44f-4427-b262-dfe9c83b6621 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:11.032161 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:11.042786 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c1d01-5956-41eb-8ca9-474d078b869f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:11.043389 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c1d01-5956-41eb-8ca9-474d078b869f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:11.043663 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c1d01-5956-41eb-8ca9-474d078b869f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:11.043934 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c1d01-5956-41eb-8ca9-474d078b869f None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:11.044562 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c1d01-5956-41eb-8ca9-474d078b869f None admin] RBAC: Adding query filter params (type=image) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:13:11.044860 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c1d01-5956-41eb-8ca9-474d078b869f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:11.046263 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c1d01-5956-41eb-8ca9-474d078b869f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:11.051433 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 396/787] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:13:10 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:11.056972 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332879df-d38b-4734-b4e4-99e6435b6d0b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:11.160350 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332879df-d38b-4734-b4e4-99e6435b6d0b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:11.194970 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be164010-7dd0-4de1-8d0d-db95d8ddd8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:11.195575 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be164010-7dd0-4de1-8d0d-db95d8ddd8c6 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:11.195853 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be164010-7dd0-4de1-8d0d-db95d8ddd8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:11.196129 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be164010-7dd0-4de1-8d0d-db95d8ddd8c6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:11.196796 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be164010-7dd0-4de1-8d0d-db95d8ddd8c6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:11.198206 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be164010-7dd0-4de1-8d0d-db95d8ddd8c6 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:11.221013 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 392/788] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:13:11 2022] POST /identity/v3/endpoints => generated 327 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:13:11.558635 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf160d5-e87e-4132-9978-a17fc8d1f0fa None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:11.559035 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf160d5-e87e-4132-9978-a17fc8d1f0fa None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:11.559211 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf160d5-e87e-4132-9978-a17fc8d1f0fa None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:11.560582 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 397/789] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:13:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:13:11.566116 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ac5c8-e3bc-406a-b697-4098c2ee3635 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:11.566378 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ac5c8-e3bc-406a-b697-4098c2ee3635 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:11.566658 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ac5c8-e3bc-406a-b697-4098c2ee3635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:11.585140 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-794ac5c8-e3bc-406a-b697-4098c2ee3635 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:13:11.586336 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-794ac5c8-e3bc-406a-b697-4098c2ee3635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:13:11.600090 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:11.663856 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 393/790] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:13:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 13:13:11.926226 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf160d5-e87e-4132-9978-a17fc8d1f0fa None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:12.034908 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf160d5-e87e-4132-9978-a17fc8d1f0fa None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:12.068823 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c9cce-9d00-478a-82f0-9462201cb3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:12.069454 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c9cce-9d00-478a-82f0-9462201cb3cd None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:12.069757 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c9cce-9d00-478a-82f0-9462201cb3cd None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:12.070026 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c9cce-9d00-478a-82f0-9462201cb3cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:12.071150 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c9cce-9d00-478a-82f0-9462201cb3cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:12.072590 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c9cce-9d00-478a-82f0-9462201cb3cd None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:12.074461 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 398/791] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:13:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:12.079997 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ac5c8-e3bc-406a-b697-4098c2ee3635 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:12.179097 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ac5c8-e3bc-406a-b697-4098c2ee3635 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:12.212690 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f70d4-8a1f-4de8-b9dc-3560e9820f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:12.213288 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f70d4-8a1f-4de8-b9dc-3560e9820f46 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:12.213557 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f70d4-8a1f-4de8-b9dc-3560e9820f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:12.213858 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f70d4-8a1f-4de8-b9dc-3560e9820f46 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:12.214507 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7f70d4-8a1f-4de8-b9dc-3560e9820f46 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:12.215942 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7f70d4-8a1f-4de8-b9dc-3560e9820f46 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:12.233072 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:12.244651 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 394/792] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Oct 27 13:13:12 2022] POST /identity/v3/users => generated 285 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:13:12.898283 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181633f2-4e01-4a84-bbc3-feb2c2ac12dd None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:12.898662 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181633f2-4e01-4a84-bbc3-feb2c2ac12dd None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:12.898826 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181633f2-4e01-4a84-bbc3-feb2c2ac12dd None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:12.900143 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 399/793] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:13:12.905680 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887f5bf-0dcf-428b-bbf8-58e43327f364 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:12.906112 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887f5bf-0dcf-428b-bbf8-58e43327f364 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:12.906447 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887f5bf-0dcf-428b-bbf8-58e43327f364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:12.925365 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-3887f5bf-0dcf-428b-bbf8-58e43327f364 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:13:12.926601 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3887f5bf-0dcf-428b-bbf8-58e43327f364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:13:12.997220 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 395/794] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:13:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 13:13:13.256149 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181633f2-4e01-4a84-bbc3-feb2c2ac12dd None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:13.322657 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:13.367396 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181633f2-4e01-4a84-bbc3-feb2c2ac12dd None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:13.376986 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ddc19e-c9f5-4f0d-953d-02ec647bf2a2 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:13.377590 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ddc19e-c9f5-4f0d-953d-02ec647bf2a2 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:13.377795 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ddc19e-c9f5-4f0d-953d-02ec647bf2a2 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:13.379466 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 396/795] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:13:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:13:13.384580 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb4d86-8b35-4831-a88e-8af60c475873 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:13.384881 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb4d86-8b35-4831-a88e-8af60c475873 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:13.385153 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb4d86-8b35-4831-a88e-8af60c475873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:13.403042 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-2ceb4d86-8b35-4831-a88e-8af60c475873 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:13:13.404205 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2ceb4d86-8b35-4831-a88e-8af60c475873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:13:13.405075 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2bda31-3001-402e-966a-6d47bf02f812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:13.405756 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2bda31-3001-402e-966a-6d47bf02f812 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:13.406042 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2bda31-3001-402e-966a-6d47bf02f812 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:13.406312 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2bda31-3001-402e-966a-6d47bf02f812 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:13.417050 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2bda31-3001-402e-966a-6d47bf02f812 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:13:13.421949 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-fe2bda31-3001-402e-966a-6d47bf02f812 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 13:13:13.421949 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:13:13.421949 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:13:13.421949 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:13:13.421949 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:13:13.421949 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:13:13.421949 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:13:13.421949 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:13:13.421949 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:13:13.421949 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:13:13.421949 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:13:13.421949 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:13:13.421949 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:13:13.421949 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:13:13.421949 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:13:13.421949 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:13:13.422869 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:13:13.422869 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:13:13.422869 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:13:13.422869 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:13:13.422869 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:13:13.422869 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:13:13.422869 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:13:13.422869 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:13:13.422869 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:13:13.422869 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:13:13.422869 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:13:13.422869 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:13:13.422869 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:13:13.422869 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:13:13.422869 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:13:13.422869 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:13:13.423695 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:13:13.423695 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:13:13.423695 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:13:13.423695 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:13:13.423695 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:13:13.423695 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:13:13.423695 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:13:13.423695 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:13:13.423695 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:13:13.423695 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:13:13.423695 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 13:13:13.423695 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:13:13.423695 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 400/796] 10.222.0.52 () {56 vars in 1120 bytes} [Thu Oct 27 13:13:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:13:13.428999 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2bda31-3001-402e-966a-6d47bf02f812 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:13.483129 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 397/797] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:13:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 13:13:13.534768 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2bda31-3001-402e-966a-6d47bf02f812 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:13.552323 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:13.570902 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70fccc-a15e-4a0a-83a6-678f9680c8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:13.571533 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70fccc-a15e-4a0a-83a6-678f9680c8a8 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:13.571809 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70fccc-a15e-4a0a-83a6-678f9680c8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:13.572081 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70fccc-a15e-4a0a-83a6-678f9680c8a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:13.572736 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf70fccc-a15e-4a0a-83a6-678f9680c8a8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:13:13.573036 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf70fccc-a15e-4a0a-83a6-678f9680c8a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:13.574455 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf70fccc-a15e-4a0a-83a6-678f9680c8a8 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:13.582837 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 401/798] 10.222.0.52 () {56 vars in 1115 bytes} [Thu Oct 27 13:13:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:13:13.588725 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb4d86-8b35-4831-a88e-8af60c475873 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:13.648148 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:13.689946 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb4d86-8b35-4831-a88e-8af60c475873 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:13.723664 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c7369-d1ed-4e50-bc78-c999eb971bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:13.724296 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c7369-d1ed-4e50-bc78-c999eb971bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:13.724573 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c7369-d1ed-4e50-bc78-c999eb971bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:13.724838 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c7369-d1ed-4e50-bc78-c999eb971bb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:13.734800 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c7369-d1ed-4e50-bc78-c999eb971bb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:13.736249 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c7369-d1ed-4e50-bc78-c999eb971bb6 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:13.744642 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70fccc-a15e-4a0a-83a6-678f9680c8a8 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:13.751776 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-297c7369-d1ed-4e50-bc78-c999eb971bb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:13:13.751776 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:13:13.751776 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:13:13.751776 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:13:13.751776 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:13:13.751776 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:13:13.751776 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:13:13.751776 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:13:13.751776 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:13:13.751776 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:13:13.751776 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:13:13.751776 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:13:13.751776 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:13:13.751776 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:13:13.751776 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:13:13.751776 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:13:13.753220 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:13:13.753220 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:13:13.753220 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:13:13.753220 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:13:13.753220 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:13:13.753220 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:13:13.753220 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:13:13.753220 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:13:13.753220 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:13:13.753220 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:13:13.753220 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:13:13.753220 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:13:13.753220 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:13:13.753220 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:13:13.753220 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:13:13.753220 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:13:13.753220 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:13:13.754172 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:13:13.754172 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:13:13.754172 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:13:13.757616 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 398/799] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:13:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:13:13.758644 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c7369-d1ed-4e50-bc78-c999eb971bb6 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:13.858070 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70fccc-a15e-4a0a-83a6-678f9680c8a8 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:13.875030 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c7369-d1ed-4e50-bc78-c999eb971bb6 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:13.889059 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:13.895754 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e331646-f5c1-4e53-9291-95cc52928fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:13.896612 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e331646-f5c1-4e53-9291-95cc52928fff None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:13.897034 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e331646-f5c1-4e53-9291-95cc52928fff None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:13.897452 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e331646-f5c1-4e53-9291-95cc52928fff None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:13.898722 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e331646-f5c1-4e53-9291-95cc52928fff None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:13.900666 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e331646-f5c1-4e53-9291-95cc52928fff None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:13.911696 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.sql.core [None req-8e331646-f5c1-4e53-9291-95cc52928fff None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 27 13:13:13.911696 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 27 13:13:13.911696 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [parameters: {'id': '950592f855dd4371a88f75f63c9d598a', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 27 13:13:13.911696 dv-cinder-862432-3-smb devstack@keystone.service[81482]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81482) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 27 13:13:13.912106 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1c91fd-8bfa-43fd-8809-67d90790591b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:13.912591 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c91fd-8bfa-43fd-8809-67d90790591b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:13.912871 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c91fd-8bfa-43fd-8809-67d90790591b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:13.913140 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c91fd-8bfa-43fd-8809-67d90790591b None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:13.913810 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1c91fd-8bfa-43fd-8809-67d90790591b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:13:13.914114 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1c91fd-8bfa-43fd-8809-67d90790591b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:13.915475 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1c91fd-8bfa-43fd-8809-67d90790591b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:13.921590 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-8e331646-f5c1-4e53-9291-95cc52928fff None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 27 13:13:13.921590 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:13:13.921590 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 13:13:13.921590 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 27 13:13:13.921590 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 13:13:13.921590 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 27 13:13:13.921590 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 13:13:13.921590 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application result = self._query(query) Oct 27 13:13:13.921590 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 13:13:13.921590 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application conn.query(q) Oct 27 13:13:13.921590 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 13:13:13.921590 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 13:13:13.921590 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 13:13:13.921590 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application result.read() Oct 27 13:13:13.922616 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 13:13:13.922616 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 27 13:13:13.922616 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 13:13:13.922616 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 27 13:13:13.922616 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 13:13:13.922616 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 27 13:13:13.922616 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 13:13:13.922616 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 27 13:13:13.922616 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 27 13:13:13.922616 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:13:13.922616 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 27 13:13:13.922616 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:13:13.922616 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:13:13.922616 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 27 13:13:13.922616 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 27 13:13:13.922616 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 27 13:13:13.922616 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 27 13:13:13.922616 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 27 13:13:13.923803 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application next(self.gen) Oct 27 13:13:13.923803 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 27 13:13:13.923803 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application yield resource Oct 27 13:13:13.923803 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 27 13:13:13.923803 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application next(self.gen) Oct 27 13:13:13.923803 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 27 13:13:13.923803 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self.session.rollback() Oct 27 13:13:13.923803 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 13:13:13.923803 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self.force_reraise() Oct 27 13:13:13.923803 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 13:13:13.923803 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise self.value Oct 27 13:13:13.923803 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 27 13:13:13.923803 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 27 13:13:13.923803 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 27 13:13:13.923803 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application session.commit() Oct 27 13:13:13.923803 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 27 13:13:13.923803 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 27 13:13:13.924948 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 27 13:13:13.924948 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._prepare_impl() Oct 27 13:13:13.924948 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 27 13:13:13.924948 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self.session.flush() Oct 27 13:13:13.924948 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 27 13:13:13.924948 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._flush(objects) Oct 27 13:13:13.924948 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 27 13:13:13.924948 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 27 13:13:13.924948 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 27 13:13:13.924948 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application compat.raise_( Oct 27 13:13:13.924948 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 13:13:13.924948 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception Oct 27 13:13:13.924948 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 27 13:13:13.924948 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application flush_context.execute() Oct 27 13:13:13.924948 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 27 13:13:13.924948 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rec.execute(self) Oct 27 13:13:13.924948 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 27 13:13:13.929722 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 27 13:13:13.929722 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 27 13:13:13.929722 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 27 13:13:13.929722 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 27 13:13:13.929722 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 27 13:13:13.929722 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 27 13:13:13.929722 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 27 13:13:13.929722 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 27 13:13:13.929722 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 27 13:13:13.929722 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 27 13:13:13.929722 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 27 13:13:13.929722 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 27 13:13:13.929722 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 27 13:13:13.929722 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 27 13:13:13.929722 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 27 13:13:13.930762 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 13:13:13.930762 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception Oct 27 13:13:13.930762 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 13:13:13.930762 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 27 13:13:13.930762 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 13:13:13.930762 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 27 13:13:13.930762 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 13:13:13.930762 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application result = self._query(query) Oct 27 13:13:13.930762 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 13:13:13.930762 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application conn.query(q) Oct 27 13:13:13.930762 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 13:13:13.930762 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 13:13:13.930762 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 13:13:13.930762 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application result.read() Oct 27 13:13:13.930762 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 13:13:13.930762 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 27 13:13:13.930762 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 13:13:13.931841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 27 13:13:13.931841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 13:13:13.931841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 27 13:13:13.931841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 13:13:13.931841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 27 13:13:13.931841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 27 13:13:13.931841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 27 13:13:13.931841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [parameters: {'id': '950592f855dd4371a88f75f63c9d598a', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 27 13:13:13.931841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 27 13:13:13.931841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:13:13.931841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 13:13:13.931841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:13:13.931841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:13:13.931841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 27 13:13:13.931841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 27 13:13:13.933151 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 27 13:13:13.933151 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 27 13:13:13.933151 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 27 13:13:13.933151 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:13:13.933151 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 13:13:13.933151 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:13:13.933151 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:13:13.933151 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:13:13.933151 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:13:13.933151 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:13:13.933151 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:13:13.933151 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:13:13.933151 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:13:13.933151 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:13:13.933151 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:13:13.933151 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:13:13.933151 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:13:13.934296 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 27 13:13:13.934296 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 27 13:13:13.934296 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:13:13.934296 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:13:13.934296 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 27 13:13:13.934296 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 27 13:13:13.934296 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:13:13.934296 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:13:13.934296 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 27 13:13:13.934296 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 27 13:13:13.934296 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 27 13:13:13.934296 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:13:13.934296 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 402/800] 10.222.0.52 () {60 vars in 1137 bytes} [Thu Oct 27 13:13:13 2022] POST /identity/v3/domains => generated 190 bytes in 183 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:13:13.935683 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 399/801] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:13:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:13.936318 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e331646-f5c1-4e53-9291-95cc52928fff None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:13.942156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1c91fd-8bfa-43fd-8809-67d90790591b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:13.986261 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:14.046187 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e331646-f5c1-4e53-9291-95cc52928fff None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:14.046396 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1c91fd-8bfa-43fd-8809-67d90790591b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:14.082816 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6999786-09e5-452f-9181-2a223408a9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:14.083388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6999786-09e5-452f-9181-2a223408a9c6 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:14.083670 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6999786-09e5-452f-9181-2a223408a9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:14.083835 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c811902-30c3-4d34-b1d3-842b0a62cbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:14.083948 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6999786-09e5-452f-9181-2a223408a9c6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:14.084469 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c811902-30c3-4d34-b1d3-842b0a62cbe7 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:14.084745 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c811902-30c3-4d34-b1d3-842b0a62cbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:14.085016 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c811902-30c3-4d34-b1d3-842b0a62cbe7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:14.091711 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6999786-09e5-452f-9181-2a223408a9c6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:14.093621 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6999786-09e5-452f-9181-2a223408a9c6 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:14.097119 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c811902-30c3-4d34-b1d3-842b0a62cbe7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:14.098363 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c811902-30c3-4d34-b1d3-842b0a62cbe7 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:14.106401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-a6999786-09e5-452f-9181-2a223408a9c6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 13:13:14.106401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:13:14.106401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:13:14.106401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:13:14.106401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:13:14.106401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:13:14.106401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:13:14.106401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:13:14.106401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:13:14.106401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:13:14.106401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:13:14.106401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:13:14.106401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 13:13:14.106401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 13:13:14.106401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 13:13:14.106401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 13:13:14.107490 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:13:14.107490 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:13:14.107490 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 13:13:14.107490 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:13:14.107490 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 13:13:14.107490 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:13:14.107490 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:13:14.107490 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:13:14.107490 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:13:14.107490 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:13:14.107490 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:13:14.107490 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:13:14.107490 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:13:14.107490 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:13:14.107490 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:13:14.107490 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:13:14.107490 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:13:14.107490 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:13:14.108577 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:13:14.108577 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:13:14.108577 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 13:13:14.108577 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 13:13:14.108577 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 13:13:14.108577 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 13:13:14.108577 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 13:13:14.108577 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 13:13:14.108577 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 27 13:13:14.108577 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:13:14.108577 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 400/802] 10.222.0.52 () {56 vars in 1093 bytes} [Thu Oct 27 13:13:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:13:14.113386 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6999786-09e5-452f-9181-2a223408a9c6 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:14.115659 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-8c811902-30c3-4d34-b1d3-842b0a62cbe7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:13:14.115659 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:13:14.115659 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:13:14.115659 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:13:14.115659 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:13:14.115659 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:13:14.115659 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:13:14.115659 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:13:14.115659 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:13:14.115659 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:13:14.115659 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:13:14.115659 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:13:14.115659 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:13:14.115659 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:13:14.115659 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:13:14.115659 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:13:14.116651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:13:14.116651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:13:14.116651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:13:14.116651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:13:14.116651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:13:14.116651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:13:14.116651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:13:14.116651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:13:14.116651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:13:14.116651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:13:14.116651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:13:14.116651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:13:14.116651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:13:14.116651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:13:14.116651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:13:14.116651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:13:14.116651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:13:14.117597 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:13:14.117597 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:13:14.117597 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:13:14.117597 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 403/803] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:13:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:13:14.122554 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c811902-30c3-4d34-b1d3-842b0a62cbe7 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:14.149346 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:14.220122 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:14.222954 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6999786-09e5-452f-9181-2a223408a9c6 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:14.227184 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c811902-30c3-4d34-b1d3-842b0a62cbe7 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:14.258704 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297833e7-6685-4dff-9951-47f624c8d549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:14.259339 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297833e7-6685-4dff-9951-47f624c8d549 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:14.259580 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297833e7-6685-4dff-9951-47f624c8d549 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:14.259889 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297833e7-6685-4dff-9951-47f624c8d549 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:14.260566 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297833e7-6685-4dff-9951-47f624c8d549 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:13:14.260935 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297833e7-6685-4dff-9951-47f624c8d549 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:14.261660 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973593d-cfb2-4c11-8e23-bb2cba645513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:14.262319 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297833e7-6685-4dff-9951-47f624c8d549 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:14.262418 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973593d-cfb2-4c11-8e23-bb2cba645513 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:14.262659 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973593d-cfb2-4c11-8e23-bb2cba645513 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:14.262990 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973593d-cfb2-4c11-8e23-bb2cba645513 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:14.263698 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3973593d-cfb2-4c11-8e23-bb2cba645513 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:13:14.264076 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3973593d-cfb2-4c11-8e23-bb2cba645513 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:14.265501 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3973593d-cfb2-4c11-8e23-bb2cba645513 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:14.277770 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 404/804] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:13:14.288482 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 401/805] 10.222.0.52 () {56 vars in 1133 bytes} [Thu Oct 27 13:13:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:14.294892 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973593d-cfb2-4c11-8e23-bb2cba645513 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:14.409752 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973593d-cfb2-4c11-8e23-bb2cba645513 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:14.414793 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ad39e-eae0-43ec-b40e-c4deea1390a9 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:14.415334 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ad39e-eae0-43ec-b40e-c4deea1390a9 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:14.415334 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ad39e-eae0-43ec-b40e-c4deea1390a9 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:14.416908 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 402/806] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:13:14.423361 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b43d3-cd90-4029-bab3-9c9493fbedd8 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:14.424152 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b43d3-cd90-4029-bab3-9c9493fbedd8 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:14.424656 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b43d3-cd90-4029-bab3-9c9493fbedd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:14.446162 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-280b43d3-cd90-4029-bab3-9c9493fbedd8 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:13:14.447981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-280b43d3-cd90-4029-bab3-9c9493fbedd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:13:14.451608 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb57779-ce9e-4fa0-82a4-81f17b5c02ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:14.452260 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb57779-ce9e-4fa0-82a4-81f17b5c02ed None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:14.452527 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb57779-ce9e-4fa0-82a4-81f17b5c02ed None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:14.452794 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb57779-ce9e-4fa0-82a4-81f17b5c02ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:14.463549 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb57779-ce9e-4fa0-82a4-81f17b5c02ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:14.465558 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb57779-ce9e-4fa0-82a4-81f17b5c02ed None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:14.482574 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-3eb57779-ce9e-4fa0-82a4-81f17b5c02ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:13:14.482574 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:13:14.482574 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:13:14.482574 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:13:14.482574 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:13:14.482574 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:13:14.482574 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:13:14.482574 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:13:14.482574 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:13:14.482574 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:13:14.482574 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:13:14.482574 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:13:14.482574 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:13:14.482574 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:13:14.482574 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:13:14.482574 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:13:14.483651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:13:14.483651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:13:14.483651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:13:14.483651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:13:14.483651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:13:14.483651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:13:14.483651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:13:14.483651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:13:14.483651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:13:14.483651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:13:14.483651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:13:14.483651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:13:14.483651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:13:14.483651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:13:14.483651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:13:14.483651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:13:14.483651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:13:14.484537 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:13:14.484537 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:13:14.484537 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:13:14.484537 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 405/807] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:13:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:13:14.490794 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb57779-ce9e-4fa0-82a4-81f17b5c02ed None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:14.504188 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:14.533740 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 403/808] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:13:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 13:13:14.602240 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb57779-ce9e-4fa0-82a4-81f17b5c02ed None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:14.636422 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1ced5-4002-4d0c-97d8-75cb3cacdf4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:14.637034 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1ced5-4002-4d0c-97d8-75cb3cacdf4a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:14.637313 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1ced5-4002-4d0c-97d8-75cb3cacdf4a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:14.637613 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1ced5-4002-4d0c-97d8-75cb3cacdf4a None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:14.638258 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1ced5-4002-4d0c-97d8-75cb3cacdf4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:13:14.638559 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1ced5-4002-4d0c-97d8-75cb3cacdf4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:14.639941 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1ced5-4002-4d0c-97d8-75cb3cacdf4a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:14.651857 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 406/809] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:13:14.657561 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b43d3-cd90-4029-bab3-9c9493fbedd8 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:14.678897 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:14.756866 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b43d3-cd90-4029-bab3-9c9493fbedd8 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:14.792248 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c039f-967c-4b0e-95e3-17f17986494d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:14.792876 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c039f-967c-4b0e-95e3-17f17986494d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:14.793154 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c039f-967c-4b0e-95e3-17f17986494d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:14.793425 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c039f-967c-4b0e-95e3-17f17986494d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:14.800708 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c039f-967c-4b0e-95e3-17f17986494d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:14.802212 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c039f-967c-4b0e-95e3-17f17986494d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:14.805328 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1ced5-4002-4d0c-97d8-75cb3cacdf4a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:14.814097 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-f60c039f-967c-4b0e-95e3-17f17986494d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:13:14.814097 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:13:14.814097 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:13:14.814097 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:13:14.814097 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:13:14.814097 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:13:14.814097 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:13:14.814097 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:13:14.814097 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:13:14.814097 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:13:14.814097 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:13:14.814097 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:13:14.814097 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 13:13:14.814097 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 13:13:14.814097 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 13:13:14.815254 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 13:13:14.815254 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:13:14.815254 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:13:14.815254 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:13:14.815254 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:13:14.815254 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:13:14.815254 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:13:14.815254 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:13:14.815254 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:13:14.815254 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:13:14.815254 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:13:14.815254 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:13:14.815254 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:13:14.815254 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:13:14.815254 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:13:14.815254 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:13:14.815254 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:13:14.821121 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 13:13:14.821121 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 13:13:14.821121 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 13:13:14.821121 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 13:13:14.821121 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 13:13:14.821121 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 13:13:14.821121 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:13:14.821121 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:13:14.821121 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 404/810] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Oct 27 13:13:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:13:14.821121 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c039f-967c-4b0e-95e3-17f17986494d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:14.876763 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:14.900254 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:14.909336 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1ced5-4002-4d0c-97d8-75cb3cacdf4a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:14.919899 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c039f-967c-4b0e-95e3-17f17986494d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:14.943113 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b1889-ef65-41c5-ad80-ca9367a8a718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:14.943659 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b1889-ef65-41c5-ad80-ca9367a8a718 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:14.943937 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b1889-ef65-41c5-ad80-ca9367a8a718 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:14.944205 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b1889-ef65-41c5-ad80-ca9367a8a718 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:14.954087 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b1889-ef65-41c5-ad80-ca9367a8a718 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:13:14.954204 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb131840-4d07-4adb-b996-35b79df54fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:14.954773 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb131840-4d07-4adb-b996-35b79df54fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:14.955053 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb131840-4d07-4adb-b996-35b79df54fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:14.955324 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb131840-4d07-4adb-b996-35b79df54fb9 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:14.956480 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb131840-4d07-4adb-b996-35b79df54fb9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:13:14.957017 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb131840-4d07-4adb-b996-35b79df54fb9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:14.958858 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-3f1b1889-ef65-41c5-ad80-ca9367a8a718 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:13:14.958858 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:13:14.958858 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:13:14.958858 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:13:14.958858 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:13:14.958858 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:13:14.958858 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:13:14.958858 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:13:14.958858 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:13:14.958858 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:13:14.958858 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:13:14.958858 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:13:14.958858 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:13:14.958858 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:13:14.958858 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:13:14.958858 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:13:14.960033 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:13:14.960033 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:13:14.960033 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:13:14.960033 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:13:14.960033 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:13:14.960033 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:13:14.960033 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:13:14.960033 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:13:14.960033 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:13:14.960033 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:13:14.960033 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:13:14.960033 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:13:14.960033 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:13:14.960033 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:13:14.960033 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:13:14.960033 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:13:14.960881 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:13:14.960881 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:13:14.960881 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:13:14.960881 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:13:14.960881 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:13:14.960881 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:13:14.960881 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:13:14.960881 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:13:14.960881 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:13:14.960881 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:13:14.960881 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:13:14.960881 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:13:14.961579 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb131840-4d07-4adb-b996-35b79df54fb9 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:14.961657 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 407/811] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Oct 27 13:13:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:13:14.966206 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b1889-ef65-41c5-ad80-ca9367a8a718 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:14.977562 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 405/812] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Oct 27 13:13:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:14.984740 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb131840-4d07-4adb-b996-35b79df54fb9 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:15.069073 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b1889-ef65-41c5-ad80-ca9367a8a718 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:15.082120 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb131840-4d07-4adb-b996-35b79df54fb9 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:15.095889 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:15.105428 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15c313-f357-4ac4-8a78-4c64b504b9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:15.106084 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15c313-f357-4ac4-8a78-4c64b504b9d3 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:15.106363 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15c313-f357-4ac4-8a78-4c64b504b9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:15.106685 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15c313-f357-4ac4-8a78-4c64b504b9d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:15.107341 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc15c313-f357-4ac4-8a78-4c64b504b9d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:13:15.107646 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc15c313-f357-4ac4-8a78-4c64b504b9d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:15.109039 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc15c313-f357-4ac4-8a78-4c64b504b9d3 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:15.115157 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0356f-5b0c-4e57-9037-40c38393a7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:15.115811 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0356f-5b0c-4e57-9037-40c38393a7a2 None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:15.116092 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0356f-5b0c-4e57-9037-40c38393a7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:15.116361 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0356f-5b0c-4e57-9037-40c38393a7a2 None admin] PATH_INFO: `/v3/projects/0be19dd5a0df4cf79fe2ec14d11521f0/users/719e4bf834d6490b96066e55a26fb159/roles/9bda48922f54416c9673d1efc1d45673` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:15.118196 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 408/813] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Oct 27 13:13:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:13:15.118480 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b0356f-5b0c-4e57-9037-40c38393a7a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=0be19dd5a0df4cf79fe2ec14d11521f0, user_id=719e4bf834d6490b96066e55a26fb159, role_id=9bda48922f54416c9673d1efc1d45673)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:15.119884 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b0356f-5b0c-4e57-9037-40c38393a7a2 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:15.123943 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15c313-f357-4ac4-8a78-4c64b504b9d3 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:15.129798 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:15.135189 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 406/814] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Oct 27 13:13:14 2022] PUT /identity/v3/projects/0be19dd5a0df4cf79fe2ec14d11521f0/users/719e4bf834d6490b96066e55a26fb159/roles/9bda48922f54416c9673d1efc1d45673 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:13:15.235169 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15c313-f357-4ac4-8a78-4c64b504b9d3 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:15.272869 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7966a-a871-4449-81f5-02ae54b10cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:15.273611 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7966a-a871-4449-81f5-02ae54b10cfc None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:15.273792 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7966a-a871-4449-81f5-02ae54b10cfc None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:15.274082 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7966a-a871-4449-81f5-02ae54b10cfc None admin] PATH_INFO: `/v3/users/5c1ab5e5d1dc4895a5c078ce7f77c274` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:15.291110 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd7966a-a871-4449-81f5-02ae54b10cfc None admin] RBAC: Authorizing `identity:get_user(user_id=5c1ab5e5d1dc4895a5c078ce7f77c274)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:15.292586 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd7966a-a871-4449-81f5-02ae54b10cfc None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:15.294347 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 409/815] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Oct 27 13:13:15 2022] GET /identity/v3/users/5c1ab5e5d1dc4895a5c078ce7f77c274 => generated 285 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:13:15.300702 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0356f-5b0c-4e57-9037-40c38393a7a2 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:15.402949 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0356f-5b0c-4e57-9037-40c38393a7a2 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:15.439761 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f09b61-46bd-44a1-8801-36e6981e5edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:15.440521 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f09b61-46bd-44a1-8801-36e6981e5edb None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:15.440729 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f09b61-46bd-44a1-8801-36e6981e5edb None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:15.440975 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f09b61-46bd-44a1-8801-36e6981e5edb None admin] PATH_INFO: `/v3/projects/7fa4caf847384d8e9cee34887d9e2e4e` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:15.442225 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f09b61-46bd-44a1-8801-36e6981e5edb None admin] RBAC: Authorizing `identity:get_project(project_id=7fa4caf847384d8e9cee34887d9e2e4e)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:15.443689 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f09b61-46bd-44a1-8801-36e6981e5edb None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:15.445366 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 407/816] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Oct 27 13:13:15 2022] GET /identity/v3/projects/7fa4caf847384d8e9cee34887d9e2e4e => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:15.451566 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7966a-a871-4449-81f5-02ae54b10cfc None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:15.504062 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:15.557171 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7966a-a871-4449-81f5-02ae54b10cfc None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:15.593377 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3becc35b-3505-46de-9cf0-5aaf089983ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:15.594061 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3becc35b-3505-46de-9cf0-5aaf089983ea None admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:15.594331 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3becc35b-3505-46de-9cf0-5aaf089983ea None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:15.594598 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3becc35b-3505-46de-9cf0-5aaf089983ea None admin] PATH_INFO: `/v3/projects/7fa4caf847384d8e9cee34887d9e2e4e/users/5c1ab5e5d1dc4895a5c078ce7f77c274/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:15.596638 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3becc35b-3505-46de-9cf0-5aaf089983ea None admin] RBAC: Authorizing `identity:create_grant(project_id=7fa4caf847384d8e9cee34887d9e2e4e, user_id=5c1ab5e5d1dc4895a5c078ce7f77c274, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:15.598101 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3becc35b-3505-46de-9cf0-5aaf089983ea None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:15.613139 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 410/817] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Oct 27 13:13:15 2022] PUT /identity/v3/projects/7fa4caf847384d8e9cee34887d9e2e4e/users/5c1ab5e5d1dc4895a5c078ce7f77c274/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:13:17.233141 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5527c-e529-4210-82dc-a8fec608b268 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:17.233733 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5527c-e529-4210-82dc-a8fec608b268 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:17.233733 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5527c-e529-4210-82dc-a8fec608b268 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:17.235085 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 408/818] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:13:17.240642 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfda889-1d2a-42ee-a91c-f4a4e218c6f5 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:17.241052 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfda889-1d2a-42ee-a91c-f4a4e218c6f5 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:17.241174 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfda889-1d2a-42ee-a91c-f4a4e218c6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:17.260140 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-acfda889-1d2a-42ee-a91c-f4a4e218c6f5 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:13:17.261317 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-acfda889-1d2a-42ee-a91c-f4a4e218c6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:13:17.335876 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 411/819] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:13:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 13:13:17.598279 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5527c-e529-4210-82dc-a8fec608b268 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:17.673488 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:17.708740 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5527c-e529-4210-82dc-a8fec608b268 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:17.740442 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd925f8-e566-4b88-b390-95f72ff65151 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:17.740721 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd925f8-e566-4b88-b390-95f72ff65151 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:17.740992 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd925f8-e566-4b88-b390-95f72ff65151 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:17.741914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1702a45-d328-4e29-b221-f0bb6de8f9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:17.742444 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 412/820] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 13:13:17.742560 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1702a45-d328-4e29-b221-f0bb6de8f9a6 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:17.742797 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1702a45-d328-4e29-b221-f0bb6de8f9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:17.743060 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1702a45-d328-4e29-b221-f0bb6de8f9a6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:17.749758 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba37331-5be3-412a-b90d-5d350d5097a9 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:17.751426 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba37331-5be3-412a-b90d-5d350d5097a9 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:17.751918 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba37331-5be3-412a-b90d-5d350d5097a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:17.761070 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1702a45-d328-4e29-b221-f0bb6de8f9a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:13:17.765981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-a1702a45-d328-4e29-b221-f0bb6de8f9a6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 13:13:17.765981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:13:17.765981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:13:17.765981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:13:17.765981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:13:17.765981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:13:17.765981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:13:17.765981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:13:17.765981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:13:17.765981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:13:17.765981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:13:17.765981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:13:17.765981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:13:17.765981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:13:17.765981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:13:17.765981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:13:17.767033 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:13:17.767033 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:13:17.767033 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:13:17.767033 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:13:17.767033 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:13:17.767033 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:13:17.767033 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:13:17.767033 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:13:17.767033 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:13:17.767033 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:13:17.767033 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:13:17.767033 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:13:17.767033 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:13:17.767033 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:13:17.767033 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:13:17.767033 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:13:17.768018 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:13:17.768018 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:13:17.768018 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:13:17.768018 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:13:17.768018 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:13:17.768018 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:13:17.768018 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:13:17.768018 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:13:17.768018 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:13:17.768018 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:13:17.768018 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 13:13:17.768018 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:13:17.768018 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 409/821] 10.222.0.52 () {56 vars in 1120 bytes} [Thu Oct 27 13:13:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:13:17.771949 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-9ba37331-5be3-412a-b90d-5d350d5097a9 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:13:17.773152 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-9ba37331-5be3-412a-b90d-5d350d5097a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:13:17.773419 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1702a45-d328-4e29-b221-f0bb6de8f9a6 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:17.808749 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:17.846658 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 413/822] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:13:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 13:13:17.879205 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1702a45-d328-4e29-b221-f0bb6de8f9a6 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:17.905153 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:17.914776 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f6298-dbaa-4a61-a611-7da119b399cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:17.915379 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f6298-dbaa-4a61-a611-7da119b399cd None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:17.915642 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f6298-dbaa-4a61-a611-7da119b399cd None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:17.915910 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f6298-dbaa-4a61-a611-7da119b399cd None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:17.916572 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f6298-dbaa-4a61-a611-7da119b399cd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:13:17.916871 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f6298-dbaa-4a61-a611-7da119b399cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:17.918293 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f6298-dbaa-4a61-a611-7da119b399cd None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:17.926404 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 410/823] 10.222.0.52 () {56 vars in 1115 bytes} [Thu Oct 27 13:13:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:17.932430 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba37331-5be3-412a-b90d-5d350d5097a9 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:18.034908 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba37331-5be3-412a-b90d-5d350d5097a9 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:18.070363 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70fc36-cb63-4a07-8852-8d00ca7805bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:18.070984 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70fc36-cb63-4a07-8852-8d00ca7805bf None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:18.071259 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70fc36-cb63-4a07-8852-8d00ca7805bf None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:18.071529 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70fc36-cb63-4a07-8852-8d00ca7805bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:18.081963 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be70fc36-cb63-4a07-8852-8d00ca7805bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:18.083433 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be70fc36-cb63-4a07-8852-8d00ca7805bf None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:18.098174 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-be70fc36-cb63-4a07-8852-8d00ca7805bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:13:18.098174 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:13:18.098174 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:13:18.098174 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:13:18.098174 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:13:18.098174 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:13:18.098174 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:13:18.098174 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:13:18.098174 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:13:18.098174 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:13:18.098174 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:13:18.098174 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:13:18.098174 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:13:18.098174 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:13:18.098174 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:13:18.098174 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:13:18.099167 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:13:18.099167 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:13:18.099167 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:13:18.099167 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:13:18.099167 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:13:18.099167 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:13:18.099167 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:13:18.099167 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:13:18.099167 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:13:18.099167 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:13:18.099167 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:13:18.099167 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:13:18.099167 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:13:18.099167 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:13:18.099167 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:13:18.099167 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:13:18.099167 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:13:18.100060 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:13:18.100060 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:13:18.100060 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:13:18.100060 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 414/824] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:13:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:13:18.105218 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f6298-dbaa-4a61-a611-7da119b399cd None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:18.107733 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70fc36-cb63-4a07-8852-8d00ca7805bf None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:18.131584 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:18.217040 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70fc36-cb63-4a07-8852-8d00ca7805bf None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:18.256244 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107430c0-69dd-40b2-97c0-a3c847c5237e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:18.256961 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107430c0-69dd-40b2-97c0-a3c847c5237e None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:18.257161 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107430c0-69dd-40b2-97c0-a3c847c5237e None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:18.257424 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107430c0-69dd-40b2-97c0-a3c847c5237e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:18.268259 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107430c0-69dd-40b2-97c0-a3c847c5237e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:13:18.273260 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-107430c0-69dd-40b2-97c0-a3c847c5237e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:13:18.273260 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:13:18.273260 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:13:18.273260 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:13:18.273260 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:13:18.273260 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:13:18.273260 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:13:18.273260 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:13:18.273260 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:13:18.273260 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:13:18.273260 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:13:18.273260 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:13:18.273260 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:13:18.273260 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:13:18.273260 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:13:18.273260 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:13:18.274425 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:13:18.274425 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:13:18.274425 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:13:18.274425 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:13:18.274425 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:13:18.274425 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:13:18.274425 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:13:18.274425 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:13:18.274425 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:13:18.274425 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:13:18.274425 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:13:18.274425 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:13:18.274425 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:13:18.274425 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:13:18.274425 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:13:18.274425 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:13:18.275462 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:13:18.275462 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:13:18.275462 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:13:18.275462 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:13:18.275462 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:13:18.275462 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:13:18.275462 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:13:18.275462 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:13:18.275462 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:13:18.275462 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:13:18.275462 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:13:18.275462 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:13:18.275462 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 415/825] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Oct 27 13:13:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:13:18.280412 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107430c0-69dd-40b2-97c0-a3c847c5237e None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:18.326619 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f6298-dbaa-4a61-a611-7da119b399cd None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:18.359784 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f3979-b36f-4ebc-9b20-bb0fb965785c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:18.360379 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:18.360518 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f3979-b36f-4ebc-9b20-bb0fb965785c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:18.360618 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f3979-b36f-4ebc-9b20-bb0fb965785c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:18.360907 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f3979-b36f-4ebc-9b20-bb0fb965785c None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:18.361517 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f3979-b36f-4ebc-9b20-bb0fb965785c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:13:18.361898 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f3979-b36f-4ebc-9b20-bb0fb965785c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:18.363364 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f3979-b36f-4ebc-9b20-bb0fb965785c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:18.375049 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 411/826] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:13:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:18.381062 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f3979-b36f-4ebc-9b20-bb0fb965785c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:18.381340 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107430c0-69dd-40b2-97c0-a3c847c5237e None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:18.415878 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a112a-f20c-464c-a82e-e1458aaeb61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:18.416424 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a112a-f20c-464c-a82e-e1458aaeb61a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:18.416700 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a112a-f20c-464c-a82e-e1458aaeb61a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:18.416955 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a112a-f20c-464c-a82e-e1458aaeb61a None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:18.417717 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a112a-f20c-464c-a82e-e1458aaeb61a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:13:18.418016 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a112a-f20c-464c-a82e-e1458aaeb61a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:18.419397 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a112a-f20c-464c-a82e-e1458aaeb61a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:18.427826 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 416/827] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Oct 27 13:13:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:13:18.432485 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:18.433970 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a112a-f20c-464c-a82e-e1458aaeb61a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:18.482275 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f3979-b36f-4ebc-9b20-bb0fb965785c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:18.514741 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b27751-6036-4bc2-b643-706c05f32f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:18.515355 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b27751-6036-4bc2-b643-706c05f32f4b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:18.515626 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b27751-6036-4bc2-b643-706c05f32f4b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:18.515888 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b27751-6036-4bc2-b643-706c05f32f4b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:18.523149 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b27751-6036-4bc2-b643-706c05f32f4b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:18.524577 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b27751-6036-4bc2-b643-706c05f32f4b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:18.529973 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a112a-f20c-464c-a82e-e1458aaeb61a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:18.535635 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-79b27751-6036-4bc2-b643-706c05f32f4b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 13:13:18.535635 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:13:18.535635 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:13:18.535635 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:13:18.535635 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:13:18.535635 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:13:18.535635 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:13:18.535635 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:13:18.535635 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:13:18.535635 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:13:18.535635 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:13:18.535635 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:13:18.535635 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 13:13:18.535635 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 13:13:18.535635 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 13:13:18.535635 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 13:13:18.536676 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:13:18.536676 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:13:18.536676 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 13:13:18.536676 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:13:18.536676 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 13:13:18.536676 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:13:18.536676 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:13:18.536676 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:13:18.536676 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:13:18.536676 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:13:18.536676 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:13:18.536676 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:13:18.536676 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:13:18.536676 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:13:18.536676 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:13:18.536676 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:13:18.536676 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:13:18.536676 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:13:18.537994 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:13:18.537994 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:13:18.537994 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 13:13:18.537994 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 13:13:18.537994 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 13:13:18.537994 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 13:13:18.537994 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 13:13:18.537994 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 13:13:18.537994 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 27 13:13:18.537994 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:13:18.537994 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 412/828] 10.222.0.52 () {56 vars in 1093 bytes} [Thu Oct 27 13:13:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:13:18.542491 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b27751-6036-4bc2-b643-706c05f32f4b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:18.566237 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e8d70-4173-4d59-908a-577d9b10862d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:18.566858 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e8d70-4173-4d59-908a-577d9b10862d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:18.567129 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e8d70-4173-4d59-908a-577d9b10862d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:18.567368 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e8d70-4173-4d59-908a-577d9b10862d None admin] PATH_INFO: `/v3/users/5c1ab5e5d1dc4895a5c078ce7f77c274` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:18.568478 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e8d70-4173-4d59-908a-577d9b10862d None admin] RBAC: Authorizing `identity:get_user(user_id=5c1ab5e5d1dc4895a5c078ce7f77c274)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:18.570035 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e8d70-4173-4d59-908a-577d9b10862d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:18.571750 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 417/829] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Oct 27 13:13:18 2022] GET /identity/v3/users/5c1ab5e5d1dc4895a5c078ce7f77c274 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:18.578411 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e8d70-4173-4d59-908a-577d9b10862d None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:18.590612 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:18.640667 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b27751-6036-4bc2-b643-706c05f32f4b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:18.651594 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:18.676942 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bfe460-23a4-4cdd-91c1-a55452ca24af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:18.677553 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfe460-23a4-4cdd-91c1-a55452ca24af None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:18.677857 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfe460-23a4-4cdd-91c1-a55452ca24af None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:18.678117 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfe460-23a4-4cdd-91c1-a55452ca24af None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:18.678826 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bfe460-23a4-4cdd-91c1-a55452ca24af None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:13:18.678997 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e8d70-4173-4d59-908a-577d9b10862d None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:18.679138 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bfe460-23a4-4cdd-91c1-a55452ca24af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:18.680526 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bfe460-23a4-4cdd-91c1-a55452ca24af None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:18.697932 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 413/830] 10.222.0.52 () {56 vars in 1133 bytes} [Thu Oct 27 13:13:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:13:18.703618 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bfe460-23a4-4cdd-91c1-a55452ca24af None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:18.717122 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619ca4f-7ce9-4d72-b890-eb02b9227e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:18.717762 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619ca4f-7ce9-4d72-b890-eb02b9227e61 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:18.718041 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619ca4f-7ce9-4d72-b890-eb02b9227e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:18.718309 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619ca4f-7ce9-4d72-b890-eb02b9227e61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:18.789114 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6619ca4f-7ce9-4d72-b890-eb02b9227e61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:18.790610 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6619ca4f-7ce9-4d72-b890-eb02b9227e61 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:18.801902 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:18.804894 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bfe460-23a4-4cdd-91c1-a55452ca24af None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:18.840061 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ea50d-cd99-4cb5-a4a0-aee7b5abc02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:18.840664 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ea50d-cd99-4cb5-a4a0-aee7b5abc02c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:18.840940 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ea50d-cd99-4cb5-a4a0-aee7b5abc02c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:18.841236 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ea50d-cd99-4cb5-a4a0-aee7b5abc02c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:18.876782 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:18.893253 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 418/831] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Oct 27 13:13:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 27 13:13:18.894313 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619ca4f-7ce9-4d72-b890-eb02b9227e61 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:18.910265 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3ea50d-cd99-4cb5-a4a0-aee7b5abc02c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:18.911713 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3ea50d-cd99-4cb5-a4a0-aee7b5abc02c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:18.990246 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619ca4f-7ce9-4d72-b890-eb02b9227e61 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:19.000658 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:19.007158 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 414/832] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Oct 27 13:13:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 27 13:13:19.012928 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ea50d-cd99-4cb5-a4a0-aee7b5abc02c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:19.029125 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996142a-f85f-44e7-8148-c37195986357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:19.029791 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996142a-f85f-44e7-8148-c37195986357 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:19.030071 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996142a-f85f-44e7-8148-c37195986357 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:19.030342 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996142a-f85f-44e7-8148-c37195986357 None admin] PATH_INFO: `/v3/projects/7fa4caf847384d8e9cee34887d9e2e4e` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:19.031448 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996142a-f85f-44e7-8148-c37195986357 None admin] RBAC: Authorizing `identity:get_project(project_id=7fa4caf847384d8e9cee34887d9e2e4e)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:19.032894 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996142a-f85f-44e7-8148-c37195986357 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:19.039938 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 419/833] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Oct 27 13:13:18 2022] GET /identity/v3/projects/7fa4caf847384d8e9cee34887d9e2e4e => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:19.041086 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996142a-f85f-44e7-8148-c37195986357 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:19.075660 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:19.108570 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ea50d-cd99-4cb5-a4a0-aee7b5abc02c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:19.137430 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996142a-f85f-44e7-8148-c37195986357 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:19.140987 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a7c8e-9aaf-4bdd-b913-53381535547b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:19.141638 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a7c8e-9aaf-4bdd-b913-53381535547b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:19.141913 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a7c8e-9aaf-4bdd-b913-53381535547b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:19.142177 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a7c8e-9aaf-4bdd-b913-53381535547b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:19.152050 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3a7c8e-9aaf-4bdd-b913-53381535547b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:19.153589 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3a7c8e-9aaf-4bdd-b913-53381535547b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:19.168328 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-0a3a7c8e-9aaf-4bdd-b913-53381535547b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:13:19.168328 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:13:19.168328 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:13:19.168328 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:13:19.168328 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:13:19.168328 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:13:19.168328 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:13:19.168328 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:13:19.168328 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:13:19.168328 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:13:19.168328 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:13:19.168328 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:13:19.168328 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:13:19.168328 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:13:19.168328 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:13:19.168328 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:13:19.169252 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:13:19.169252 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:13:19.169252 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:13:19.169252 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:13:19.169252 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:13:19.169252 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:13:19.169252 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:13:19.169252 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:13:19.169252 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:13:19.169252 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:13:19.169252 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:13:19.169252 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:13:19.169252 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:13:19.169252 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:13:19.169252 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:13:19.169252 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:13:19.169252 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:13:19.170179 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:13:19.170179 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:13:19.170179 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:13:19.170179 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 415/834] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:13:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:13:19.172763 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7becb4dc-8194-4290-958f-fcfe38f6d874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:19.173364 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7becb4dc-8194-4290-958f-fcfe38f6d874 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:19.173655 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7becb4dc-8194-4290-958f-fcfe38f6d874 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:19.173921 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7becb4dc-8194-4290-958f-fcfe38f6d874 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:19.174957 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7becb4dc-8194-4290-958f-fcfe38f6d874 None admin] RBAC: Adding query filter params (role.id=93bba834c17a4aa7afdc65c002a12975, scope.project.id=7fa4caf847384d8e9cee34887d9e2e4e, user.id=5c1ab5e5d1dc4895a5c078ce7f77c274) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:13:19.175151 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a7c8e-9aaf-4bdd-b913-53381535547b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:19.175251 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7becb4dc-8194-4290-958f-fcfe38f6d874 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:19.176671 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7becb4dc-8194-4290-958f-fcfe38f6d874 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:19.189605 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 420/835] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Oct 27 13:13:19 2022] GET /identity/v3/role_assignments?user.id=5c1ab5e5d1dc4895a5c078ce7f77c274&scope.project.id=7fa4caf847384d8e9cee34887d9e2e4e&role.id=93bba834c17a4aa7afdc65c002a12975 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:13:19.282093 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a7c8e-9aaf-4bdd-b913-53381535547b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:19.303317 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:19.321362 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698bcb1-abec-4097-9eaa-241093dfab4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:19.322016 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698bcb1-abec-4097-9eaa-241093dfab4a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:19.322294 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698bcb1-abec-4097-9eaa-241093dfab4a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:19.322564 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698bcb1-abec-4097-9eaa-241093dfab4a None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:19.323214 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8698bcb1-abec-4097-9eaa-241093dfab4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:13:19.323514 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8698bcb1-abec-4097-9eaa-241093dfab4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:19.324902 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8698bcb1-abec-4097-9eaa-241093dfab4a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:19.337964 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 416/836] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:13:19.343864 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7becb4dc-8194-4290-958f-fcfe38f6d874 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:19.388718 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:19.445063 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7becb4dc-8194-4290-958f-fcfe38f6d874 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:19.479626 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf9ad9-fd35-4f9f-8c8b-5cef1b1d05b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:19.480256 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf9ad9-fd35-4f9f-8c8b-5cef1b1d05b6 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:19.480525 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf9ad9-fd35-4f9f-8c8b-5cef1b1d05b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:19.480791 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf9ad9-fd35-4f9f-8c8b-5cef1b1d05b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:19.487993 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acf9ad9-fd35-4f9f-8c8b-5cef1b1d05b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:19.489458 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acf9ad9-fd35-4f9f-8c8b-5cef1b1d05b6 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:19.500894 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-8acf9ad9-fd35-4f9f-8c8b-5cef1b1d05b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:13:19.500894 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:13:19.500894 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:13:19.500894 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:13:19.500894 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:13:19.500894 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:13:19.500894 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:13:19.500894 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:13:19.500894 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:13:19.500894 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:13:19.500894 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:13:19.500894 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:13:19.500894 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 13:13:19.500894 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 13:13:19.500894 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 13:13:19.502014 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 13:13:19.502014 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:13:19.502014 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:13:19.502014 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:13:19.502014 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:13:19.502014 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:13:19.502014 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:13:19.502014 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:13:19.502014 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:13:19.502014 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:13:19.502014 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:13:19.502014 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:13:19.502014 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:13:19.502014 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:13:19.502014 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:13:19.502014 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:13:19.502014 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:13:19.502980 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 13:13:19.502980 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 13:13:19.502980 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 13:13:19.502980 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 13:13:19.502980 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 13:13:19.502980 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 13:13:19.502980 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:13:19.502980 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:13:19.502980 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 421/837] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Oct 27 13:13:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:13:19.508384 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698bcb1-abec-4097-9eaa-241093dfab4a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:19.607450 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698bcb1-abec-4097-9eaa-241093dfab4a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:19.641725 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673305f-f0b8-43d7-bab2-6f08c1e4dcfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:19.642318 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673305f-f0b8-43d7-bab2-6f08c1e4dcfa None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:19.642594 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673305f-f0b8-43d7-bab2-6f08c1e4dcfa None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:19.642861 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673305f-f0b8-43d7-bab2-6f08c1e4dcfa None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:19.643596 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673305f-f0b8-43d7-bab2-6f08c1e4dcfa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:13:19.643894 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673305f-f0b8-43d7-bab2-6f08c1e4dcfa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:19.645314 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673305f-f0b8-43d7-bab2-6f08c1e4dcfa None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:19.656846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 417/838] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Oct 27 13:13:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:19.663171 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf9ad9-fd35-4f9f-8c8b-5cef1b1d05b6 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:19.767331 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf9ad9-fd35-4f9f-8c8b-5cef1b1d05b6 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:19.769065 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:19.804276 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc3c81-cff7-4a92-991d-583f7230242c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:19.804882 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc3c81-cff7-4a92-991d-583f7230242c None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:19.805153 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc3c81-cff7-4a92-991d-583f7230242c None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:19.805420 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc3c81-cff7-4a92-991d-583f7230242c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:19.806236 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc3c81-cff7-4a92-991d-583f7230242c None admin] RBAC: Adding query filter params (role.id=9bda48922f54416c9673d1efc1d45673, scope.project.id=0be19dd5a0df4cf79fe2ec14d11521f0, user.id=719e4bf834d6490b96066e55a26fb159) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:13:19.806541 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc3c81-cff7-4a92-991d-583f7230242c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:19.808284 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc3c81-cff7-4a92-991d-583f7230242c None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:19.814331 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 422/839] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Oct 27 13:13:19 2022] GET /identity/v3/role_assignments?user.id=719e4bf834d6490b96066e55a26fb159&scope.project.id=0be19dd5a0df4cf79fe2ec14d11521f0&role.id=9bda48922f54416c9673d1efc1d45673 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:21.343202 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a4826-df93-4f85-92f6-a198177fe8c6 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:21.344042 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a4826-df93-4f85-92f6-a198177fe8c6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:21.344042 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a4826-df93-4f85-92f6-a198177fe8c6 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:21.346452 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 418/840] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:13:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:13:21.352664 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6090c71-562a-4934-9011-3b7e012b5ae5 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:21.353377 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6090c71-562a-4934-9011-3b7e012b5ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:21.353510 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6090c71-562a-4934-9011-3b7e012b5ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:21.376715 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-c6090c71-562a-4934-9011-3b7e012b5ae5 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:13:21.377958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c6090c71-562a-4934-9011-3b7e012b5ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:13:21.450534 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 423/841] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:13:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 13:13:21.719650 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a4826-df93-4f85-92f6-a198177fe8c6 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:21.769085 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:21.835730 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a4826-df93-4f85-92f6-a198177fe8c6 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:21.870018 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc855d-7623-452b-8b5d-5943f2187d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:21.870605 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc855d-7623-452b-8b5d-5943f2187d1e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:21.870902 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc855d-7623-452b-8b5d-5943f2187d1e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:21.871164 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc855d-7623-452b-8b5d-5943f2187d1e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:21.872298 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc855d-7623-452b-8b5d-5943f2187d1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:21.873743 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc855d-7623-452b-8b5d-5943f2187d1e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:21.875285 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 419/842] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:13:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:21.882081 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6090c71-562a-4934-9011-3b7e012b5ae5 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:21.993826 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:22.000703 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6090c71-562a-4934-9011-3b7e012b5ae5 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:22.038137 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7169af-6bc7-46fc-8dd3-d721a6ca5fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:22.038732 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7169af-6bc7-46fc-8dd3-d721a6ca5fde None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:22.039002 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7169af-6bc7-46fc-8dd3-d721a6ca5fde None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:22.039267 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7169af-6bc7-46fc-8dd3-d721a6ca5fde None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:22.039914 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7169af-6bc7-46fc-8dd3-d721a6ca5fde None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:22.041335 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7169af-6bc7-46fc-8dd3-d721a6ca5fde None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:22.071930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 424/843] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Oct 27 13:13:21 2022] POST /identity/v3/users => generated 286 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:13:24.206467 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4cbc9-4f8b-4378-8f5e-ef397b640b24 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:24.207293 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4cbc9-4f8b-4378-8f5e-ef397b640b24 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:24.207293 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4cbc9-4f8b-4378-8f5e-ef397b640b24 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:24.209520 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 420/844] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:13:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:13:24.218379 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e92bb-fbe7-416d-9b8a-6fb1a77bf9d9 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:24.219065 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e92bb-fbe7-416d-9b8a-6fb1a77bf9d9 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:24.219210 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e92bb-fbe7-416d-9b8a-6fb1a77bf9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:24.245316 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-283e92bb-fbe7-416d-9b8a-6fb1a77bf9d9 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:13:24.246536 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-283e92bb-fbe7-416d-9b8a-6fb1a77bf9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:13:24.324841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 425/845] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:13:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 13:13:24.594066 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4cbc9-4f8b-4378-8f5e-ef397b640b24 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:24.706142 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4cbc9-4f8b-4378-8f5e-ef397b640b24 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:24.715520 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:24.741155 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b2469-97ee-4518-96e8-fb15d7cc74d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:24.741793 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b2469-97ee-4518-96e8-fb15d7cc74d4 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:24.742064 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b2469-97ee-4518-96e8-fb15d7cc74d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:24.742328 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b2469-97ee-4518-96e8-fb15d7cc74d4 None admin] PATH_INFO: `/v3/roles/5db0b376b1b047f6bdc42dc784aa1ba9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:24.743687 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b2469-97ee-4518-96e8-fb15d7cc74d4 None admin] RBAC: Authorizing `identity:get_role(role_id=5db0b376b1b047f6bdc42dc784aa1ba9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:24.745054 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b2469-97ee-4518-96e8-fb15d7cc74d4 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:24.746426 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 421/846] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Oct 27 13:13:24 2022] GET /identity/v3/roles/5db0b376b1b047f6bdc42dc784aa1ba9 => generated 223 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:24.752778 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e92bb-fbe7-416d-9b8a-6fb1a77bf9d9 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:24.837577 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:24.858793 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e92bb-fbe7-416d-9b8a-6fb1a77bf9d9 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:24.894559 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80897379-833e-4cd0-a6fe-f9eab1d83d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:24.895192 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80897379-833e-4cd0-a6fe-f9eab1d83d89 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:24.895468 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80897379-833e-4cd0-a6fe-f9eab1d83d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:24.895742 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80897379-833e-4cd0-a6fe-f9eab1d83d89 None admin] PATH_INFO: `/v3/users/aafad45b5855443684daa64855d3fdce` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:24.909634 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80897379-833e-4cd0-a6fe-f9eab1d83d89 None admin] RBAC: Authorizing `identity:get_user(user_id=aafad45b5855443684daa64855d3fdce)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:24.911106 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80897379-833e-4cd0-a6fe-f9eab1d83d89 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:24.912738 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 426/847] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Oct 27 13:13:24 2022] GET /identity/v3/users/aafad45b5855443684daa64855d3fdce => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:24.919695 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b2469-97ee-4518-96e8-fb15d7cc74d4 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:25.026649 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b2469-97ee-4518-96e8-fb15d7cc74d4 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:25.061298 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9dba29-fc0d-413a-be5f-308b433a2414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:25.061940 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9dba29-fc0d-413a-be5f-308b433a2414 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:25.062215 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9dba29-fc0d-413a-be5f-308b433a2414 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:25.062481 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9dba29-fc0d-413a-be5f-308b433a2414 None admin] PATH_INFO: `/v3/projects/7fa4caf847384d8e9cee34887d9e2e4e` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:25.063713 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9dba29-fc0d-413a-be5f-308b433a2414 None admin] RBAC: Authorizing `identity:get_project(project_id=7fa4caf847384d8e9cee34887d9e2e4e)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:25.065167 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9dba29-fc0d-413a-be5f-308b433a2414 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:25.066887 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 422/848] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Oct 27 13:13:24 2022] GET /identity/v3/projects/7fa4caf847384d8e9cee34887d9e2e4e => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:25.076331 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80897379-833e-4cd0-a6fe-f9eab1d83d89 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:25.181743 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80897379-833e-4cd0-a6fe-f9eab1d83d89 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:25.217049 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7701ee1-4954-4160-9e81-2d707e53d79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:25.217738 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7701ee1-4954-4160-9e81-2d707e53d79d None admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:25.218012 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7701ee1-4954-4160-9e81-2d707e53d79d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:25.218274 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7701ee1-4954-4160-9e81-2d707e53d79d None admin] PATH_INFO: `/v3/projects/7fa4caf847384d8e9cee34887d9e2e4e/users/aafad45b5855443684daa64855d3fdce/roles/5db0b376b1b047f6bdc42dc784aa1ba9` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:25.220745 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7701ee1-4954-4160-9e81-2d707e53d79d None admin] RBAC: Authorizing `identity:create_grant(project_id=7fa4caf847384d8e9cee34887d9e2e4e, user_id=aafad45b5855443684daa64855d3fdce, role_id=5db0b376b1b047f6bdc42dc784aa1ba9)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:25.222401 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7701ee1-4954-4160-9e81-2d707e53d79d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:25.235709 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:25.240810 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 427/849] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Oct 27 13:13:25 2022] PUT /identity/v3/projects/7fa4caf847384d8e9cee34887d9e2e4e/users/aafad45b5855443684daa64855d3fdce/roles/5db0b376b1b047f6bdc42dc784aa1ba9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:13:27.332713 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433b68b-0520-45df-8bb3-744ee0ee13ee None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:27.333302 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433b68b-0520-45df-8bb3-744ee0ee13ee None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:27.333302 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433b68b-0520-45df-8bb3-744ee0ee13ee None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:27.334612 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 423/850] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:13:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:13:27.340955 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723f61a-9e5f-49c6-ada6-d20781d82d6e None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:27.341658 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723f61a-9e5f-49c6-ada6-d20781d82d6e None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:27.341891 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723f61a-9e5f-49c6-ada6-d20781d82d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:27.369556 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-d723f61a-9e5f-49c6-ada6-d20781d82d6e None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:13:27.370751 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d723f61a-9e5f-49c6-ada6-d20781d82d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:13:27.574805 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 428/851] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:13:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 13:13:27.851877 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433b68b-0520-45df-8bb3-744ee0ee13ee None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:27.906105 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:27.974929 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433b68b-0520-45df-8bb3-744ee0ee13ee None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:28.010863 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed99ec8-ab8a-4f1f-bc6b-a30d79b55d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:28.011487 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed99ec8-ab8a-4f1f-bc6b-a30d79b55d2f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:28.011762 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed99ec8-ab8a-4f1f-bc6b-a30d79b55d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:28.012030 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed99ec8-ab8a-4f1f-bc6b-a30d79b55d2f None admin] PATH_INFO: `/v3/roles/5db0b376b1b047f6bdc42dc784aa1ba9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:28.013411 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed99ec8-ab8a-4f1f-bc6b-a30d79b55d2f None admin] RBAC: Authorizing `identity:get_role(role_id=5db0b376b1b047f6bdc42dc784aa1ba9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:28.014810 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed99ec8-ab8a-4f1f-bc6b-a30d79b55d2f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:28.016182 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 424/852] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Oct 27 13:13:27 2022] GET /identity/v3/roles/5db0b376b1b047f6bdc42dc784aa1ba9 => generated 223 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:28.022987 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723f61a-9e5f-49c6-ada6-d20781d82d6e None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:28.127354 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723f61a-9e5f-49c6-ada6-d20781d82d6e None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:28.160469 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:28.170286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d7dfa-f00b-4bbc-8cd3-90321980badd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:28.171315 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d7dfa-f00b-4bbc-8cd3-90321980badd None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:28.171739 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d7dfa-f00b-4bbc-8cd3-90321980badd None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:28.172144 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d7dfa-f00b-4bbc-8cd3-90321980badd None admin] PATH_INFO: `/v3/users/aafad45b5855443684daa64855d3fdce` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:28.174215 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d7dfa-f00b-4bbc-8cd3-90321980badd None admin] RBAC: Authorizing `identity:get_user(user_id=aafad45b5855443684daa64855d3fdce)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:28.176514 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d7dfa-f00b-4bbc-8cd3-90321980badd None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:28.179184 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 429/853] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Oct 27 13:13:28 2022] GET /identity/v3/users/aafad45b5855443684daa64855d3fdce => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:28.185757 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed99ec8-ab8a-4f1f-bc6b-a30d79b55d2f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:28.289927 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed99ec8-ab8a-4f1f-bc6b-a30d79b55d2f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:28.304286 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:28.327537 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f07222-dc2b-4cb7-8357-ed8165687016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:28.328134 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f07222-dc2b-4cb7-8357-ed8165687016 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:28.328409 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f07222-dc2b-4cb7-8357-ed8165687016 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:28.328675 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f07222-dc2b-4cb7-8357-ed8165687016 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:28.400223 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f07222-dc2b-4cb7-8357-ed8165687016 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:28.401599 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f07222-dc2b-4cb7-8357-ed8165687016 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:28.497848 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 425/854] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Oct 27 13:13:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 27 13:13:28.507286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d7dfa-f00b-4bbc-8cd3-90321980badd None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:28.623039 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d7dfa-f00b-4bbc-8cd3-90321980badd None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:28.660418 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d62332-d0f9-478a-8564-43e0354e4a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:28.660988 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d62332-d0f9-478a-8564-43e0354e4a96 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:28.661261 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d62332-d0f9-478a-8564-43e0354e4a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:28.661559 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d62332-d0f9-478a-8564-43e0354e4a96 None admin] PATH_INFO: `/v3/projects/7fa4caf847384d8e9cee34887d9e2e4e` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:28.662790 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d62332-d0f9-478a-8564-43e0354e4a96 None admin] RBAC: Authorizing `identity:get_project(project_id=7fa4caf847384d8e9cee34887d9e2e4e)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:28.664245 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d62332-d0f9-478a-8564-43e0354e4a96 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:28.665923 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 430/855] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Oct 27 13:13:28 2022] GET /identity/v3/projects/7fa4caf847384d8e9cee34887d9e2e4e => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:28.672491 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f07222-dc2b-4cb7-8357-ed8165687016 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:28.688562 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:28.782389 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f07222-dc2b-4cb7-8357-ed8165687016 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:28.818943 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a2bb59-49d0-4a36-80aa-d3a7d99720b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:28.819540 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a2bb59-49d0-4a36-80aa-d3a7d99720b9 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:28.819806 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a2bb59-49d0-4a36-80aa-d3a7d99720b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:28.820058 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a2bb59-49d0-4a36-80aa-d3a7d99720b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:28.820782 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a2bb59-49d0-4a36-80aa-d3a7d99720b9 None admin] RBAC: Adding query filter params (role.id=5db0b376b1b047f6bdc42dc784aa1ba9, scope.project.id=7fa4caf847384d8e9cee34887d9e2e4e, user.id=aafad45b5855443684daa64855d3fdce) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:13:28.821091 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a2bb59-49d0-4a36-80aa-d3a7d99720b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:28.822557 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a2bb59-49d0-4a36-80aa-d3a7d99720b9 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:28.828394 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 426/856] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Oct 27 13:13:28 2022] GET /identity/v3/role_assignments?user.id=aafad45b5855443684daa64855d3fdce&scope.project.id=7fa4caf847384d8e9cee34887d9e2e4e&role.id=5db0b376b1b047f6bdc42dc784aa1ba9 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:30.939527 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89a5f5-8b87-4b32-8efb-259a4e571d87 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:30.939527 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89a5f5-8b87-4b32-8efb-259a4e571d87 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:30.940498 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89a5f5-8b87-4b32-8efb-259a4e571d87 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:30.941447 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 431/857] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:13:30.947894 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25015d57-d105-4475-bed2-7887a599f96d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:30.948551 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25015d57-d105-4475-bed2-7887a599f96d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:30.948775 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25015d57-d105-4475-bed2-7887a599f96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:30.971717 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-25015d57-d105-4475-bed2-7887a599f96d None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:13:30.972942 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-25015d57-d105-4475-bed2-7887a599f96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:13:31.045799 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 427/858] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:13:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 13:13:31.309698 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89a5f5-8b87-4b32-8efb-259a4e571d87 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:31.385296 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:31.431082 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89a5f5-8b87-4b32-8efb-259a4e571d87 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:31.469617 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83bc3d-5d84-48a2-ba1f-bf3abec7fc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:31.470232 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83bc3d-5d84-48a2-ba1f-bf3abec7fc6d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:31.470508 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83bc3d-5d84-48a2-ba1f-bf3abec7fc6d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:31.470773 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83bc3d-5d84-48a2-ba1f-bf3abec7fc6d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:31.472260 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e83bc3d-5d84-48a2-ba1f-bf3abec7fc6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:31.473756 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e83bc3d-5d84-48a2-ba1f-bf3abec7fc6d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:31.475320 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 432/859] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:13:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:31.482239 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25015d57-d105-4475-bed2-7887a599f96d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:31.494467 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:31.589595 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25015d57-d105-4475-bed2-7887a599f96d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:31.624557 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd5ebd-3d67-43f2-9069-d743a5287d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:31.625145 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd5ebd-3d67-43f2-9069-d743a5287d24 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:31.625412 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd5ebd-3d67-43f2-9069-d743a5287d24 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:31.625697 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd5ebd-3d67-43f2-9069-d743a5287d24 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:31.626326 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd5ebd-3d67-43f2-9069-d743a5287d24 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:31.627780 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd5ebd-3d67-43f2-9069-d743a5287d24 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:31.660932 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 428/860] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Oct 27 13:13:31 2022] POST /identity/v3/projects => generated 311 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:13:33.816446 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862febb-de18-4f84-9ae1-3b3294a763be None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:33.817134 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862febb-de18-4f84-9ae1-3b3294a763be None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:33.817250 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862febb-de18-4f84-9ae1-3b3294a763be None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:33.819545 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 433/861] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:13:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:13:33.825758 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb63af-01d6-43d9-8e2d-07ca401ab997 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:33.826437 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb63af-01d6-43d9-8e2d-07ca401ab997 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:33.826528 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb63af-01d6-43d9-8e2d-07ca401ab997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:33.847359 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-3acb63af-01d6-43d9-8e2d-07ca401ab997 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:13:33.848547 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3acb63af-01d6-43d9-8e2d-07ca401ab997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:13:33.905023 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:33.923826 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 429/862] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:13:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 13:13:34.193667 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5862febb-de18-4f84-9ae1-3b3294a763be None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:34.307436 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5862febb-de18-4f84-9ae1-3b3294a763be None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:34.343861 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91282bc-eee1-4640-80c8-0918acd3800a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:34.344476 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91282bc-eee1-4640-80c8-0918acd3800a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:34.344747 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91282bc-eee1-4640-80c8-0918acd3800a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:34.345020 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91282bc-eee1-4640-80c8-0918acd3800a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:34.346331 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91282bc-eee1-4640-80c8-0918acd3800a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:34.347770 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91282bc-eee1-4640-80c8-0918acd3800a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:34.349335 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 434/863] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:13:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:34.355312 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb63af-01d6-43d9-8e2d-07ca401ab997 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:34.455146 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb63af-01d6-43d9-8e2d-07ca401ab997 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:34.502829 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b097d6-5379-4b63-99f3-c318ae6a9b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:34.503427 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b097d6-5379-4b63-99f3-c318ae6a9b0c None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:34.503700 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b097d6-5379-4b63-99f3-c318ae6a9b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:34.503969 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b097d6-5379-4b63-99f3-c318ae6a9b0c None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:34.504607 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b097d6-5379-4b63-99f3-c318ae6a9b0c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:34.506065 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b097d6-5379-4b63-99f3-c318ae6a9b0c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:34.533054 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 430/864] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Oct 27 13:13:34 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:13:36.667059 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2f0a8-3764-4547-bb0b-878e83d17e5f None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:36.667666 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2f0a8-3764-4547-bb0b-878e83d17e5f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:36.667666 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2f0a8-3764-4547-bb0b-878e83d17e5f None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:36.668952 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 435/865] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:13:36.675332 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c35e5-1e64-45d2-a9da-0116201ca636 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:36.676068 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c35e5-1e64-45d2-a9da-0116201ca636 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:36.676171 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c35e5-1e64-45d2-a9da-0116201ca636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:36.700727 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-fc0c35e5-1e64-45d2-a9da-0116201ca636 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:13:36.701939 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-fc0c35e5-1e64-45d2-a9da-0116201ca636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:13:36.744500 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:36.773658 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 431/866] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:13:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 13:13:37.037942 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2f0a8-3764-4547-bb0b-878e83d17e5f None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:37.042504 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:37.149781 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2f0a8-3764-4547-bb0b-878e83d17e5f None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:37.186639 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba074825-6a92-4027-8c87-e030112b31f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:37.187255 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba074825-6a92-4027-8c87-e030112b31f1 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:37.187527 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba074825-6a92-4027-8c87-e030112b31f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:37.187795 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba074825-6a92-4027-8c87-e030112b31f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:37.199031 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba074825-6a92-4027-8c87-e030112b31f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:13:37.203894 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-ba074825-6a92-4027-8c87-e030112b31f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:13:37.203894 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:13:37.203894 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:13:37.203894 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:13:37.203894 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:13:37.203894 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:13:37.203894 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:13:37.203894 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:13:37.203894 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:13:37.203894 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:13:37.203894 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:13:37.203894 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:13:37.203894 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:13:37.203894 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:13:37.203894 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:13:37.203894 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:13:37.204922 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:13:37.204922 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:13:37.204922 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:13:37.204922 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:13:37.204922 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:13:37.204922 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:13:37.204922 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:13:37.204922 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:13:37.204922 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:13:37.204922 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:13:37.204922 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:13:37.204922 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:13:37.204922 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:13:37.204922 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:13:37.204922 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:13:37.204922 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:13:37.206724 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:13:37.206724 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:13:37.206724 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:13:37.206724 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:13:37.206724 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:13:37.206724 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:13:37.206724 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:13:37.206724 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:13:37.206724 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:13:37.206724 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:13:37.206724 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:13:37.206724 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:13:37.206724 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 436/867] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Oct 27 13:13:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:13:37.211201 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c35e5-1e64-45d2-a9da-0116201ca636 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:37.312406 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c35e5-1e64-45d2-a9da-0116201ca636 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:37.349108 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d156692e-40a0-41c9-ae96-27f4aa3a408d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:37.349732 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156692e-40a0-41c9-ae96-27f4aa3a408d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:37.350011 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156692e-40a0-41c9-ae96-27f4aa3a408d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:37.350277 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156692e-40a0-41c9-ae96-27f4aa3a408d None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:37.350928 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d156692e-40a0-41c9-ae96-27f4aa3a408d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:13:37.351227 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d156692e-40a0-41c9-ae96-27f4aa3a408d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:37.352591 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d156692e-40a0-41c9-ae96-27f4aa3a408d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:37.360637 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 432/868] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Oct 27 13:13:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:37.367824 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba074825-6a92-4027-8c87-e030112b31f1 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:37.435545 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:37.481452 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba074825-6a92-4027-8c87-e030112b31f1 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:37.517873 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ff20c-b55e-46ac-b821-207ceb503c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:37.518516 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ff20c-b55e-46ac-b821-207ceb503c36 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:37.518810 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ff20c-b55e-46ac-b821-207ceb503c36 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:37.519073 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ff20c-b55e-46ac-b821-207ceb503c36 None admin] PATH_INFO: `/v3/users/73d52a5dfc524cb293a482429e6e5a97` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:37.534892 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ff20c-b55e-46ac-b821-207ceb503c36 None admin] RBAC: Authorizing `identity:get_user(user_id=73d52a5dfc524cb293a482429e6e5a97)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:37.537226 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ff20c-b55e-46ac-b821-207ceb503c36 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:37.539840 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 437/869] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Oct 27 13:13:37 2022] GET /identity/v3/users/73d52a5dfc524cb293a482429e6e5a97 => generated 286 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:37.549039 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d156692e-40a0-41c9-ae96-27f4aa3a408d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:37.592600 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:37.661904 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d156692e-40a0-41c9-ae96-27f4aa3a408d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:37.702048 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b842196-0e8b-46ed-a7b3-b437c92f961e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:37.702679 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b842196-0e8b-46ed-a7b3-b437c92f961e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:37.702961 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b842196-0e8b-46ed-a7b3-b437c92f961e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:37.703221 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b842196-0e8b-46ed-a7b3-b437c92f961e None admin] PATH_INFO: `/v3/projects/b2f12d8b3f514d84ba59f18a4e4a96f2` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:37.704447 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b842196-0e8b-46ed-a7b3-b437c92f961e None admin] RBAC: Authorizing `identity:get_project(project_id=b2f12d8b3f514d84ba59f18a4e4a96f2)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:37.706006 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b842196-0e8b-46ed-a7b3-b437c92f961e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:37.707811 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 433/870] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Oct 27 13:13:37 2022] GET /identity/v3/projects/b2f12d8b3f514d84ba59f18a4e4a96f2 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:13:37.716741 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ff20c-b55e-46ac-b821-207ceb503c36 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:37.835939 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ff20c-b55e-46ac-b821-207ceb503c36 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:37.856158 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:37.871819 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f273cf-ea4f-4e71-9272-79da4ce545a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:37.872476 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f273cf-ea4f-4e71-9272-79da4ce545a0 None admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:37.872755 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f273cf-ea4f-4e71-9272-79da4ce545a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:37.873027 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f273cf-ea4f-4e71-9272-79da4ce545a0 None admin] PATH_INFO: `/v3/projects/b2f12d8b3f514d84ba59f18a4e4a96f2/users/73d52a5dfc524cb293a482429e6e5a97/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:37.875204 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f273cf-ea4f-4e71-9272-79da4ce545a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=b2f12d8b3f514d84ba59f18a4e4a96f2, user_id=73d52a5dfc524cb293a482429e6e5a97, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:37.876645 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f273cf-ea4f-4e71-9272-79da4ce545a0 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:37.893782 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 438/871] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Oct 27 13:13:37 2022] PUT /identity/v3/projects/b2f12d8b3f514d84ba59f18a4e4a96f2/users/73d52a5dfc524cb293a482429e6e5a97/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:13:39.996772 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f0e95-a37f-4e71-8637-f150a8a9df15 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:39.997325 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f0e95-a37f-4e71-8637-f150a8a9df15 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:39.997325 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f0e95-a37f-4e71-8637-f150a8a9df15 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:39.998711 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 434/872] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:13:40.005258 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74683b07-90e9-48f1-bed8-f4bd9fa8555a None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:40.006036 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74683b07-90e9-48f1-bed8-f4bd9fa8555a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:40.006199 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74683b07-90e9-48f1-bed8-f4bd9fa8555a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:40.029804 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-74683b07-90e9-48f1-bed8-f4bd9fa8555a None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:13:40.031014 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-74683b07-90e9-48f1-bed8-f4bd9fa8555a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:13:40.104828 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 439/873] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:13:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 13:13:40.372740 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f0e95-a37f-4e71-8637-f150a8a9df15 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:40.491815 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f0e95-a37f-4e71-8637-f150a8a9df15 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:40.494128 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:40.527746 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3633248-c892-43f5-b25d-0ecc291d314d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:40.528369 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3633248-c892-43f5-b25d-0ecc291d314d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:40.528646 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3633248-c892-43f5-b25d-0ecc291d314d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:40.528916 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3633248-c892-43f5-b25d-0ecc291d314d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:40.540105 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3633248-c892-43f5-b25d-0ecc291d314d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:13:40.544915 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-e3633248-c892-43f5-b25d-0ecc291d314d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:13:40.544915 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:13:40.544915 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:13:40.544915 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:13:40.544915 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:13:40.544915 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:13:40.544915 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:13:40.544915 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:13:40.544915 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:13:40.544915 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:13:40.544915 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:13:40.544915 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:13:40.544915 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:13:40.544915 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:13:40.544915 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:13:40.544915 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:13:40.545929 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:13:40.545929 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:13:40.545929 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:13:40.545929 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:13:40.545929 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:13:40.545929 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:13:40.545929 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:13:40.545929 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:13:40.545929 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:13:40.545929 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:13:40.545929 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:13:40.545929 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:13:40.545929 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:13:40.545929 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:13:40.545929 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:13:40.545929 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:13:40.546790 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:13:40.546790 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:13:40.546790 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:13:40.546790 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:13:40.546790 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:13:40.546790 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:13:40.546790 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:13:40.546790 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:13:40.546790 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:13:40.546790 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:13:40.546790 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:13:40.546790 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:13:40.546790 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 435/874] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Oct 27 13:13:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:13:40.553165 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74683b07-90e9-48f1-bed8-f4bd9fa8555a None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:40.670946 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74683b07-90e9-48f1-bed8-f4bd9fa8555a None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:40.687729 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:40.717583 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ebd3f-6a4b-4c70-96b6-5c7d9012a58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:40.718197 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ebd3f-6a4b-4c70-96b6-5c7d9012a58c None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:40.718476 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ebd3f-6a4b-4c70-96b6-5c7d9012a58c None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:40.718748 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ebd3f-6a4b-4c70-96b6-5c7d9012a58c None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:40.719418 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ebd3f-6a4b-4c70-96b6-5c7d9012a58c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:13:40.719719 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ebd3f-6a4b-4c70-96b6-5c7d9012a58c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:40.721165 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ebd3f-6a4b-4c70-96b6-5c7d9012a58c None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:40.729354 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 440/875] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Oct 27 13:13:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:40.736219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3633248-c892-43f5-b25d-0ecc291d314d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:40.842844 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3633248-c892-43f5-b25d-0ecc291d314d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:40.879760 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c710ad-a859-434a-9f85-cdccba366b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:40.880378 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c710ad-a859-434a-9f85-cdccba366b29 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:40.880652 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c710ad-a859-434a-9f85-cdccba366b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:40.880916 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c710ad-a859-434a-9f85-cdccba366b29 None admin] PATH_INFO: `/v3/users/73d52a5dfc524cb293a482429e6e5a97` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:40.882187 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c710ad-a859-434a-9f85-cdccba366b29 None admin] RBAC: Authorizing `identity:get_user(user_id=73d52a5dfc524cb293a482429e6e5a97)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:40.883635 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c710ad-a859-434a-9f85-cdccba366b29 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:40.885226 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 436/876] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Oct 27 13:13:40 2022] GET /identity/v3/users/73d52a5dfc524cb293a482429e6e5a97 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:13:40.894337 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ebd3f-6a4b-4c70-96b6-5c7d9012a58c None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:40.999861 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ebd3f-6a4b-4c70-96b6-5c7d9012a58c None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:41.035318 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0f63a-ef2f-4271-b2a8-a75d39b32924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:41.035903 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0f63a-ef2f-4271-b2a8-a75d39b32924 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:41.036166 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0f63a-ef2f-4271-b2a8-a75d39b32924 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:41.036427 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0f63a-ef2f-4271-b2a8-a75d39b32924 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:41.079065 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:41.107227 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b0f63a-ef2f-4271-b2a8-a75d39b32924 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:41.108667 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b0f63a-ef2f-4271-b2a8-a75d39b32924 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:41.208402 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 441/877] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Oct 27 13:13:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 27 13:13:41.218040 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c710ad-a859-434a-9f85-cdccba366b29 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:41.250489 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:41.320524 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c710ad-a859-434a-9f85-cdccba366b29 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:41.355368 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d158490-4cf2-4b17-a5ad-fd8717675eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:41.355995 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d158490-4cf2-4b17-a5ad-fd8717675eb1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:41.356299 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d158490-4cf2-4b17-a5ad-fd8717675eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:41.356530 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d158490-4cf2-4b17-a5ad-fd8717675eb1 None admin] PATH_INFO: `/v3/projects/b2f12d8b3f514d84ba59f18a4e4a96f2` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:41.357774 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d158490-4cf2-4b17-a5ad-fd8717675eb1 None admin] RBAC: Authorizing `identity:get_project(project_id=b2f12d8b3f514d84ba59f18a4e4a96f2)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:41.359373 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d158490-4cf2-4b17-a5ad-fd8717675eb1 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:41.361023 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 437/878] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Oct 27 13:13:41 2022] GET /identity/v3/projects/b2f12d8b3f514d84ba59f18a4e4a96f2 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:41.367892 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0f63a-ef2f-4271-b2a8-a75d39b32924 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:41.447691 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:41.479244 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0f63a-ef2f-4271-b2a8-a75d39b32924 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:41.518765 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1fdb6f-0cc0-4121-a217-68977b9bb6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:41.519307 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1fdb6f-0cc0-4121-a217-68977b9bb6a1 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:41.519582 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1fdb6f-0cc0-4121-a217-68977b9bb6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:41.519850 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1fdb6f-0cc0-4121-a217-68977b9bb6a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:41.520570 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1fdb6f-0cc0-4121-a217-68977b9bb6a1 None admin] RBAC: Adding query filter params (role.id=93bba834c17a4aa7afdc65c002a12975, scope.project.id=b2f12d8b3f514d84ba59f18a4e4a96f2, user.id=73d52a5dfc524cb293a482429e6e5a97) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:13:41.520877 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1fdb6f-0cc0-4121-a217-68977b9bb6a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:41.522409 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1fdb6f-0cc0-4121-a217-68977b9bb6a1 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:41.528301 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 442/879] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Oct 27 13:13:41 2022] GET /identity/v3/role_assignments?user.id=73d52a5dfc524cb293a482429e6e5a97&scope.project.id=b2f12d8b3f514d84ba59f18a4e4a96f2&role.id=93bba834c17a4aa7afdc65c002a12975 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:43.650114 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf47e1-9dc5-4e02-8eb6-030ce9681c03 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:43.650980 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf47e1-9dc5-4e02-8eb6-030ce9681c03 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:43.650980 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf47e1-9dc5-4e02-8eb6-030ce9681c03 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:43.653080 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 438/880] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:13:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:13:43.659845 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064007e8-e88d-46ac-af18-7e7637b76e3c None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:43.660556 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064007e8-e88d-46ac-af18-7e7637b76e3c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:43.660729 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064007e8-e88d-46ac-af18-7e7637b76e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:43.684511 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-064007e8-e88d-46ac-af18-7e7637b76e3c None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:13:43.685727 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-064007e8-e88d-46ac-af18-7e7637b76e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:13:43.756439 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 443/881] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:13:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 13:13:44.032707 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf47e1-9dc5-4e02-8eb6-030ce9681c03 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:44.151699 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:44.156748 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf47e1-9dc5-4e02-8eb6-030ce9681c03 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:44.191862 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a259c8fa-ff68-4e41-bfdc-19c8173752f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:44.192450 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259c8fa-ff68-4e41-bfdc-19c8173752f8 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:44.192722 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259c8fa-ff68-4e41-bfdc-19c8173752f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:44.192993 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259c8fa-ff68-4e41-bfdc-19c8173752f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:44.193681 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a259c8fa-ff68-4e41-bfdc-19c8173752f8 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:44.195042 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a259c8fa-ff68-4e41-bfdc-19c8173752f8 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:44.215344 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 439/882] 10.222.0.52 () {60 vars in 1138 bytes} [Thu Oct 27 13:13:44 2022] POST /identity/v3/domains => generated 267 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:13:46.348507 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca08d24-20e4-4e3f-80cc-974671cce48b None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:46.349350 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca08d24-20e4-4e3f-80cc-974671cce48b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:46.349350 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca08d24-20e4-4e3f-80cc-974671cce48b None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:46.351522 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 444/883] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:13:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:13:46.360324 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88213838-6938-4813-9560-a761cfda3fad None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:46.360736 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88213838-6938-4813-9560-a761cfda3fad None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:46.360900 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88213838-6938-4813-9560-a761cfda3fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:46.384473 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-88213838-6938-4813-9560-a761cfda3fad None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:13:46.385724 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-88213838-6938-4813-9560-a761cfda3fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:13:46.453343 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 440/884] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:13:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 13:13:46.723362 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca08d24-20e4-4e3f-80cc-974671cce48b None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:46.808440 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:46.854945 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca08d24-20e4-4e3f-80cc-974671cce48b None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:46.891635 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10aa0b-17f6-42eb-bfba-ff896df9b37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:46.892245 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10aa0b-17f6-42eb-bfba-ff896df9b37f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:46.892520 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10aa0b-17f6-42eb-bfba-ff896df9b37f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:46.892789 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10aa0b-17f6-42eb-bfba-ff896df9b37f None admin] PATH_INFO: `/v3/domains/7aa53478c0674e50be0d262579deae43` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:46.903933 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b10aa0b-17f6-42eb-bfba-ff896df9b37f None admin] RBAC: Authorizing `identity:get_domain(domain_id=7aa53478c0674e50be0d262579deae43)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:46.905366 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b10aa0b-17f6-42eb-bfba-ff896df9b37f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:46.907051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 445/885] 10.222.0.52 () {56 vars in 1183 bytes} [Thu Oct 27 13:13:46 2022] GET /identity/v3/domains/7aa53478c0674e50be0d262579deae43 => generated 267 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:46.914085 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88213838-6938-4813-9560-a761cfda3fad None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:47.003811 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:47.015591 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88213838-6938-4813-9560-a761cfda3fad None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:47.051909 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10948045-88c6-4043-861a-30e9ae2bd13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:47.052494 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10948045-88c6-4043-861a-30e9ae2bd13b None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:47.052763 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10948045-88c6-4043-861a-30e9ae2bd13b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:47.053025 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10948045-88c6-4043-861a-30e9ae2bd13b None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:47.053788 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10948045-88c6-4043-861a-30e9ae2bd13b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:47.055217 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10948045-88c6-4043-861a-30e9ae2bd13b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:47.087088 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 441/886] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Oct 27 13:13:46 2022] POST /identity/v3/projects => generated 361 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:13:49.224272 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d682d-286f-4346-968a-c7d094c51a43 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:49.224958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d682d-286f-4346-968a-c7d094c51a43 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:49.224958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d682d-286f-4346-968a-c7d094c51a43 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:49.226206 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 446/887] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:13:49.232509 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e52432-32eb-4874-8306-002308995b74 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:49.233261 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e52432-32eb-4874-8306-002308995b74 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:49.233411 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e52432-32eb-4874-8306-002308995b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:49.260415 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-43e52432-32eb-4874-8306-002308995b74 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:13:49.261639 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-43e52432-32eb-4874-8306-002308995b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:13:49.332332 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 442/888] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:13:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 13:13:49.602826 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d682d-286f-4346-968a-c7d094c51a43 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:49.720385 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d682d-286f-4346-968a-c7d094c51a43 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:49.744255 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:49.753622 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b8eaf-feb9-47d7-bc7a-6bc7cc434a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:49.754304 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b8eaf-feb9-47d7-bc7a-6bc7cc434a24 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:49.754577 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b8eaf-feb9-47d7-bc7a-6bc7cc434a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:49.754842 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b8eaf-feb9-47d7-bc7a-6bc7cc434a24 None admin] PATH_INFO: `/v3/domains/7aa53478c0674e50be0d262579deae43` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:49.756002 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b8eaf-feb9-47d7-bc7a-6bc7cc434a24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=7aa53478c0674e50be0d262579deae43)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:49.757440 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b8eaf-feb9-47d7-bc7a-6bc7cc434a24 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:49.759024 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 447/889] 10.222.0.52 () {56 vars in 1183 bytes} [Thu Oct 27 13:13:49 2022] GET /identity/v3/domains/7aa53478c0674e50be0d262579deae43 => generated 267 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:13:49.765006 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e52432-32eb-4874-8306-002308995b74 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:49.838232 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:49.879551 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e52432-32eb-4874-8306-002308995b74 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:49.918178 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0287ff-8829-4b99-9ce7-5e95e7a3459f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:49.918782 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0287ff-8829-4b99-9ce7-5e95e7a3459f None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:49.919062 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0287ff-8829-4b99-9ce7-5e95e7a3459f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:49.919334 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0287ff-8829-4b99-9ce7-5e95e7a3459f None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:49.919996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0287ff-8829-4b99-9ce7-5e95e7a3459f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:49.921432 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0287ff-8829-4b99-9ce7-5e95e7a3459f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:49.946474 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 443/890] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Oct 27 13:13:49 2022] POST /identity/v3/users => generated 311 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:13:52.085977 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f47f0-9e15-4b72-8f05-4eb5c41c6fba None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:52.086499 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f47f0-9e15-4b72-8f05-4eb5c41c6fba None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:52.086499 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f47f0-9e15-4b72-8f05-4eb5c41c6fba None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:52.087776 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 448/891] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:13:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:13:52.094122 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cfb1b-fe8d-4bae-9cc2-8dad428f9437 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:52.094871 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cfb1b-fe8d-4bae-9cc2-8dad428f9437 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:52.095005 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cfb1b-fe8d-4bae-9cc2-8dad428f9437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:52.120205 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-569cfb1b-fe8d-4bae-9cc2-8dad428f9437 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:13:52.121378 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-569cfb1b-fe8d-4bae-9cc2-8dad428f9437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:13:52.190868 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 444/892] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:13:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 13:13:52.452191 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f47f0-9e15-4b72-8f05-4eb5c41c6fba None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:52.576469 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f47f0-9e15-4b72-8f05-4eb5c41c6fba None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:52.610880 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54f59b-37f6-4cf7-ad60-62e2b54a59e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:52.611497 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54f59b-37f6-4cf7-ad60-62e2b54a59e2 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:52.611770 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54f59b-37f6-4cf7-ad60-62e2b54a59e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:52.612115 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54f59b-37f6-4cf7-ad60-62e2b54a59e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:52.623408 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a54f59b-37f6-4cf7-ad60-62e2b54a59e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:13:52.628337 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-8a54f59b-37f6-4cf7-ad60-62e2b54a59e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:13:52.628337 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:13:52.628337 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:13:52.628337 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:13:52.628337 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:13:52.628337 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:13:52.628337 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:13:52.628337 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:13:52.628337 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:13:52.628337 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:13:52.628337 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:13:52.628337 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:13:52.628337 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:13:52.628337 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:13:52.628337 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:13:52.628337 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:13:52.629431 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:13:52.629431 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:13:52.629431 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:13:52.629431 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:13:52.629431 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:13:52.629431 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:13:52.629431 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:13:52.629431 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:13:52.629431 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:13:52.629431 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:13:52.629431 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:13:52.629431 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:13:52.629431 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:13:52.629431 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:13:52.629431 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:13:52.629431 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:13:52.630553 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:13:52.630553 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:13:52.630553 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:13:52.630553 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:13:52.630553 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:13:52.630553 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:13:52.630553 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:13:52.630553 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:13:52.630553 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:13:52.630553 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:13:52.630553 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:13:52.630553 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:13:52.630553 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 449/893] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Oct 27 13:13:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:13:52.635674 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569cfb1b-fe8d-4bae-9cc2-8dad428f9437 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:52.696180 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:52.742943 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569cfb1b-fe8d-4bae-9cc2-8dad428f9437 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:52.777458 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13647ca-4202-4595-9d9c-56cd0592ab66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:52.778072 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13647ca-4202-4595-9d9c-56cd0592ab66 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:52.778340 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13647ca-4202-4595-9d9c-56cd0592ab66 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:52.778601 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13647ca-4202-4595-9d9c-56cd0592ab66 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:52.779251 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13647ca-4202-4595-9d9c-56cd0592ab66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:13:52.779528 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13647ca-4202-4595-9d9c-56cd0592ab66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:52.780898 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13647ca-4202-4595-9d9c-56cd0592ab66 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:52.789464 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 445/894] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Oct 27 13:13:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:52.798180 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54f59b-37f6-4cf7-ad60-62e2b54a59e2 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:52.863480 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:52.911113 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54f59b-37f6-4cf7-ad60-62e2b54a59e2 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:52.947557 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcb7fd-8e9d-4461-8929-4303ef59537f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:52.948171 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcb7fd-8e9d-4461-8929-4303ef59537f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:52.948445 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcb7fd-8e9d-4461-8929-4303ef59537f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:52.948715 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcb7fd-8e9d-4461-8929-4303ef59537f None admin] PATH_INFO: `/v3/users/3883e7a66ebd454abaa90975b51e1a58` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:52.963402 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffcb7fd-8e9d-4461-8929-4303ef59537f None admin] RBAC: Authorizing `identity:get_user(user_id=3883e7a66ebd454abaa90975b51e1a58)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:52.964852 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffcb7fd-8e9d-4461-8929-4303ef59537f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:52.966478 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 450/895] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Oct 27 13:13:52 2022] GET /identity/v3/users/3883e7a66ebd454abaa90975b51e1a58 => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:13:52.972907 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13647ca-4202-4595-9d9c-56cd0592ab66 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:53.074493 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13647ca-4202-4595-9d9c-56cd0592ab66 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:53.094024 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:53.111002 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19447dfa-06e1-4c5a-8e01-2b0c3313c9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:53.111605 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19447dfa-06e1-4c5a-8e01-2b0c3313c9a3 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:53.111888 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19447dfa-06e1-4c5a-8e01-2b0c3313c9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:53.112170 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19447dfa-06e1-4c5a-8e01-2b0c3313c9a3 None admin] PATH_INFO: `/v3/projects/9d5ed5914b8f48cd9935a7dc5d5eb5f4` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:53.113347 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19447dfa-06e1-4c5a-8e01-2b0c3313c9a3 None admin] RBAC: Authorizing `identity:get_project(project_id=9d5ed5914b8f48cd9935a7dc5d5eb5f4)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:53.114806 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19447dfa-06e1-4c5a-8e01-2b0c3313c9a3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:53.116422 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 446/896] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Oct 27 13:13:52 2022] GET /identity/v3/projects/9d5ed5914b8f48cd9935a7dc5d5eb5f4 => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:53.122859 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcb7fd-8e9d-4461-8929-4303ef59537f None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:53.227308 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcb7fd-8e9d-4461-8929-4303ef59537f None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:53.240588 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:53.262786 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0173272-13c5-4641-8fbc-f3eccd433377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:53.263433 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0173272-13c5-4641-8fbc-f3eccd433377 None admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:53.263708 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0173272-13c5-4641-8fbc-f3eccd433377 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:53.263976 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0173272-13c5-4641-8fbc-f3eccd433377 None admin] PATH_INFO: `/v3/projects/9d5ed5914b8f48cd9935a7dc5d5eb5f4/users/3883e7a66ebd454abaa90975b51e1a58/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:53.266001 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0173272-13c5-4641-8fbc-f3eccd433377 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d5ed5914b8f48cd9935a7dc5d5eb5f4, user_id=3883e7a66ebd454abaa90975b51e1a58, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:53.267432 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0173272-13c5-4641-8fbc-f3eccd433377 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:53.282884 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 451/897] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Oct 27 13:13:53 2022] PUT /identity/v3/projects/9d5ed5914b8f48cd9935a7dc5d5eb5f4/users/3883e7a66ebd454abaa90975b51e1a58/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:13:55.418858 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e90ba-aa05-4a7c-8b01-2918b8ff235f None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:55.419704 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e90ba-aa05-4a7c-8b01-2918b8ff235f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:55.419704 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e90ba-aa05-4a7c-8b01-2918b8ff235f None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:55.421055 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 447/898] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:13:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:13:55.426798 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554c437-7f30-45b1-86c3-bf24cd8872e0 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:55.427294 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554c437-7f30-45b1-86c3-bf24cd8872e0 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:55.427294 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554c437-7f30-45b1-86c3-bf24cd8872e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:55.453035 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-1554c437-7f30-45b1-86c3-bf24cd8872e0 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:13:55.454619 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1554c437-7f30-45b1-86c3-bf24cd8872e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:13:55.553122 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 452/899] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:13:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 13:13:55.833947 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e90ba-aa05-4a7c-8b01-2918b8ff235f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:55.950679 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e90ba-aa05-4a7c-8b01-2918b8ff235f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:55.991686 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd6fd1-d3d8-4f2e-92de-18ea71fc6845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:55.992312 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd6fd1-d3d8-4f2e-92de-18ea71fc6845 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:55.992588 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd6fd1-d3d8-4f2e-92de-18ea71fc6845 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:55.992884 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd6fd1-d3d8-4f2e-92de-18ea71fc6845 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:56.003869 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bd6fd1-d3d8-4f2e-92de-18ea71fc6845 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:13:56.008596 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-94bd6fd1-d3d8-4f2e-92de-18ea71fc6845 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:13:56.008596 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:13:56.008596 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:13:56.008596 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:13:56.008596 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:13:56.008596 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:13:56.008596 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:13:56.008596 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:13:56.008596 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:13:56.008596 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:13:56.008596 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:13:56.008596 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:13:56.008596 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:13:56.008596 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:13:56.008596 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:13:56.008596 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:13:56.009793 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:13:56.009793 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:13:56.009793 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:13:56.009793 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:13:56.009793 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:13:56.009793 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:13:56.009793 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:13:56.009793 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:13:56.009793 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:13:56.009793 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:13:56.009793 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:13:56.009793 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:13:56.009793 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:13:56.009793 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:13:56.009793 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:13:56.009793 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:13:56.010879 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:13:56.010879 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:13:56.010879 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:13:56.010879 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:13:56.010879 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:13:56.010879 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:13:56.010879 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:13:56.010879 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:13:56.010879 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:13:56.010879 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:13:56.010879 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:13:56.010879 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:13:56.010879 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 448/900] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Oct 27 13:13:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:13:56.016260 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1554c437-7f30-45b1-86c3-bf24cd8872e0 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:56.120971 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1554c437-7f30-45b1-86c3-bf24cd8872e0 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:56.122613 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:56.157839 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5807eac1-c239-4047-80be-dab91bb992b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:56.158437 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807eac1-c239-4047-80be-dab91bb992b6 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:56.158716 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807eac1-c239-4047-80be-dab91bb992b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:56.159020 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807eac1-c239-4047-80be-dab91bb992b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:56.159686 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5807eac1-c239-4047-80be-dab91bb992b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:13:56.159996 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5807eac1-c239-4047-80be-dab91bb992b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:56.161362 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5807eac1-c239-4047-80be-dab91bb992b6 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:56.169464 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 453/901] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Oct 27 13:13:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:56.175838 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd6fd1-d3d8-4f2e-92de-18ea71fc6845 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:56.224966 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:56.276672 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd6fd1-d3d8-4f2e-92de-18ea71fc6845 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:56.317895 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b46d2b-3cf4-4ed6-a7fb-8ce24817aaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:56.318884 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b46d2b-3cf4-4ed6-a7fb-8ce24817aaf8 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:56.319339 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b46d2b-3cf4-4ed6-a7fb-8ce24817aaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:56.319690 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b46d2b-3cf4-4ed6-a7fb-8ce24817aaf8 None admin] PATH_INFO: `/v3/users/3883e7a66ebd454abaa90975b51e1a58` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:56.321711 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b46d2b-3cf4-4ed6-a7fb-8ce24817aaf8 None admin] RBAC: Authorizing `identity:get_user(user_id=3883e7a66ebd454abaa90975b51e1a58)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:56.324043 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b46d2b-3cf4-4ed6-a7fb-8ce24817aaf8 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:56.326579 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 449/902] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Oct 27 13:13:56 2022] GET /identity/v3/users/3883e7a66ebd454abaa90975b51e1a58 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:56.334332 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5807eac1-c239-4047-80be-dab91bb992b6 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:56.444117 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5807eac1-c239-4047-80be-dab91bb992b6 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:56.482184 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb861aa-f0aa-4d0e-9308-ab856a680e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:56.483059 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb861aa-f0aa-4d0e-9308-ab856a680e4a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:56.483420 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb861aa-f0aa-4d0e-9308-ab856a680e4a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:56.483761 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb861aa-f0aa-4d0e-9308-ab856a680e4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:56.520410 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:56.566112 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb861aa-f0aa-4d0e-9308-ab856a680e4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:56.567568 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb861aa-f0aa-4d0e-9308-ab856a680e4a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:56.670983 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 454/903] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Oct 27 13:13:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 27 13:13:56.680952 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b46d2b-3cf4-4ed6-a7fb-8ce24817aaf8 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:56.785649 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b46d2b-3cf4-4ed6-a7fb-8ce24817aaf8 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:56.802073 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:56.820381 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9103d-7005-4d6f-8cc5-d64f44b36f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:56.821004 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9103d-7005-4d6f-8cc5-d64f44b36f10 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:56.821281 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9103d-7005-4d6f-8cc5-d64f44b36f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:56.821553 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9103d-7005-4d6f-8cc5-d64f44b36f10 None admin] PATH_INFO: `/v3/projects/9d5ed5914b8f48cd9935a7dc5d5eb5f4` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:56.822701 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d9103d-7005-4d6f-8cc5-d64f44b36f10 None admin] RBAC: Authorizing `identity:get_project(project_id=9d5ed5914b8f48cd9935a7dc5d5eb5f4)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:56.824142 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d9103d-7005-4d6f-8cc5-d64f44b36f10 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:56.825818 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 450/904] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Oct 27 13:13:56 2022] GET /identity/v3/projects/9d5ed5914b8f48cd9935a7dc5d5eb5f4 => generated 361 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:13:56.833097 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb861aa-f0aa-4d0e-9308-ab856a680e4a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:13:56.908245 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:13:56.954119 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb861aa-f0aa-4d0e-9308-ab856a680e4a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:13:56.990302 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45919bc7-7dba-4252-b08e-94a4e3bd3305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:13:56.990893 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45919bc7-7dba-4252-b08e-94a4e3bd3305 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:13:56.991176 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45919bc7-7dba-4252-b08e-94a4e3bd3305 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:13:56.991428 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45919bc7-7dba-4252-b08e-94a4e3bd3305 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:13:56.992141 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45919bc7-7dba-4252-b08e-94a4e3bd3305 None admin] RBAC: Adding query filter params (role.id=93bba834c17a4aa7afdc65c002a12975, scope.project.id=9d5ed5914b8f48cd9935a7dc5d5eb5f4, user.id=3883e7a66ebd454abaa90975b51e1a58) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:13:56.992443 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45919bc7-7dba-4252-b08e-94a4e3bd3305 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:13:56.993937 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45919bc7-7dba-4252-b08e-94a4e3bd3305 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:13:56.999847 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 455/905] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Oct 27 13:13:56 2022] GET /identity/v3/role_assignments?user.id=3883e7a66ebd454abaa90975b51e1a58&scope.project.id=9d5ed5914b8f48cd9935a7dc5d5eb5f4&role.id=93bba834c17a4aa7afdc65c002a12975 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:14:06.816409 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=8 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:14:06.997197 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=36 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:14:52.707579 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeaeceb-b72f-4bc7-b795-3ce2494941e5 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:14:52.708201 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeaeceb-b72f-4bc7-b795-3ce2494941e5 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:14:52.708201 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeaeceb-b72f-4bc7-b795-3ce2494941e5 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:14:52.709722 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 451/906] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:14:52.716372 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97b906-9210-4d9e-bd77-f39cffbc3f50 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:14:52.716798 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97b906-9210-4d9e-bd77-f39cffbc3f50 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:14:52.717005 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97b906-9210-4d9e-bd77-f39cffbc3f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:14:52.743017 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-7f97b906-9210-4d9e-bd77-f39cffbc3f50 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:14:52.743017 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7f97b906-9210-4d9e-bd77-f39cffbc3f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:14:52.824037 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 456/907] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:14:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 13:14:53.144038 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeaeceb-b72f-4bc7-b795-3ce2494941e5 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:14:53.275866 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeaeceb-b72f-4bc7-b795-3ce2494941e5 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:14:53.325882 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83833d9-0c9a-4f60-8cfe-5b7ebe231a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:14:53.326622 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83833d9-0c9a-4f60-8cfe-5b7ebe231a55 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:14:53.326958 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83833d9-0c9a-4f60-8cfe-5b7ebe231a55 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:14:53.327210 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83833d9-0c9a-4f60-8cfe-5b7ebe231a55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:14:53.343214 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83833d9-0c9a-4f60-8cfe-5b7ebe231a55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:14:53.344677 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83833d9-0c9a-4f60-8cfe-5b7ebe231a55 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:14:53.364196 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-a83833d9-0c9a-4f60-8cfe-5b7ebe231a55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:14:53.364196 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:14:53.364196 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:14:53.364196 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:14:53.364196 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:14:53.364196 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:14:53.364196 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:14:53.364196 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:14:53.364196 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:14:53.364196 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:14:53.364196 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:14:53.364196 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:14:53.364196 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:14:53.364196 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:14:53.364196 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:14:53.364196 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:14:53.365476 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:14:53.365476 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:14:53.365476 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:14:53.365476 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:14:53.365476 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:14:53.365476 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:14:53.365476 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:14:53.365476 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:14:53.365476 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:14:53.365476 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:14:53.365476 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:14:53.365476 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:14:53.365476 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:14:53.365476 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:14:53.365476 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:14:53.365476 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:14:53.365476 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:14:53.366504 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:14:53.366504 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:14:53.366504 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:14:53.369703 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 452/908] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:14:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:14:53.372020 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97b906-9210-4d9e-bd77-f39cffbc3f50 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:14:53.493150 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97b906-9210-4d9e-bd77-f39cffbc3f50 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:14:53.526833 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:14:53.538756 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602ae62-3d74-464b-8b1b-2d02de6b5944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:14:53.539478 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602ae62-3d74-464b-8b1b-2d02de6b5944 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:14:53.539759 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602ae62-3d74-464b-8b1b-2d02de6b5944 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:14:53.540026 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602ae62-3d74-464b-8b1b-2d02de6b5944 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:14:53.540683 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f602ae62-3d74-464b-8b1b-2d02de6b5944 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:14:53.541011 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f602ae62-3d74-464b-8b1b-2d02de6b5944 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:14:53.542516 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f602ae62-3d74-464b-8b1b-2d02de6b5944 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:14:53.555438 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 457/909] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:14:53.562076 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83833d9-0c9a-4f60-8cfe-5b7ebe231a55 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:14:53.634402 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:14:53.699424 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83833d9-0c9a-4f60-8cfe-5b7ebe231a55 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:14:53.743075 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95af2eb-740a-4519-8410-2588a210f22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:14:53.744616 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95af2eb-740a-4519-8410-2588a210f22b None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:14:53.745088 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95af2eb-740a-4519-8410-2588a210f22b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:14:53.745638 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95af2eb-740a-4519-8410-2588a210f22b None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:14:53.746507 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95af2eb-740a-4519-8410-2588a210f22b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:14:53.748241 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95af2eb-740a-4519-8410-2588a210f22b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:14:53.777602 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 453/910] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Oct 27 13:14:53 2022] POST /identity/v3/users => generated 251 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:14:56.153457 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841a97e-7f60-4853-8eea-cbe3c6b33a28 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:14:56.154728 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841a97e-7f60-4853-8eea-cbe3c6b33a28 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:14:56.155016 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841a97e-7f60-4853-8eea-cbe3c6b33a28 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:14:56.156525 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 458/911] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:14:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 13:14:56.162587 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3cde98-6e3e-4c16-92f6-0ee513e21caa None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:14:56.163208 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3cde98-6e3e-4c16-92f6-0ee513e21caa None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:14:56.163208 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3cde98-6e3e-4c16-92f6-0ee513e21caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:14:56.188187 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-4a3cde98-6e3e-4c16-92f6-0ee513e21caa None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:14:56.189391 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4a3cde98-6e3e-4c16-92f6-0ee513e21caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:14:56.281595 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 454/912] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:14:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 13:14:56.593113 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4841a97e-7f60-4853-8eea-cbe3c6b33a28 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:14:56.738773 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4841a97e-7f60-4853-8eea-cbe3c6b33a28 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:14:56.777570 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fec8bd-ed2c-440d-a35a-b81b5879278a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:14:56.778246 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fec8bd-ed2c-440d-a35a-b81b5879278a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:14:56.778524 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fec8bd-ed2c-440d-a35a-b81b5879278a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:14:56.779974 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fec8bd-ed2c-440d-a35a-b81b5879278a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:14:56.793891 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fec8bd-ed2c-440d-a35a-b81b5879278a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:14:56.798997 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-01fec8bd-ed2c-440d-a35a-b81b5879278a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 13:14:56.798997 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:14:56.798997 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:14:56.798997 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:14:56.798997 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:14:56.798997 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:14:56.798997 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:14:56.798997 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:14:56.798997 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:14:56.798997 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:14:56.798997 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:14:56.798997 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:14:56.798997 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:14:56.798997 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:14:56.798997 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:14:56.798997 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:14:56.800175 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:14:56.800175 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:14:56.800175 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:14:56.800175 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:14:56.800175 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:14:56.800175 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:14:56.800175 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:14:56.800175 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:14:56.800175 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:14:56.800175 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:14:56.800175 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:14:56.800175 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:14:56.800175 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:14:56.800175 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:14:56.800175 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:14:56.800175 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:14:56.801014 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:14:56.801014 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:14:56.801014 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:14:56.801014 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:14:56.801014 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:14:56.801014 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:14:56.801014 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:14:56.801014 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:14:56.801014 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:14:56.801014 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:14:56.801014 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 13:14:56.801014 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:14:56.801014 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 459/913] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Oct 27 13:14:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:14:56.806522 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3cde98-6e3e-4c16-92f6-0ee513e21caa None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:14:56.855080 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:14:56.937975 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3cde98-6e3e-4c16-92f6-0ee513e21caa None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:14:56.978397 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88762e5-f747-4362-b75e-c5e1df089320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:14:56.979552 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88762e5-f747-4362-b75e-c5e1df089320 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:14:56.979799 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88762e5-f747-4362-b75e-c5e1df089320 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:14:56.980115 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88762e5-f747-4362-b75e-c5e1df089320 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:14:56.980779 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88762e5-f747-4362-b75e-c5e1df089320 None admin] RBAC: Adding query filter params (name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:14:56.981133 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88762e5-f747-4362-b75e-c5e1df089320 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:14:56.982594 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88762e5-f747-4362-b75e-c5e1df089320 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:14:56.991976 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 455/914] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Oct 27 13:14:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:14:56.997643 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fec8bd-ed2c-440d-a35a-b81b5879278a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:14:57.054531 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:14:57.108700 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fec8bd-ed2c-440d-a35a-b81b5879278a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:14:57.144685 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c021d-cd8f-4f70-be5d-aae31a9f4bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:14:57.145325 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c021d-cd8f-4f70-be5d-aae31a9f4bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:14:57.145725 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c021d-cd8f-4f70-be5d-aae31a9f4bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:14:57.147788 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c021d-cd8f-4f70-be5d-aae31a9f4bb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:14:57.159612 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c021d-cd8f-4f70-be5d-aae31a9f4bb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:14:57.161108 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c021d-cd8f-4f70-be5d-aae31a9f4bb9 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:14:57.176477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-639c021d-cd8f-4f70-be5d-aae31a9f4bb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:14:57.176477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:14:57.176477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:14:57.176477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:14:57.176477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:14:57.176477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:14:57.176477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:14:57.176477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:14:57.176477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:14:57.176477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:14:57.176477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:14:57.176477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:14:57.176477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:14:57.176477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:14:57.176477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:14:57.176477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:14:57.177802 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:14:57.177802 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:14:57.177802 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:14:57.177802 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:14:57.177802 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:14:57.177802 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:14:57.177802 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:14:57.177802 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:14:57.177802 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:14:57.177802 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:14:57.177802 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:14:57.177802 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:14:57.177802 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:14:57.177802 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:14:57.177802 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:14:57.177802 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:14:57.177802 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:14:57.178814 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:14:57.178814 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:14:57.178814 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:14:57.178814 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 460/915] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:14:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:14:57.183832 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88762e5-f747-4362-b75e-c5e1df089320 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:14:57.298608 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:14:57.302036 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88762e5-f747-4362-b75e-c5e1df089320 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:14:57.339477 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942cfa0-e7bd-42a0-953f-0ff448b7c81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:14:57.340093 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942cfa0-e7bd-42a0-953f-0ff448b7c81d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:14:57.340357 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942cfa0-e7bd-42a0-953f-0ff448b7c81d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:14:57.340620 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942cfa0-e7bd-42a0-953f-0ff448b7c81d None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:14:57.341452 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5942cfa0-e7bd-42a0-953f-0ff448b7c81d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:14:57.341609 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5942cfa0-e7bd-42a0-953f-0ff448b7c81d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:14:57.342954 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5942cfa0-e7bd-42a0-953f-0ff448b7c81d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:14:57.364363 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 456/916] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:14:57.365267 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c021d-cd8f-4f70-be5d-aae31a9f4bb9 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:14:57.481290 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c021d-cd8f-4f70-be5d-aae31a9f4bb9 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:14:57.483554 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:14:57.523644 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8bccb2-b589-4900-b5dc-f56c6dc76871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:14:57.524655 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bccb2-b589-4900-b5dc-f56c6dc76871 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:14:57.525140 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bccb2-b589-4900-b5dc-f56c6dc76871 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:14:57.525618 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bccb2-b589-4900-b5dc-f56c6dc76871 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:14:57.535197 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8bccb2-b589-4900-b5dc-f56c6dc76871 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:14:57.537023 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8bccb2-b589-4900-b5dc-f56c6dc76871 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:14:57.551503 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-9c8bccb2-b589-4900-b5dc-f56c6dc76871 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 27 13:14:57.551503 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:14:57.551503 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:14:57.551503 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:14:57.551503 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:14:57.551503 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:14:57.551503 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:14:57.551503 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:14:57.551503 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:14:57.551503 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:14:57.551503 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:14:57.551503 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:14:57.551503 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 13:14:57.551503 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 13:14:57.551503 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 13:14:57.551503 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 13:14:57.552753 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:14:57.552753 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:14:57.552753 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 13:14:57.552753 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:14:57.552753 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 13:14:57.552753 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:14:57.552753 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:14:57.552753 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:14:57.552753 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:14:57.552753 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:14:57.552753 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:14:57.552753 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:14:57.552753 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:14:57.552753 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:14:57.552753 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:14:57.552753 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:14:57.552753 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:14:57.552753 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:14:57.554058 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:14:57.554058 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:14:57.554058 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 13:14:57.554058 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 13:14:57.554058 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 13:14:57.554058 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 13:14:57.554058 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 13:14:57.554058 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 13:14:57.554058 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 27 13:14:57.554058 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:14:57.556074 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 461/917] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:14:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:14:57.562620 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942cfa0-e7bd-42a0-953f-0ff448b7c81d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:14:57.672570 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942cfa0-e7bd-42a0-953f-0ff448b7c81d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:14:57.715440 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e175b-70b9-4d85-a8f8-86e5f6208e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:14:57.716139 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e175b-70b9-4d85-a8f8-86e5f6208e7b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:14:57.716410 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e175b-70b9-4d85-a8f8-86e5f6208e7b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:14:57.716626 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e175b-70b9-4d85-a8f8-86e5f6208e7b None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:14:57.717447 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e175b-70b9-4d85-a8f8-86e5f6208e7b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:14:57.717829 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e175b-70b9-4d85-a8f8-86e5f6208e7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:14:57.719508 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e175b-70b9-4d85-a8f8-86e5f6208e7b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:14:57.738472 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 457/918] 10.222.0.52 () {56 vars in 1143 bytes} [Thu Oct 27 13:14:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:14:57.744737 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8bccb2-b589-4900-b5dc-f56c6dc76871 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:14:57.880650 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8bccb2-b589-4900-b5dc-f56c6dc76871 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:14:57.914433 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d9bf9-b280-4a76-9178-2590efccf84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:14:57.915323 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d9bf9-b280-4a76-9178-2590efccf84f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:14:57.915323 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d9bf9-b280-4a76-9178-2590efccf84f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:14:57.915589 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d9bf9-b280-4a76-9178-2590efccf84f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:14:57.926642 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d9bf9-b280-4a76-9178-2590efccf84f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:14:57.928068 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d9bf9-b280-4a76-9178-2590efccf84f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:14:57.942686 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-4e6d9bf9-b280-4a76-9178-2590efccf84f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:14:57.942686 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:14:57.942686 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:14:57.942686 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:14:57.942686 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:14:57.942686 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:14:57.942686 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:14:57.942686 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:14:57.942686 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:14:57.942686 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:14:57.942686 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:14:57.942686 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:14:57.942686 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:14:57.942686 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:14:57.942686 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:14:57.942686 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:14:57.943872 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:14:57.943872 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:14:57.943872 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:14:57.943872 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:14:57.943872 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:14:57.943872 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:14:57.943872 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:14:57.943872 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:14:57.943872 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:14:57.943872 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:14:57.943872 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:14:57.943872 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:14:57.943872 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:14:57.943872 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:14:57.943872 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:14:57.943872 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:14:57.943872 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:14:57.945055 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:14:57.945055 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:14:57.945055 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:14:57.948782 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 462/919] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:14:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:14:57.949952 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e175b-70b9-4d85-a8f8-86e5f6208e7b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:14:57.968781 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:14:58.055585 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e175b-70b9-4d85-a8f8-86e5f6208e7b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:14:58.093546 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14479def-58c4-46aa-b9f9-1619753dc756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:14:58.094230 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14479def-58c4-46aa-b9f9-1619753dc756 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:14:58.094576 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14479def-58c4-46aa-b9f9-1619753dc756 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:14:58.094840 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14479def-58c4-46aa-b9f9-1619753dc756 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:14:58.095565 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14479def-58c4-46aa-b9f9-1619753dc756 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:14:58.095927 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14479def-58c4-46aa-b9f9-1619753dc756 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:14:58.097660 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14479def-58c4-46aa-b9f9-1619753dc756 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:14:58.110345 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 458/920] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:14:58.116369 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d9bf9-b280-4a76-9178-2590efccf84f None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:14:58.133074 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:14:58.220494 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d9bf9-b280-4a76-9178-2590efccf84f None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:14:58.256706 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef77d3aa-519d-4299-9d3e-cc5a7bd77268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:14:58.257338 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77d3aa-519d-4299-9d3e-cc5a7bd77268 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:14:58.257738 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77d3aa-519d-4299-9d3e-cc5a7bd77268 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:14:58.258052 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77d3aa-519d-4299-9d3e-cc5a7bd77268 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:14:58.265661 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef77d3aa-519d-4299-9d3e-cc5a7bd77268 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:14:58.267132 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef77d3aa-519d-4299-9d3e-cc5a7bd77268 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:14:58.279706 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-ef77d3aa-519d-4299-9d3e-cc5a7bd77268 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:14:58.279706 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:14:58.279706 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:14:58.279706 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:14:58.279706 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:14:58.279706 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:14:58.279706 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:14:58.279706 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:14:58.279706 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:14:58.279706 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:14:58.279706 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:14:58.279706 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:14:58.279706 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 13:14:58.279706 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 13:14:58.279706 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 13:14:58.280804 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 13:14:58.280804 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:14:58.280804 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:14:58.280804 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:14:58.280804 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:14:58.280804 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:14:58.280804 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:14:58.280804 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:14:58.280804 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:14:58.280804 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:14:58.280804 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:14:58.280804 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:14:58.280804 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:14:58.280804 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:14:58.280804 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:14:58.280804 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:14:58.280804 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:14:58.281855 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 13:14:58.281855 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 13:14:58.281855 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 13:14:58.281855 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 13:14:58.281855 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 13:14:58.281855 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 13:14:58.281855 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:14:58.281855 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:14:58.285721 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 463/921] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Oct 27 13:14:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:14:58.287372 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14479def-58c4-46aa-b9f9-1619753dc756 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:14:58.373855 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:14:58.396226 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14479def-58c4-46aa-b9f9-1619753dc756 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:14:58.431033 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c10ff0-59a6-4b81-8f6b-4cc41f0bf800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:14:58.431637 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c10ff0-59a6-4b81-8f6b-4cc41f0bf800 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:14:58.431909 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c10ff0-59a6-4b81-8f6b-4cc41f0bf800 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:14:58.432176 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c10ff0-59a6-4b81-8f6b-4cc41f0bf800 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:14:58.432857 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c10ff0-59a6-4b81-8f6b-4cc41f0bf800 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:14:58.433153 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c10ff0-59a6-4b81-8f6b-4cc41f0bf800 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:14:58.435100 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c10ff0-59a6-4b81-8f6b-4cc41f0bf800 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:14:58.448266 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 459/922] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Oct 27 13:14:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:14:58.454429 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef77d3aa-519d-4299-9d3e-cc5a7bd77268 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:14:58.536147 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:14:58.566216 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef77d3aa-519d-4299-9d3e-cc5a7bd77268 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:14:58.602916 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc746d-5f15-4d46-8078-3ef4c490aff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:14:58.603608 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc746d-5f15-4d46-8078-3ef4c490aff4 None admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:14:58.603897 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc746d-5f15-4d46-8078-3ef4c490aff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:14:58.604167 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc746d-5f15-4d46-8078-3ef4c490aff4 None admin] PATH_INFO: `/v3/projects/0be19dd5a0df4cf79fe2ec14d11521f0/users/cbcd6da4e42248a3b38101104fbc03cc/roles/75936ae3accd49cb935acc7c628e2136` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:14:58.620110 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc746d-5f15-4d46-8078-3ef4c490aff4 None admin] RBAC: Authorizing `identity:create_grant(project_id=0be19dd5a0df4cf79fe2ec14d11521f0, user_id=cbcd6da4e42248a3b38101104fbc03cc, role_id=75936ae3accd49cb935acc7c628e2136)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:14:58.621764 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc746d-5f15-4d46-8078-3ef4c490aff4 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:14:58.635550 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 464/923] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Oct 27 13:14:58 2022] PUT /identity/v3/projects/0be19dd5a0df4cf79fe2ec14d11521f0/users/cbcd6da4e42248a3b38101104fbc03cc/roles/75936ae3accd49cb935acc7c628e2136 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:15:00.937472 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56628936-e58a-437a-a2d3-14ae4b070088 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:00.938042 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56628936-e58a-437a-a2d3-14ae4b070088 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:00.938042 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56628936-e58a-437a-a2d3-14ae4b070088 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:00.939531 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 460/924] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:15:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:15:00.945716 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4940678-69a2-43d9-9635-e1fb87e5088b None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:00.946184 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4940678-69a2-43d9-9635-e1fb87e5088b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:00.946310 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4940678-69a2-43d9-9635-e1fb87e5088b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:00.965835 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-f4940678-69a2-43d9-9635-e1fb87e5088b None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:15:00.967155 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f4940678-69a2-43d9-9635-e1fb87e5088b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:15:01.037152 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 465/925] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:15:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 13:15:01.310767 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56628936-e58a-437a-a2d3-14ae4b070088 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:15:01.428893 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56628936-e58a-437a-a2d3-14ae4b070088 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:15:01.466770 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db14904c-b5fa-4b42-ae6b-0abe91dc1f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:15:01.467470 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14904c-b5fa-4b42-ae6b-0abe91dc1f55 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:01.467794 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14904c-b5fa-4b42-ae6b-0abe91dc1f55 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:01.468068 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14904c-b5fa-4b42-ae6b-0abe91dc1f55 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:01.475890 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:15:01.481162 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db14904c-b5fa-4b42-ae6b-0abe91dc1f55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:15:01.487408 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-db14904c-b5fa-4b42-ae6b-0abe91dc1f55 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 13:15:01.487408 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:15:01.487408 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:15:01.487408 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:15:01.487408 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:15:01.487408 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:15:01.487408 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:15:01.487408 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:15:01.487408 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:15:01.487408 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:15:01.487408 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:15:01.487408 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:15:01.487408 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:15:01.487408 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:15:01.487408 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:15:01.487408 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:15:01.488569 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:15:01.488569 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:15:01.488569 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:15:01.488569 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:15:01.488569 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:15:01.488569 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:15:01.488569 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:15:01.488569 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:15:01.488569 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:15:01.488569 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:15:01.488569 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:15:01.488569 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:15:01.488569 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:15:01.488569 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:15:01.488569 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:15:01.488569 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:15:01.495007 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:15:01.495007 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:15:01.495007 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:15:01.495007 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:15:01.495007 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:15:01.495007 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:15:01.495007 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:15:01.495007 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:15:01.495007 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:15:01.495007 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:15:01.495007 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 13:15:01.495007 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:15:01.495007 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 461/926] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Oct 27 13:15:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:15:01.495736 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4940678-69a2-43d9-9635-e1fb87e5088b None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:15:01.564055 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:15:01.613965 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4940678-69a2-43d9-9635-e1fb87e5088b None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:15:01.651080 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1484d3-e618-45db-b5da-eaff1456ac04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:15:01.651706 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1484d3-e618-45db-b5da-eaff1456ac04 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:01.651973 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1484d3-e618-45db-b5da-eaff1456ac04 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:01.652239 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1484d3-e618-45db-b5da-eaff1456ac04 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:01.652900 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1484d3-e618-45db-b5da-eaff1456ac04 None admin] RBAC: Adding query filter params (name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:15:01.653198 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1484d3-e618-45db-b5da-eaff1456ac04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:15:01.654639 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1484d3-e618-45db-b5da-eaff1456ac04 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:15:01.668054 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 466/927] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Oct 27 13:15:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:15:01.669473 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db14904c-b5fa-4b42-ae6b-0abe91dc1f55 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:15:01.772876 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db14904c-b5fa-4b42-ae6b-0abe91dc1f55 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:15:01.810362 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e927a2e-3198-470a-933f-f2cc4e649172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:15:01.811096 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e927a2e-3198-470a-933f-f2cc4e649172 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:01.811438 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e927a2e-3198-470a-933f-f2cc4e649172 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:01.811706 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e927a2e-3198-470a-933f-f2cc4e649172 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:01.823212 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e927a2e-3198-470a-933f-f2cc4e649172 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:15:01.824695 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e927a2e-3198-470a-933f-f2cc4e649172 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:15:01.841513 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-9e927a2e-3198-470a-933f-f2cc4e649172 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:15:01.841513 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:15:01.841513 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:15:01.841513 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:15:01.841513 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:15:01.841513 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:15:01.841513 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:15:01.841513 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:15:01.841513 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:15:01.841513 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:15:01.841513 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:15:01.841513 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:15:01.841513 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:15:01.841513 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:15:01.841513 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:15:01.841513 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:15:01.842652 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:15:01.842652 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:15:01.842652 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:15:01.842652 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:15:01.842652 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:15:01.842652 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:15:01.842652 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:15:01.842652 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:15:01.842652 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:15:01.842652 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:15:01.842652 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:15:01.842652 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:15:01.842652 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:15:01.842652 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:15:01.842652 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:15:01.842652 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:15:01.842652 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:15:01.843557 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:15:01.843557 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:15:01.843557 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:15:01.843557 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 462/928] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:15:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:15:01.849643 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1484d3-e618-45db-b5da-eaff1456ac04 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:15:01.962466 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1484d3-e618-45db-b5da-eaff1456ac04 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:15:01.979738 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:15:01.998558 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eeaae0-6e8f-4c3d-9c0f-db7a9e1b129a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:15:01.999167 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eeaae0-6e8f-4c3d-9c0f-db7a9e1b129a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:01.999439 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eeaae0-6e8f-4c3d-9c0f-db7a9e1b129a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:01.999703 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eeaae0-6e8f-4c3d-9c0f-db7a9e1b129a None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:02.000353 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eeaae0-6e8f-4c3d-9c0f-db7a9e1b129a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:15:02.000668 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eeaae0-6e8f-4c3d-9c0f-db7a9e1b129a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:15:02.002135 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eeaae0-6e8f-4c3d-9c0f-db7a9e1b129a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:15:02.014794 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 467/929] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:15:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:15:02.021111 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e927a2e-3198-470a-933f-f2cc4e649172 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:15:02.075155 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:15:02.127302 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e927a2e-3198-470a-933f-f2cc4e649172 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:15:02.164884 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0d8b3-1bb8-4b14-bcea-09faa59ecd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:15:02.165628 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0d8b3-1bb8-4b14-bcea-09faa59ecd64 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:02.165917 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0d8b3-1bb8-4b14-bcea-09faa59ecd64 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:02.166189 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0d8b3-1bb8-4b14-bcea-09faa59ecd64 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:02.174206 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f0d8b3-1bb8-4b14-bcea-09faa59ecd64 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:15:02.176024 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f0d8b3-1bb8-4b14-bcea-09faa59ecd64 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:15:02.193996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-33f0d8b3-1bb8-4b14-bcea-09faa59ecd64 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 27 13:15:02.193996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:15:02.193996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:15:02.193996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:15:02.193996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:15:02.193996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:15:02.193996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:15:02.193996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:15:02.193996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:15:02.193996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:15:02.193996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:15:02.193996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:15:02.193996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 13:15:02.193996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 13:15:02.193996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 13:15:02.193996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 13:15:02.195134 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:15:02.195134 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:15:02.195134 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 13:15:02.195134 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:15:02.195134 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 13:15:02.195134 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:15:02.195134 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:15:02.195134 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:15:02.195134 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:15:02.195134 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:15:02.195134 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:15:02.195134 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:15:02.195134 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:15:02.195134 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:15:02.195134 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:15:02.195134 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:15:02.195134 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:15:02.195134 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:15:02.196295 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:15:02.196295 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:15:02.196295 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 13:15:02.196295 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 13:15:02.196295 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 13:15:02.196295 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 13:15:02.196295 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 13:15:02.196295 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 13:15:02.196295 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 27 13:15:02.196295 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:15:02.196295 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 463/930] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:15:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:15:02.204184 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eeaae0-6e8f-4c3d-9c0f-db7a9e1b129a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:15:02.318507 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eeaae0-6e8f-4c3d-9c0f-db7a9e1b129a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:15:02.355538 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4059204-2f6b-4689-9e3b-246457a48d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:15:02.356197 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4059204-2f6b-4689-9e3b-246457a48d47 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:02.356479 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4059204-2f6b-4689-9e3b-246457a48d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:02.356743 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4059204-2f6b-4689-9e3b-246457a48d47 None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:02.357573 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4059204-2f6b-4689-9e3b-246457a48d47 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:15:02.357854 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4059204-2f6b-4689-9e3b-246457a48d47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:15:02.359321 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4059204-2f6b-4689-9e3b-246457a48d47 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:15:02.376907 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 468/931] 10.222.0.52 () {56 vars in 1143 bytes} [Thu Oct 27 13:15:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:15:02.382982 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0d8b3-1bb8-4b14-bcea-09faa59ecd64 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:15:02.488385 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0d8b3-1bb8-4b14-bcea-09faa59ecd64 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:15:02.499339 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:15:02.526303 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0683af61-f851-42f2-ab6b-270b93007f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:15:02.526916 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683af61-f851-42f2-ab6b-270b93007f6a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:02.527192 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683af61-f851-42f2-ab6b-270b93007f6a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:02.527461 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683af61-f851-42f2-ab6b-270b93007f6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:02.595633 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0683af61-f851-42f2-ab6b-270b93007f6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:15:02.597146 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0683af61-f851-42f2-ab6b-270b93007f6a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:15:02.699673 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 464/932] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Oct 27 13:15:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 27 13:15:02.708017 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4059204-2f6b-4689-9e3b-246457a48d47 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:15:02.744255 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:15:02.818186 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4059204-2f6b-4689-9e3b-246457a48d47 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:15:02.854585 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76032d2-2e2f-4ca3-96fa-9e0627d8956f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:15:02.855223 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76032d2-2e2f-4ca3-96fa-9e0627d8956f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:02.855507 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76032d2-2e2f-4ca3-96fa-9e0627d8956f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:02.855775 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76032d2-2e2f-4ca3-96fa-9e0627d8956f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:02.867014 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76032d2-2e2f-4ca3-96fa-9e0627d8956f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:15:02.868678 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76032d2-2e2f-4ca3-96fa-9e0627d8956f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:15:02.885078 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-e76032d2-2e2f-4ca3-96fa-9e0627d8956f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:15:02.885078 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:15:02.885078 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:15:02.885078 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:15:02.885078 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:15:02.885078 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:15:02.885078 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:15:02.885078 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:15:02.885078 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:15:02.885078 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:15:02.885078 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:15:02.885078 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:15:02.885078 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:15:02.885078 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:15:02.885078 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:15:02.885078 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:15:02.886334 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:15:02.886334 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:15:02.886334 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:15:02.886334 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:15:02.886334 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:15:02.886334 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:15:02.886334 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:15:02.886334 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:15:02.886334 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:15:02.886334 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:15:02.886334 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:15:02.886334 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:15:02.886334 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:15:02.886334 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:15:02.886334 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:15:02.886334 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:15:02.886334 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:15:02.887397 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:15:02.887397 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:15:02.887397 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:15:02.887397 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 469/933] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:15:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:15:02.892572 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0683af61-f851-42f2-ab6b-270b93007f6a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:15:02.905802 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:15:03.000642 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0683af61-f851-42f2-ab6b-270b93007f6a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:15:03.036170 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fac1da-716a-4d56-bd67-3008e66ff2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:15:03.036881 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fac1da-716a-4d56-bd67-3008e66ff2fc None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:03.037153 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fac1da-716a-4d56-bd67-3008e66ff2fc None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:03.037488 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fac1da-716a-4d56-bd67-3008e66ff2fc None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:03.038387 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fac1da-716a-4d56-bd67-3008e66ff2fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:15:03.038752 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fac1da-716a-4d56-bd67-3008e66ff2fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:15:03.040247 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fac1da-716a-4d56-bd67-3008e66ff2fc None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:15:03.052439 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 465/934] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:15:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:15:03.058427 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76032d2-2e2f-4ca3-96fa-9e0627d8956f None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:15:03.148521 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:15:03.167827 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76032d2-2e2f-4ca3-96fa-9e0627d8956f None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:15:03.207024 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b5c19-d202-4459-a525-0420fcd12ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:15:03.207742 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b5c19-d202-4459-a525-0420fcd12ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:03.208029 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b5c19-d202-4459-a525-0420fcd12ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:03.208347 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b5c19-d202-4459-a525-0420fcd12ec5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:03.215863 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72b5c19-d202-4459-a525-0420fcd12ec5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:15:03.217483 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72b5c19-d202-4459-a525-0420fcd12ec5 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:15:03.229428 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-d72b5c19-d202-4459-a525-0420fcd12ec5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:15:03.229428 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:15:03.229428 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:15:03.229428 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:15:03.229428 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:15:03.229428 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:15:03.229428 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:15:03.229428 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:15:03.229428 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:15:03.229428 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:15:03.229428 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:15:03.229428 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:15:03.229428 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 13:15:03.229428 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 13:15:03.229428 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 13:15:03.230462 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 13:15:03.230462 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:15:03.230462 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:15:03.230462 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:15:03.230462 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:15:03.230462 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:15:03.230462 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:15:03.230462 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:15:03.230462 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:15:03.230462 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:15:03.230462 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:15:03.230462 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:15:03.230462 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:15:03.230462 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:15:03.230462 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:15:03.230462 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:15:03.230462 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:15:03.231354 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 13:15:03.231354 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 13:15:03.231354 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 13:15:03.231354 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 13:15:03.231354 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 13:15:03.231354 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 13:15:03.231354 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:15:03.231354 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:15:03.231354 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 470/935] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Oct 27 13:15:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:15:03.237001 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fac1da-716a-4d56-bd67-3008e66ff2fc None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:15:03.314162 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:15:03.348228 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fac1da-716a-4d56-bd67-3008e66ff2fc None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:15:03.387249 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0137477c-9206-4649-a67a-cb4907cfd321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:15:03.387900 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137477c-9206-4649-a67a-cb4907cfd321 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:03.388176 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137477c-9206-4649-a67a-cb4907cfd321 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:03.388493 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137477c-9206-4649-a67a-cb4907cfd321 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:03.389233 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0137477c-9206-4649-a67a-cb4907cfd321 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:15:03.389557 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0137477c-9206-4649-a67a-cb4907cfd321 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:15:03.391174 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0137477c-9206-4649-a67a-cb4907cfd321 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:15:03.405644 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 466/936] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Oct 27 13:15:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:15:03.412620 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b5c19-d202-4459-a525-0420fcd12ec5 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:15:03.534081 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b5c19-d202-4459-a525-0420fcd12ec5 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:15:03.571046 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129dde02-9f0b-4f3b-98b0-aced5e700111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:15:03.571614 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129dde02-9f0b-4f3b-98b0-aced5e700111 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:03.571851 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129dde02-9f0b-4f3b-98b0-aced5e700111 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:03.572115 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129dde02-9f0b-4f3b-98b0-aced5e700111 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:03.572833 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129dde02-9f0b-4f3b-98b0-aced5e700111 None admin] RBAC: Adding query filter params (role.id=75936ae3accd49cb935acc7c628e2136, scope.project.id=0be19dd5a0df4cf79fe2ec14d11521f0, user.id=cbcd6da4e42248a3b38101104fbc03cc) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:15:03.573131 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129dde02-9f0b-4f3b-98b0-aced5e700111 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:15:03.574616 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129dde02-9f0b-4f3b-98b0-aced5e700111 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:15:03.580829 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 471/937] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Oct 27 13:15:03 2022] GET /identity/v3/role_assignments?user.id=cbcd6da4e42248a3b38101104fbc03cc&scope.project.id=0be19dd5a0df4cf79fe2ec14d11521f0&role.id=75936ae3accd49cb935acc7c628e2136 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:15:05.729223 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c3b1f-f7fb-412a-bbc7-0bb178bf8659 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:05.729842 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c3b1f-f7fb-412a-bbc7-0bb178bf8659 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:05.729842 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c3b1f-f7fb-412a-bbc7-0bb178bf8659 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:05.731874 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 467/938] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:15:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:15:05.737646 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f24306-f5f1-41cc-829b-1aa948477a53 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:05.738131 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f24306-f5f1-41cc-829b-1aa948477a53 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:05.738224 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f24306-f5f1-41cc-829b-1aa948477a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:05.758737 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-a7f24306-f5f1-41cc-829b-1aa948477a53 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:15:05.760072 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a7f24306-f5f1-41cc-829b-1aa948477a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:15:05.763283 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:15:05.835826 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 472/939] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:15:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 13:15:06.101901 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c3b1f-f7fb-412a-bbc7-0bb178bf8659 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:15:06.218801 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c3b1f-f7fb-412a-bbc7-0bb178bf8659 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:15:06.250827 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:15:06.257446 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81494a02-d4e5-4ff9-ac68-ffd44c33ffaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:15:06.258281 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81494a02-d4e5-4ff9-ac68-ffd44c33ffaf None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:06.258564 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81494a02-d4e5-4ff9-ac68-ffd44c33ffaf None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:06.258869 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81494a02-d4e5-4ff9-ac68-ffd44c33ffaf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:06.270509 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81494a02-d4e5-4ff9-ac68-ffd44c33ffaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:15:06.275549 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-81494a02-d4e5-4ff9-ac68-ffd44c33ffaf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:15:06.275549 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:15:06.275549 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:15:06.275549 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:15:06.275549 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:15:06.275549 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:15:06.275549 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:15:06.275549 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:15:06.275549 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:15:06.275549 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:15:06.275549 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:15:06.275549 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:15:06.275549 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:15:06.275549 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:15:06.275549 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:15:06.275549 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:15:06.276764 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:15:06.276764 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:15:06.276764 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:15:06.276764 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:15:06.276764 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:15:06.276764 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:15:06.276764 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:15:06.276764 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:15:06.276764 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:15:06.276764 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:15:06.276764 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:15:06.276764 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:15:06.276764 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:15:06.276764 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:15:06.276764 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:15:06.276764 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:15:06.277671 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:15:06.277671 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:15:06.277671 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:15:06.277671 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:15:06.277671 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:15:06.277671 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:15:06.277671 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:15:06.277671 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:15:06.277671 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:15:06.277671 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:15:06.277671 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:15:06.277671 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:15:06.277671 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 468/940] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Oct 27 13:15:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:15:06.283422 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f24306-f5f1-41cc-829b-1aa948477a53 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:15:06.397147 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f24306-f5f1-41cc-829b-1aa948477a53 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:15:06.436960 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fcf848-a26e-45ba-bbb2-bc8756bdd61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:15:06.437602 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcf848-a26e-45ba-bbb2-bc8756bdd61b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:06.439177 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcf848-a26e-45ba-bbb2-bc8756bdd61b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:06.439177 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcf848-a26e-45ba-bbb2-bc8756bdd61b None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:06.439177 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fcf848-a26e-45ba-bbb2-bc8756bdd61b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:15:06.439177 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fcf848-a26e-45ba-bbb2-bc8756bdd61b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:15:06.440731 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fcf848-a26e-45ba-bbb2-bc8756bdd61b None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:15:06.449482 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 473/941] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Oct 27 13:15:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:15:06.455526 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81494a02-d4e5-4ff9-ac68-ffd44c33ffaf None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:15:06.566117 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81494a02-d4e5-4ff9-ac68-ffd44c33ffaf None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:15:06.602277 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e66ccf-ec67-4b52-b5d6-8c374a8390b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:15:06.603009 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e66ccf-ec67-4b52-b5d6-8c374a8390b2 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:06.603308 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e66ccf-ec67-4b52-b5d6-8c374a8390b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:06.603555 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e66ccf-ec67-4b52-b5d6-8c374a8390b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:06.614738 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e66ccf-ec67-4b52-b5d6-8c374a8390b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:15:06.616258 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e66ccf-ec67-4b52-b5d6-8c374a8390b2 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:15:06.632446 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-a6e66ccf-ec67-4b52-b5d6-8c374a8390b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:15:06.632446 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:15:06.632446 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:15:06.632446 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:15:06.632446 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:15:06.632446 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:15:06.632446 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:15:06.632446 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:15:06.632446 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:15:06.632446 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:15:06.632446 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:15:06.632446 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:15:06.632446 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:15:06.632446 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:15:06.632446 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:15:06.632446 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:15:06.633503 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:15:06.633503 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:15:06.633503 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:15:06.633503 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:15:06.633503 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:15:06.633503 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:15:06.633503 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:15:06.633503 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:15:06.633503 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:15:06.633503 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:15:06.633503 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:15:06.633503 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:15:06.633503 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:15:06.633503 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:15:06.633503 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:15:06.633503 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:15:06.633503 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:15:06.634692 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:15:06.634692 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:15:06.634692 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:15:06.634692 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 469/942] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:15:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:15:06.639951 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fcf848-a26e-45ba-bbb2-bc8756bdd61b None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:15:06.643638 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:15:06.753614 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fcf848-a26e-45ba-bbb2-bc8756bdd61b None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:15:06.792987 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7538c-d2d3-4104-820d-483fa25f9743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:15:06.793646 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7538c-d2d3-4104-820d-483fa25f9743 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:06.793933 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7538c-d2d3-4104-820d-483fa25f9743 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:06.794242 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7538c-d2d3-4104-820d-483fa25f9743 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:06.794954 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c7538c-d2d3-4104-820d-483fa25f9743 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:15:06.795263 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c7538c-d2d3-4104-820d-483fa25f9743 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:15:06.796846 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c7538c-d2d3-4104-820d-483fa25f9743 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:15:06.810831 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 474/943] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:15:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:15:06.816889 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e66ccf-ec67-4b52-b5d6-8c374a8390b2 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:15:06.866903 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:15:06.940147 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e66ccf-ec67-4b52-b5d6-8c374a8390b2 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:15:06.977201 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32c0bc-e5a9-4d87-9514-575cc988a8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:15:06.977889 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32c0bc-e5a9-4d87-9514-575cc988a8e2 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:06.978192 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32c0bc-e5a9-4d87-9514-575cc988a8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:06.978563 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32c0bc-e5a9-4d87-9514-575cc988a8e2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:06.987590 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd32c0bc-e5a9-4d87-9514-575cc988a8e2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:15:06.989209 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd32c0bc-e5a9-4d87-9514-575cc988a8e2 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:15:07.002104 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-fd32c0bc-e5a9-4d87-9514-575cc988a8e2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 27 13:15:07.002104 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:15:07.002104 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:15:07.002104 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:15:07.002104 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:15:07.002104 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:15:07.002104 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:15:07.002104 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:15:07.002104 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:15:07.002104 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:15:07.002104 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:15:07.002104 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:15:07.002104 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 13:15:07.002104 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 13:15:07.002104 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 13:15:07.002104 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 13:15:07.003455 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:15:07.003455 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:15:07.003455 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 13:15:07.003455 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:15:07.003455 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 13:15:07.003455 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:15:07.003455 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:15:07.003455 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:15:07.003455 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:15:07.003455 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:15:07.003455 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:15:07.003455 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:15:07.003455 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:15:07.003455 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:15:07.003455 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:15:07.003455 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:15:07.003455 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:15:07.003455 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:15:07.004461 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:15:07.004461 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:15:07.004461 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 13:15:07.004461 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 13:15:07.004461 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 13:15:07.004461 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 13:15:07.004461 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 13:15:07.004461 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 13:15:07.004461 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 27 13:15:07.004461 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:15:07.004461 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 470/944] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:15:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:15:07.010004 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7538c-d2d3-4104-820d-483fa25f9743 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:15:07.078732 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:15:07.120339 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7538c-d2d3-4104-820d-483fa25f9743 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:15:07.157086 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1e344-571d-4dd4-a0dd-2d2deeac0451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:15:07.157723 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1e344-571d-4dd4-a0dd-2d2deeac0451 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:07.157997 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1e344-571d-4dd4-a0dd-2d2deeac0451 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:07.158262 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1e344-571d-4dd4-a0dd-2d2deeac0451 None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:07.159479 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c1e344-571d-4dd4-a0dd-2d2deeac0451 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:15:07.159758 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c1e344-571d-4dd4-a0dd-2d2deeac0451 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:15:07.161321 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c1e344-571d-4dd4-a0dd-2d2deeac0451 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:15:07.185471 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 475/945] 10.222.0.52 () {56 vars in 1143 bytes} [Thu Oct 27 13:15:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:15:07.186802 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32c0bc-e5a9-4d87-9514-575cc988a8e2 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:15:07.302199 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32c0bc-e5a9-4d87-9514-575cc988a8e2 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:15:07.303664 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:15:07.337696 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651e1f0-3af3-430e-8374-3db180fef258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:15:07.338322 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651e1f0-3af3-430e-8374-3db180fef258 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:07.338648 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651e1f0-3af3-430e-8374-3db180fef258 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:07.338998 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651e1f0-3af3-430e-8374-3db180fef258 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:07.351136 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9651e1f0-3af3-430e-8374-3db180fef258 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:15:07.352609 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9651e1f0-3af3-430e-8374-3db180fef258 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:15:07.369345 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-9651e1f0-3af3-430e-8374-3db180fef258 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:15:07.369345 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:15:07.369345 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:15:07.369345 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:15:07.369345 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:15:07.369345 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:15:07.369345 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:15:07.369345 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:15:07.369345 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:15:07.369345 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:15:07.369345 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:15:07.369345 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:15:07.369345 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:15:07.369345 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:15:07.369345 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:15:07.369345 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:15:07.370562 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:15:07.370562 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:15:07.370562 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:15:07.370562 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:15:07.370562 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:15:07.370562 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:15:07.370562 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:15:07.370562 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:15:07.370562 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:15:07.370562 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:15:07.370562 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:15:07.370562 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:15:07.370562 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:15:07.370562 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:15:07.370562 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:15:07.370562 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:15:07.370562 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:15:07.371507 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:15:07.371507 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:15:07.371507 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:15:07.371507 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 471/946] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:15:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:15:07.376671 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1e344-571d-4dd4-a0dd-2d2deeac0451 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:15:07.491885 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1e344-571d-4dd4-a0dd-2d2deeac0451 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:15:07.517401 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:15:07.535763 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012960dd-05af-47c4-a3a4-91e621743cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:15:07.536499 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012960dd-05af-47c4-a3a4-91e621743cce None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:07.536800 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012960dd-05af-47c4-a3a4-91e621743cce None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:07.537306 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012960dd-05af-47c4-a3a4-91e621743cce None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:07.537964 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012960dd-05af-47c4-a3a4-91e621743cce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:15:07.538273 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012960dd-05af-47c4-a3a4-91e621743cce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:15:07.539996 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012960dd-05af-47c4-a3a4-91e621743cce None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:15:07.553938 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 476/947] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:15:07.560211 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651e1f0-3af3-430e-8374-3db180fef258 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:15:07.668773 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651e1f0-3af3-430e-8374-3db180fef258 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:15:07.704574 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde4a69-5c2c-43af-aec1-edcdc72d1463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:15:07.705236 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde4a69-5c2c-43af-aec1-edcdc72d1463 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:07.705598 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde4a69-5c2c-43af-aec1-edcdc72d1463 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:07.705868 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde4a69-5c2c-43af-aec1-edcdc72d1463 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:07.713615 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde4a69-5c2c-43af-aec1-edcdc72d1463 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:15:07.715258 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde4a69-5c2c-43af-aec1-edcdc72d1463 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:15:07.727767 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-0cde4a69-5c2c-43af-aec1-edcdc72d1463 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:15:07.727767 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:15:07.727767 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:15:07.727767 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:15:07.727767 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:15:07.727767 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:15:07.727767 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:15:07.727767 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:15:07.727767 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:15:07.727767 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:15:07.727767 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:15:07.727767 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:15:07.727767 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 13:15:07.727767 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 13:15:07.727767 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 13:15:07.728904 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 13:15:07.728904 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:15:07.728904 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:15:07.728904 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:15:07.728904 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:15:07.728904 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:15:07.728904 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:15:07.728904 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:15:07.728904 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:15:07.728904 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:15:07.728904 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:15:07.728904 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:15:07.728904 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:15:07.728904 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:15:07.728904 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:15:07.728904 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:15:07.728904 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:15:07.730205 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 13:15:07.730205 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 13:15:07.730205 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 13:15:07.730205 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 13:15:07.730205 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 13:15:07.730205 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 13:15:07.730205 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:15:07.730205 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:15:07.730205 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 472/948] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Oct 27 13:15:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:15:07.735295 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012960dd-05af-47c4-a3a4-91e621743cce None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:15:07.849389 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012960dd-05af-47c4-a3a4-91e621743cce None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:15:07.887331 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d4377-83f5-4685-a93b-7ed08fa8b0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:15:07.887939 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d4377-83f5-4685-a93b-7ed08fa8b0d5 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:07.888213 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d4377-83f5-4685-a93b-7ed08fa8b0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:07.888479 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d4377-83f5-4685-a93b-7ed08fa8b0d5 None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:07.889164 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d4377-83f5-4685-a93b-7ed08fa8b0d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:15:07.889497 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d4377-83f5-4685-a93b-7ed08fa8b0d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:15:07.890933 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d4377-83f5-4685-a93b-7ed08fa8b0d5 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:15:07.904395 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 477/949] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Oct 27 13:15:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:15:07.911114 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde4a69-5c2c-43af-aec1-edcdc72d1463 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:15:07.928742 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:15:08.020519 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde4a69-5c2c-43af-aec1-edcdc72d1463 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:15:08.056144 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62806fbb-410c-4f41-b305-1d5cc78bb115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:15:08.056808 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62806fbb-410c-4f41-b305-1d5cc78bb115 None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:08.057081 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62806fbb-410c-4f41-b305-1d5cc78bb115 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:08.057349 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62806fbb-410c-4f41-b305-1d5cc78bb115 None admin] PATH_INFO: `/v3/projects/0be19dd5a0df4cf79fe2ec14d11521f0/users/cbcd6da4e42248a3b38101104fbc03cc/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:08.059599 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62806fbb-410c-4f41-b305-1d5cc78bb115 None admin] RBAC: Authorizing `identity:create_grant(project_id=0be19dd5a0df4cf79fe2ec14d11521f0, user_id=cbcd6da4e42248a3b38101104fbc03cc, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:15:08.061078 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62806fbb-410c-4f41-b305-1d5cc78bb115 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:15:08.076086 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 473/950] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Oct 27 13:15:07 2022] PUT /identity/v3/projects/0be19dd5a0df4cf79fe2ec14d11521f0/users/cbcd6da4e42248a3b38101104fbc03cc/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:15:10.217331 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede13d4-3adb-4830-96c3-28501e68ead7 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:10.218030 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede13d4-3adb-4830-96c3-28501e68ead7 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:10.218030 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede13d4-3adb-4830-96c3-28501e68ead7 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:10.219358 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 478/951] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 13:15:10.224863 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532a737-edea-45b5-bbca-aa3866c9511a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:10.225278 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532a737-edea-45b5-bbca-aa3866c9511a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:10.225389 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532a737-edea-45b5-bbca-aa3866c9511a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:10.243292 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-b532a737-edea-45b5-bbca-aa3866c9511a None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:15:10.244450 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b532a737-edea-45b5-bbca-aa3866c9511a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:15:10.321814 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 474/952] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:15:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 13:15:10.624965 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede13d4-3adb-4830-96c3-28501e68ead7 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:15:10.673760 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:15:10.741937 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede13d4-3adb-4830-96c3-28501e68ead7 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:15:10.781400 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb994a2-ec7d-4865-b3f2-9a5d3c96ae6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:15:10.782014 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb994a2-ec7d-4865-b3f2-9a5d3c96ae6a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:10.782282 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb994a2-ec7d-4865-b3f2-9a5d3c96ae6a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:10.782552 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb994a2-ec7d-4865-b3f2-9a5d3c96ae6a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:10.796707 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb994a2-ec7d-4865-b3f2-9a5d3c96ae6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 13:15:10.801734 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-7eb994a2-ec7d-4865-b3f2-9a5d3c96ae6a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:15:10.801734 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:15:10.801734 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:15:10.801734 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:15:10.801734 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:15:10.801734 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:15:10.801734 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:15:10.801734 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:15:10.801734 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:15:10.801734 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:15:10.801734 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:15:10.801734 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:15:10.801734 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 13:15:10.801734 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 13:15:10.801734 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 13:15:10.801734 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 13:15:10.802901 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 13:15:10.802901 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 13:15:10.802901 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 13:15:10.802901 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 13:15:10.802901 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:15:10.802901 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:15:10.802901 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:15:10.802901 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:15:10.802901 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:15:10.802901 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:15:10.802901 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:15:10.802901 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:15:10.802901 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:15:10.802901 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:15:10.802901 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:15:10.802901 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:15:10.804534 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:15:10.804534 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:15:10.804534 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:15:10.804534 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:15:10.804534 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 13:15:10.804534 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 13:15:10.804534 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 13:15:10.804534 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 13:15:10.804534 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 13:15:10.804534 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 13:15:10.804534 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:15:10.804534 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:15:10.804534 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 479/953] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Oct 27 13:15:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:15:10.809650 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532a737-edea-45b5-bbca-aa3866c9511a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:15:10.813564 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:15:10.913822 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532a737-edea-45b5-bbca-aa3866c9511a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:15:10.948585 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a746455-9eca-437e-9154-cc5863d86f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:15:10.949634 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a746455-9eca-437e-9154-cc5863d86f92 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:10.949634 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a746455-9eca-437e-9154-cc5863d86f92 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:10.949820 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a746455-9eca-437e-9154-cc5863d86f92 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:10.950420 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a746455-9eca-437e-9154-cc5863d86f92 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:15:10.950723 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a746455-9eca-437e-9154-cc5863d86f92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:15:10.952106 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a746455-9eca-437e-9154-cc5863d86f92 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:15:10.960835 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 475/954] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Oct 27 13:15:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:15:10.967719 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb994a2-ec7d-4865-b3f2-9a5d3c96ae6a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:15:11.073928 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:15:11.076840 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb994a2-ec7d-4865-b3f2-9a5d3c96ae6a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:15:11.113714 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391cc9ab-3744-4463-9090-ac8f4c7f061c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:15:11.114361 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391cc9ab-3744-4463-9090-ac8f4c7f061c None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:11.114610 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391cc9ab-3744-4463-9090-ac8f4c7f061c None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:11.114874 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391cc9ab-3744-4463-9090-ac8f4c7f061c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:11.125000 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391cc9ab-3744-4463-9090-ac8f4c7f061c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:15:11.126491 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391cc9ab-3744-4463-9090-ac8f4c7f061c None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:15:11.141276 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-391cc9ab-3744-4463-9090-ac8f4c7f061c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:15:11.141276 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:15:11.141276 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:15:11.141276 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:15:11.141276 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:15:11.141276 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:15:11.141276 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:15:11.141276 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:15:11.141276 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:15:11.141276 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:15:11.141276 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:15:11.141276 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:15:11.141276 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:15:11.141276 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:15:11.141276 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:15:11.141276 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:15:11.142544 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:15:11.142544 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:15:11.142544 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:15:11.142544 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:15:11.142544 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:15:11.142544 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:15:11.142544 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:15:11.142544 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:15:11.142544 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:15:11.142544 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:15:11.142544 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:15:11.142544 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:15:11.142544 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:15:11.142544 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:15:11.142544 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:15:11.142544 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:15:11.142544 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:15:11.143655 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:15:11.143655 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:15:11.143655 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:15:11.143655 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 480/955] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:15:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:15:11.148920 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a746455-9eca-437e-9154-cc5863d86f92 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:15:11.216413 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:15:11.251335 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a746455-9eca-437e-9154-cc5863d86f92 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:15:11.284609 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ecf80-7f3e-4e6d-8635-c545821e1483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:15:11.285244 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ecf80-7f3e-4e6d-8635-c545821e1483 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:11.285515 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ecf80-7f3e-4e6d-8635-c545821e1483 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:11.285812 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ecf80-7f3e-4e6d-8635-c545821e1483 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:11.286444 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ecf80-7f3e-4e6d-8635-c545821e1483 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:15:11.286753 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ecf80-7f3e-4e6d-8635-c545821e1483 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:15:11.288106 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ecf80-7f3e-4e6d-8635-c545821e1483 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:15:11.300504 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 476/956] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:15:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:15:11.306454 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391cc9ab-3744-4463-9090-ac8f4c7f061c None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:15:11.415978 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391cc9ab-3744-4463-9090-ac8f4c7f061c None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:15:11.450898 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db873c7-3612-4114-9210-5a158da792c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:15:11.451528 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db873c7-3612-4114-9210-5a158da792c2 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:11.451851 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db873c7-3612-4114-9210-5a158da792c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:11.452156 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db873c7-3612-4114-9210-5a158da792c2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:11.460456 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db873c7-3612-4114-9210-5a158da792c2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:15:11.462071 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db873c7-3612-4114-9210-5a158da792c2 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:15:11.474697 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-9db873c7-3612-4114-9210-5a158da792c2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 27 13:15:11.474697 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:15:11.474697 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:15:11.474697 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:15:11.474697 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:15:11.474697 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:15:11.474697 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:15:11.474697 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:15:11.474697 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:15:11.474697 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:15:11.474697 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:15:11.474697 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:15:11.474697 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 13:15:11.474697 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 13:15:11.474697 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 13:15:11.474697 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 13:15:11.475825 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:15:11.475825 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:15:11.475825 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 13:15:11.475825 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:15:11.475825 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 13:15:11.475825 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 13:15:11.475825 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:15:11.475825 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:15:11.475825 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:15:11.475825 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:15:11.475825 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:15:11.475825 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:15:11.475825 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:15:11.475825 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:15:11.475825 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:15:11.475825 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:15:11.475825 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:15:11.475825 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:15:11.477234 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:15:11.477234 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:15:11.477234 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 13:15:11.477234 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 13:15:11.477234 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 13:15:11.477234 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 13:15:11.477234 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 13:15:11.477234 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 13:15:11.477234 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 27 13:15:11.477234 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:15:11.477234 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 481/957] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:15:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:15:11.482258 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ecf80-7f3e-4e6d-8635-c545821e1483 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:15:11.592118 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ecf80-7f3e-4e6d-8635-c545821e1483 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:15:11.617979 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:15:11.627224 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eece264-977f-4a6e-aa1c-19a82a30809e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:15:11.628046 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eece264-977f-4a6e-aa1c-19a82a30809e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:11.628320 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eece264-977f-4a6e-aa1c-19a82a30809e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:11.628591 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eece264-977f-4a6e-aa1c-19a82a30809e None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:11.629316 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eece264-977f-4a6e-aa1c-19a82a30809e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:15:11.629644 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eece264-977f-4a6e-aa1c-19a82a30809e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:15:11.631066 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eece264-977f-4a6e-aa1c-19a82a30809e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:15:11.648519 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 477/958] 10.222.0.52 () {56 vars in 1143 bytes} [Thu Oct 27 13:15:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:15:11.654478 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db873c7-3612-4114-9210-5a158da792c2 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:15:11.670693 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:15:11.764560 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db873c7-3612-4114-9210-5a158da792c2 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:15:11.799780 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70b6d6-f8e3-410d-a488-12a3dc7775cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:15:11.800510 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70b6d6-f8e3-410d-a488-12a3dc7775cd None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:11.800785 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70b6d6-f8e3-410d-a488-12a3dc7775cd None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:11.801149 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70b6d6-f8e3-410d-a488-12a3dc7775cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:11.873848 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70b6d6-f8e3-410d-a488-12a3dc7775cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:15:11.875323 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70b6d6-f8e3-410d-a488-12a3dc7775cd None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:15:11.889914 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:15:11.982506 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 482/959] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Oct 27 13:15:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 27 13:15:11.988855 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eece264-977f-4a6e-aa1c-19a82a30809e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:15:12.098090 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eece264-977f-4a6e-aa1c-19a82a30809e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:15:12.136590 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef16a0-856e-4845-8534-8aa1bfbd12fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:15:12.137256 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef16a0-856e-4845-8534-8aa1bfbd12fa None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:12.137550 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef16a0-856e-4845-8534-8aa1bfbd12fa None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:12.137826 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef16a0-856e-4845-8534-8aa1bfbd12fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:12.151165 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef16a0-856e-4845-8534-8aa1bfbd12fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:15:12.152927 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef16a0-856e-4845-8534-8aa1bfbd12fa None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:15:12.169983 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-4bef16a0-856e-4845-8534-8aa1bfbd12fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:15:12.169983 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:15:12.169983 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:15:12.169983 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:15:12.169983 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:15:12.169983 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:15:12.169983 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:15:12.169983 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:15:12.169983 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:15:12.169983 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:15:12.169983 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:15:12.169983 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:15:12.169983 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 13:15:12.169983 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 13:15:12.169983 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 13:15:12.169983 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 13:15:12.171019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:15:12.171019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:15:12.171019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:15:12.171019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:15:12.171019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:15:12.171019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:15:12.171019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:15:12.171019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:15:12.171019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:15:12.171019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:15:12.171019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:15:12.171019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:15:12.171019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:15:12.171019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:15:12.171019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:15:12.171019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:15:12.171019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 13:15:12.171922 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 13:15:12.171922 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:15:12.171922 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:15:12.171922 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 478/960] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:15:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:15:12.178459 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70b6d6-f8e3-410d-a488-12a3dc7775cd None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:15:12.287714 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70b6d6-f8e3-410d-a488-12a3dc7775cd None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:15:12.301762 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:15:12.324762 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ac4ab-0a10-42e6-8cc5-c42d883868a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:15:12.325673 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ac4ab-0a10-42e6-8cc5-c42d883868a6 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:12.325673 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ac4ab-0a10-42e6-8cc5-c42d883868a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:12.325967 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ac4ab-0a10-42e6-8cc5-c42d883868a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:12.326541 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5ac4ab-0a10-42e6-8cc5-c42d883868a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:15:12.326840 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5ac4ab-0a10-42e6-8cc5-c42d883868a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:15:12.328358 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5ac4ab-0a10-42e6-8cc5-c42d883868a6 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:15:12.340554 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 483/961] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Oct 27 13:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:15:12.346522 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef16a0-856e-4845-8534-8aa1bfbd12fa None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:15:12.383521 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:15:12.451908 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef16a0-856e-4845-8534-8aa1bfbd12fa None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:15:12.492199 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302ce2e-63f3-4266-bd67-cb55c5f3b710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:15:12.493018 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302ce2e-63f3-4266-bd67-cb55c5f3b710 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:12.493274 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302ce2e-63f3-4266-bd67-cb55c5f3b710 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:12.493614 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302ce2e-63f3-4266-bd67-cb55c5f3b710 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:12.503733 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302ce2e-63f3-4266-bd67-cb55c5f3b710 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:15:12.505291 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302ce2e-63f3-4266-bd67-cb55c5f3b710 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:15:12.518156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-e302ce2e-63f3-4266-bd67-cb55c5f3b710 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:15:12.518156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:15:12.518156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:15:12.518156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:15:12.518156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:15:12.518156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:15:12.518156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:15:12.518156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:15:12.518156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:15:12.518156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:15:12.518156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:15:12.518156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:15:12.518156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 13:15:12.518156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 13:15:12.518156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 13:15:12.519516 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 13:15:12.519516 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:15:12.519516 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:15:12.519516 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:15:12.519516 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:15:12.519516 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:15:12.519516 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:15:12.519516 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:15:12.519516 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Oct 27 13:15:12.519516 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:15:12.519516 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:15:12.519516 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:15:12.519516 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:15:12.519516 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:15:12.519516 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:15:12.519516 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:15:12.519516 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:15:12.520739 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 13:15:12.520739 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 13:15:12.520739 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 13:15:12.520739 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 13:15:12.520739 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 13:15:12.520739 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 13:15:12.520739 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:15:12.520739 dv-cinder-862432-3-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Oct 27 13:15:12.520739 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 479/962] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Oct 27 13:15:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:15:12.525870 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ac4ab-0a10-42e6-8cc5-c42d883868a6 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:15:12.635133 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ac4ab-0a10-42e6-8cc5-c42d883868a6 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:15:12.674987 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c8837-6451-4037-98d3-5d56a9cb7e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:15:12.675722 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c8837-6451-4037-98d3-5d56a9cb7e6f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:12.676058 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c8837-6451-4037-98d3-5d56a9cb7e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:12.677822 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c8837-6451-4037-98d3-5d56a9cb7e6f None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:12.678548 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c8837-6451-4037-98d3-5d56a9cb7e6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:15:12.678825 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c8837-6451-4037-98d3-5d56a9cb7e6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:15:12.680299 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c8837-6451-4037-98d3-5d56a9cb7e6f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:15:12.694221 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 484/963] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Oct 27 13:15:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:15:12.700712 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302ce2e-63f3-4266-bd67-cb55c5f3b710 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:15:12.810774 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:15:12.818197 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302ce2e-63f3-4266-bd67-cb55c5f3b710 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:15:12.855361 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ec4ee-27d4-4829-93f8-54588ea5a1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:15:12.855995 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ec4ee-27d4-4829-93f8-54588ea5a1b3 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:12.856272 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ec4ee-27d4-4829-93f8-54588ea5a1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:12.856529 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ec4ee-27d4-4829-93f8-54588ea5a1b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:12.857278 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ec4ee-27d4-4829-93f8-54588ea5a1b3 None admin] RBAC: Adding query filter params (role.id=93bba834c17a4aa7afdc65c002a12975, scope.project.id=0be19dd5a0df4cf79fe2ec14d11521f0, user.id=cbcd6da4e42248a3b38101104fbc03cc) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:15:12.857624 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ec4ee-27d4-4829-93f8-54588ea5a1b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:15:12.859080 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ec4ee-27d4-4829-93f8-54588ea5a1b3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:15:12.866385 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 480/964] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Oct 27 13:15:12 2022] GET /identity/v3/role_assignments?user.id=cbcd6da4e42248a3b38101104fbc03cc&scope.project.id=0be19dd5a0df4cf79fe2ec14d11521f0&role.id=93bba834c17a4aa7afdc65c002a12975 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:15:15.005511 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8627f-7436-4385-9dff-85b2bc7a8aab None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:15.006360 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8627f-7436-4385-9dff-85b2bc7a8aab None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:15.006500 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8627f-7436-4385-9dff-85b2bc7a8aab None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:15.008608 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 485/965] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:15:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:15:15.015121 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18995d6-0887-44c6-a250-2cd63b29ea5e None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:15.015550 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18995d6-0887-44c6-a250-2cd63b29ea5e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:15.015693 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18995d6-0887-44c6-a250-2cd63b29ea5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:15.036025 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d18995d6-0887-44c6-a250-2cd63b29ea5e None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:15:15.037201 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d18995d6-0887-44c6-a250-2cd63b29ea5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:15:15.105991 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 481/966] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:15:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 13:15:15.370475 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8627f-7436-4385-9dff-85b2bc7a8aab None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:15:15.403601 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:15:15.477203 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8627f-7436-4385-9dff-85b2bc7a8aab None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:15:15.511920 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450fa059-4ff7-4da8-82f5-a4bc9db644e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:15:15.512756 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fa059-4ff7-4da8-82f5-a4bc9db644e1 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:15.512984 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fa059-4ff7-4da8-82f5-a4bc9db644e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:15.513313 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fa059-4ff7-4da8-82f5-a4bc9db644e1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:15.514021 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450fa059-4ff7-4da8-82f5-a4bc9db644e1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:15:15.515403 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450fa059-4ff7-4da8-82f5-a4bc9db644e1 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:15:15.524829 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-450fa059-4ff7-4da8-82f5-a4bc9db644e1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 13:15:15.524829 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:15:15.524829 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 13:15:15.524829 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 13:15:15.524829 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 13:15:15.524829 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 13:15:15.524829 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 13:15:15.524829 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:15:15.524829 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 13:15:15.524829 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:15:15.524829 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 13:15:15.524829 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:15:15.524829 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:15:15.524829 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:15:15.524829 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:15:15.524829 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:15:15.524829 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:15:15.526192 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:15:15.526192 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:15:15.526192 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:15:15.526192 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:15:15.526192 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:15:15.526192 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:15:15.526192 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 13:15:15.526192 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 13:15:15.526192 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 13:15:15.526192 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 13:15:15.526192 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:15:15.526192 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:15:15.526192 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:15:15.526192 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:15:15.526192 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:15:15.526192 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:15:15.527233 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:15:15.527233 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:15:15.527233 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:15:15.527233 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:15:15.527233 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:15:15.527233 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:15:15.527233 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:15:15.527233 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:15:15.527233 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:15:15.527233 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:15:15.527233 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 13:15:15.527233 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:15:15.527233 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 13:15:15.527233 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:15:15.527233 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 486/967] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Oct 27 13:15:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:15:15.532313 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18995d6-0887-44c6-a250-2cd63b29ea5e None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:15:15.621897 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:15:15.631599 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18995d6-0887-44c6-a250-2cd63b29ea5e None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:15:15.666462 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e235ba-c1b8-440f-b1f1-4bc32987a645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:15:15.667061 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e235ba-c1b8-440f-b1f1-4bc32987a645 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:15.667335 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e235ba-c1b8-440f-b1f1-4bc32987a645 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:15.667604 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e235ba-c1b8-440f-b1f1-4bc32987a645 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:15.668218 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e235ba-c1b8-440f-b1f1-4bc32987a645 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:15:15.668515 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e235ba-c1b8-440f-b1f1-4bc32987a645 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:15:15.669922 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e235ba-c1b8-440f-b1f1-4bc32987a645 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:15:15.675224 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 482/968] 10.222.0.52 () {56 vars in 1116 bytes} [Thu Oct 27 13:15:15 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:15:15.681664 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450fa059-4ff7-4da8-82f5-a4bc9db644e1 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:15:15.783371 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:15:15.789694 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450fa059-4ff7-4da8-82f5-a4bc9db644e1 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:15:15.827159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc293d-bb3e-4fbb-8cfc-b2a7e64135f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:15:15.827781 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc293d-bb3e-4fbb-8cfc-b2a7e64135f6 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:15.828070 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc293d-bb3e-4fbb-8cfc-b2a7e64135f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:15.828335 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc293d-bb3e-4fbb-8cfc-b2a7e64135f6 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:15.828975 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc293d-bb3e-4fbb-8cfc-b2a7e64135f6 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:15:15.829277 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc293d-bb3e-4fbb-8cfc-b2a7e64135f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:15:15.830796 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc293d-bb3e-4fbb-8cfc-b2a7e64135f6 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:15:15.835482 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 487/969] 10.222.0.52 () {56 vars in 1116 bytes} [Thu Oct 27 13:15:15 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:15:17.959035 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb133f-f30d-4b89-89c1-a49e88e0bfc0 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:17.959608 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb133f-f30d-4b89-89c1-a49e88e0bfc0 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:17.959608 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb133f-f30d-4b89-89c1-a49e88e0bfc0 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:17.960936 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 483/970] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:15:17.967285 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ef657-0277-4d24-888e-3185e9ca132a None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:17.967959 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ef657-0277-4d24-888e-3185e9ca132a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:17.968147 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ef657-0277-4d24-888e-3185e9ca132a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:17.989356 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-1f4ef657-0277-4d24-888e-3185e9ca132a None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:15:17.990568 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1f4ef657-0277-4d24-888e-3185e9ca132a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:15:18.063267 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 488/971] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:15:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 13:15:18.336463 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeb133f-f30d-4b89-89c1-a49e88e0bfc0 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:15:18.459026 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeb133f-f30d-4b89-89c1-a49e88e0bfc0 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:15:18.501168 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd37ef-3d4d-4066-8ec8-63c7d2d13fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:15:18.501766 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd37ef-3d4d-4066-8ec8-63c7d2d13fb8 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:18.502087 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd37ef-3d4d-4066-8ec8-63c7d2d13fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:18.502354 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd37ef-3d4d-4066-8ec8-63c7d2d13fb8 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:18.503015 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabd37ef-3d4d-4066-8ec8-63c7d2d13fb8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:15:18.504393 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabd37ef-3d4d-4066-8ec8-63c7d2d13fb8 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:15:18.520655 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 484/972] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Oct 27 13:15:18 2022] POST /identity/v3/services => generated 246 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:15:20.619501 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9283866-d487-42a4-843c-4083abe7c3ff None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:20.620061 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9283866-d487-42a4-843c-4083abe7c3ff None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:20.620061 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9283866-d487-42a4-843c-4083abe7c3ff None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:20.621386 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 489/973] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:15:20.627727 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564cadbf-6c8c-480c-aad8-169812a2d2b4 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:20.628197 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564cadbf-6c8c-480c-aad8-169812a2d2b4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:20.628290 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564cadbf-6c8c-480c-aad8-169812a2d2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:20.647998 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-564cadbf-6c8c-480c-aad8-169812a2d2b4 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:15:20.649187 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-564cadbf-6c8c-480c-aad8-169812a2d2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:15:20.658830 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:15:20.735755 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 485/974] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:15:20 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 13:15:21.002011 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9283866-d487-42a4-843c-4083abe7c3ff None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:15:21.098079 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:15:21.113549 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9283866-d487-42a4-843c-4083abe7c3ff None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:15:21.148654 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ebcf54-f816-4716-8d79-9d5138cb2afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:15:21.149267 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebcf54-f816-4716-8d79-9d5138cb2afa None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:21.149572 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebcf54-f816-4716-8d79-9d5138cb2afa None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:21.149836 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebcf54-f816-4716-8d79-9d5138cb2afa None admin] PATH_INFO: `/v3/services/placement` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:21.150413 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ebcf54-f816-4716-8d79-9d5138cb2afa None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:15:21.151787 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ebcf54-f816-4716-8d79-9d5138cb2afa None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:15:21.160780 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-40ebcf54-f816-4716-8d79-9d5138cb2afa None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 13:15:21.160780 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:15:21.160780 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 13:15:21.160780 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 13:15:21.160780 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 13:15:21.160780 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 13:15:21.160780 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 13:15:21.160780 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:15:21.160780 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 13:15:21.160780 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:15:21.160780 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 13:15:21.160780 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:15:21.160780 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:15:21.160780 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:15:21.160780 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:15:21.160780 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:15:21.160780 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:15:21.162020 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:15:21.162020 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:15:21.162020 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:15:21.162020 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:15:21.162020 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:15:21.162020 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:15:21.162020 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 13:15:21.162020 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 13:15:21.162020 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 13:15:21.162020 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 13:15:21.162020 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:15:21.162020 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:15:21.162020 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:15:21.162020 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:15:21.162020 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:15:21.162020 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:15:21.163419 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:15:21.163419 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:15:21.163419 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:15:21.163419 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:15:21.163419 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:15:21.163419 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:15:21.163419 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:15:21.163419 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:15:21.163419 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:15:21.163419 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:15:21.163419 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 13:15:21.163419 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:15:21.163419 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 13:15:21.163419 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:15:21.163419 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 490/975] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Oct 27 13:15:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:15:21.171324 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564cadbf-6c8c-480c-aad8-169812a2d2b4 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:15:21.269963 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564cadbf-6c8c-480c-aad8-169812a2d2b4 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:15:21.304620 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09723336-cf9f-41f6-9fc5-10bb78c20f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:15:21.305210 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09723336-cf9f-41f6-9fc5-10bb78c20f2c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:21.305483 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09723336-cf9f-41f6-9fc5-10bb78c20f2c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:21.305788 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09723336-cf9f-41f6-9fc5-10bb78c20f2c None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:21.306398 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09723336-cf9f-41f6-9fc5-10bb78c20f2c None admin] RBAC: Adding query filter params (name=placement) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:15:21.306693 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09723336-cf9f-41f6-9fc5-10bb78c20f2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:15:21.308060 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09723336-cf9f-41f6-9fc5-10bb78c20f2c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:15:21.313558 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 486/976] 10.222.0.52 () {56 vars in 1116 bytes} [Thu Oct 27 13:15:21 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:15:21.320300 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ebcf54-f816-4716-8d79-9d5138cb2afa None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:15:21.427739 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ebcf54-f816-4716-8d79-9d5138cb2afa None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:15:21.465506 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f702d2e-4da2-454b-a101-a87b233ee68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:15:21.466132 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f702d2e-4da2-454b-a101-a87b233ee68e None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:21.466402 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f702d2e-4da2-454b-a101-a87b233ee68e None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:21.466667 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f702d2e-4da2-454b-a101-a87b233ee68e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:21.467352 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f702d2e-4da2-454b-a101-a87b233ee68e None admin] RBAC: Adding query filter params (interface=public, service_id=ba5df8ab5c0d465ea5a723dd6206e500, region_id=RegionOne) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:15:21.467646 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f702d2e-4da2-454b-a101-a87b233ee68e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:15:21.469016 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f702d2e-4da2-454b-a101-a87b233ee68e None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:15:21.474390 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 491/977] 10.222.0.52 () {56 vars in 1251 bytes} [Thu Oct 27 13:15:21 2022] GET /identity/v3/endpoints?service_id=ba5df8ab5c0d465ea5a723dd6206e500&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:15:21.482197 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09723336-cf9f-41f6-9fc5-10bb78c20f2c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:15:21.486684 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:15:21.595803 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09723336-cf9f-41f6-9fc5-10bb78c20f2c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:15:21.634924 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe78ef-56e9-483e-9316-b7f91d0e389a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:15:21.635534 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe78ef-56e9-483e-9316-b7f91d0e389a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:21.635782 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe78ef-56e9-483e-9316-b7f91d0e389a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:21.636048 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe78ef-56e9-483e-9316-b7f91d0e389a None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:21.636649 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe78ef-56e9-483e-9316-b7f91d0e389a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:15:21.638055 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe78ef-56e9-483e-9316-b7f91d0e389a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:15:21.645501 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 487/978] 10.222.0.52 () {56 vars in 1087 bytes} [Thu Oct 27 13:15:21 2022] GET /identity/v3/services => generated 2191 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 13:15:23.769690 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d5337-c0a6-4e22-823e-34b98baa2b47 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:23.770631 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d5337-c0a6-4e22-823e-34b98baa2b47 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:23.770631 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d5337-c0a6-4e22-823e-34b98baa2b47 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:23.772822 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 492/979] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:15:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:15:23.779241 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f07204-fe28-4396-bf78-8c74df9b3ebb None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:23.779699 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f07204-fe28-4396-bf78-8c74df9b3ebb None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:23.779809 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f07204-fe28-4396-bf78-8c74df9b3ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:23.801022 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-c2f07204-fe28-4396-bf78-8c74df9b3ebb None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:15:23.802248 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c2f07204-fe28-4396-bf78-8c74df9b3ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:15:23.866288 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:15:23.872456 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 488/980] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:15:23 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 13:15:24.142005 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d5337-c0a6-4e22-823e-34b98baa2b47 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:15:24.175890 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:15:24.265215 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d5337-c0a6-4e22-823e-34b98baa2b47 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:15:24.301716 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d702c2-057a-490c-9c8e-d562ad10ae01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:15:24.302333 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d702c2-057a-490c-9c8e-d562ad10ae01 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:24.302602 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d702c2-057a-490c-9c8e-d562ad10ae01 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:24.302868 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d702c2-057a-490c-9c8e-d562ad10ae01 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:24.303438 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d702c2-057a-490c-9c8e-d562ad10ae01 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:15:24.304810 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d702c2-057a-490c-9c8e-d562ad10ae01 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:15:24.317051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-b6d702c2-057a-490c-9c8e-d562ad10ae01 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 13:15:24.317051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:15:24.317051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 13:15:24.317051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 13:15:24.317051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 13:15:24.317051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 13:15:24.317051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 13:15:24.317051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:15:24.317051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 13:15:24.317051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:15:24.317051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 13:15:24.317051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:15:24.317051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 13:15:24.317051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 13:15:24.317051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 13:15:24.317051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 13:15:24.317051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 13:15:24.318240 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 13:15:24.318240 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 13:15:24.318240 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 13:15:24.318240 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 13:15:24.318240 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 13:15:24.318240 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 13:15:24.318240 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 13:15:24.318240 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 13:15:24.318240 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 13:15:24.318240 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 13:15:24.318240 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 13:15:24.318240 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 13:15:24.318240 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 13:15:24.318240 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 13:15:24.318240 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 13:15:24.318240 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 13:15:24.319092 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 13:15:24.319092 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Oct 27 13:15:24.319092 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 13:15:24.319092 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Oct 27 13:15:24.319092 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 13:15:24.319092 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 13:15:24.319092 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 13:15:24.319092 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Oct 27 13:15:24.319092 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 13:15:24.319092 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Oct 27 13:15:24.319092 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 13:15:24.319092 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 13:15:24.319092 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 13:15:24.319092 dv-cinder-862432-3-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Oct 27 13:15:24.319092 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 493/981] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Oct 27 13:15:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:15:24.324574 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f07204-fe28-4396-bf78-8c74df9b3ebb None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:15:24.436808 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f07204-fe28-4396-bf78-8c74df9b3ebb None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:15:24.471269 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5423047-1784-4200-9e78-0f998cca680b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:15:24.471871 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5423047-1784-4200-9e78-0f998cca680b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:24.472148 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5423047-1784-4200-9e78-0f998cca680b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:24.472417 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5423047-1784-4200-9e78-0f998cca680b None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:24.473044 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5423047-1784-4200-9e78-0f998cca680b None admin] RBAC: Adding query filter params (name=placement) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:15:24.473346 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5423047-1784-4200-9e78-0f998cca680b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:15:24.474759 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5423047-1784-4200-9e78-0f998cca680b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:15:24.479654 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 489/982] 10.222.0.52 () {56 vars in 1116 bytes} [Thu Oct 27 13:15:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:15:24.486733 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d702c2-057a-490c-9c8e-d562ad10ae01 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:15:24.581270 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:15:24.600564 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d702c2-057a-490c-9c8e-d562ad10ae01 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:15:24.635394 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0af7f6-9fd4-4630-b9d2-8873e958ac5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:15:24.635983 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0af7f6-9fd4-4630-b9d2-8873e958ac5c None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:15:24.636256 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0af7f6-9fd4-4630-b9d2-8873e958ac5c None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:15:24.636486 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0af7f6-9fd4-4630-b9d2-8873e958ac5c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:15:24.637167 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0af7f6-9fd4-4630-b9d2-8873e958ac5c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:15:24.638570 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0af7f6-9fd4-4630-b9d2-8873e958ac5c None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:15:24.666243 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 494/983] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:15:24 2022] POST /identity/v3/endpoints => generated 331 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:15:34.477202 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=69 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:15:34.658147 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:16:28.958265 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd599fa-5fe1-48c0-9e03-bbc4696d91c9 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:16:28.958856 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd599fa-5fe1-48c0-9e03-bbc4696d91c9 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:16:28.958989 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd599fa-5fe1-48c0-9e03-bbc4696d91c9 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:16:28.960448 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 490/984] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 13:16:28.965780 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b03f1-8e99-4fd1-9c17-b9d16764ecff None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:16:28.966257 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b03f1-8e99-4fd1-9c17-b9d16764ecff None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:16:28.966338 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b03f1-8e99-4fd1-9c17-b9d16764ecff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:16:29.091602 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-2c0b03f1-8e99-4fd1-9c17-b9d16764ecff None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:16:29.092955 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2c0b03f1-8e99-4fd1-9c17-b9d16764ecff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:16:29.203542 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 495/985] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:16:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:16:29.522167 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5841b9-4842-4d67-a661-ff098e2c2e70 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:16:29.522452 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5841b9-4842-4d67-a661-ff098e2c2e70 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:16:29.523626 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5841b9-4842-4d67-a661-ff098e2c2e70 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:16:29.525243 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 491/986] 10.222.0.52 () {54 vars in 965 bytes} [Thu Oct 27 13:16:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:16:29.533051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b23319-de17-4710-8daf-29e2cde77324 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:16:29.533338 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b23319-de17-4710-8daf-29e2cde77324 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:16:29.533942 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b23319-de17-4710-8daf-29e2cde77324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:16:29.635333 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-c9b23319-de17-4710-8daf-29e2cde77324 None None] MFA Rules not processed for user `d803f074332a4216aee8a38220faa10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:16:29.637845 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c9b23319-de17-4710-8daf-29e2cde77324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:16:29.669047 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:16:29.733409 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 496/987] 10.222.0.52 () {58 vars in 1062 bytes} [Thu Oct 27 13:16:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:16:29.742833 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5841b9-4842-4d67-a661-ff098e2c2e70 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:16:29.744796 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-fa5841b9-4842-4d67-a661-ff098e2c2e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:16:29.863306 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5841b9-4842-4d67-a661-ff098e2c2e70 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:16:29.947028 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8b56f-9433-4d64-9db2-29f89533d8a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:16:29.947813 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8b56f-9433-4d64-9db2-29f89533d8a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:16:29.948188 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8b56f-9433-4d64-9db2-29f89533d8a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:16:29.948558 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8b56f-9433-4d64-9db2-29f89533d8a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:16:29.950299 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-36d8b56f-9433-4d64-9db2-29f89533d8a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:16:30.011507 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:16:30.077795 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8b56f-9433-4d64-9db2-29f89533d8a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:16:30.079444 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8b56f-9433-4d64-9db2-29f89533d8a8 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:16:30.101379 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 492/988] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:16:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:16:32.561917 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce5393-9d02-4b84-8272-bf67388cc24a None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:16:32.562474 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce5393-9d02-4b84-8272-bf67388cc24a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:16:32.562474 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce5393-9d02-4b84-8272-bf67388cc24a None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:16:32.563830 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 497/989] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:16:32.570074 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75626b-44df-49d6-8b8c-41cb5dc654d7 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:16:32.570618 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75626b-44df-49d6-8b8c-41cb5dc654d7 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:16:32.570618 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75626b-44df-49d6-8b8c-41cb5dc654d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:16:32.658354 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-1a75626b-44df-49d6-8b8c-41cb5dc654d7 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:16:32.659558 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1a75626b-44df-49d6-8b8c-41cb5dc654d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:16:32.758538 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 493/990] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:16:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:16:33.058704 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a68c3f-9e10-426c-899a-cf08048e9c78 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:16:33.058986 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a68c3f-9e10-426c-899a-cf08048e9c78 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:16:33.059307 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a68c3f-9e10-426c-899a-cf08048e9c78 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:16:33.061822 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 498/991] 10.222.0.52 () {54 vars in 965 bytes} [Thu Oct 27 13:16:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:16:33.070517 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf46a1-cacf-49d7-8ccf-5915ed682f8b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:16:33.070797 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf46a1-cacf-49d7-8ccf-5915ed682f8b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:16:33.071063 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf46a1-cacf-49d7-8ccf-5915ed682f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:16:33.082925 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:16:33.149070 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-26cf46a1-cacf-49d7-8ccf-5915ed682f8b None None] MFA Rules not processed for user `d803f074332a4216aee8a38220faa10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:16:33.150197 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-26cf46a1-cacf-49d7-8ccf-5915ed682f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:16:33.230017 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 494/992] 10.222.0.52 () {58 vars in 1062 bytes} [Thu Oct 27 13:16:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:16:33.239310 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a68c3f-9e10-426c-899a-cf08048e9c78 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:16:33.240968 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-62a68c3f-9e10-426c-899a-cf08048e9c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:16:33.355123 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a68c3f-9e10-426c-899a-cf08048e9c78 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:16:33.431717 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:16:33.434496 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd07d9-1029-4533-96df-37e5e2ae56e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:16:33.435569 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd07d9-1029-4533-96df-37e5e2ae56e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:16:33.435843 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd07d9-1029-4533-96df-37e5e2ae56e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:16:33.436095 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd07d9-1029-4533-96df-37e5e2ae56e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:16:33.438532 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-dfdd07d9-1029-4533-96df-37e5e2ae56e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:16:33.558251 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdd07d9-1029-4533-96df-37e5e2ae56e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:16:33.559684 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdd07d9-1029-4533-96df-37e5e2ae56e9 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:16:33.579766 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 499/993] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:16:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:16:36.267048 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843daa3-2285-4598-9938-9d50bd6bab22 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:16:36.267821 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843daa3-2285-4598-9938-9d50bd6bab22 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:16:36.267821 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843daa3-2285-4598-9938-9d50bd6bab22 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:16:36.269924 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 495/994] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:16:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:16:36.276475 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13cef8-4fcf-4a38-81f9-cb69ad38a11d None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:16:36.276880 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13cef8-4fcf-4a38-81f9-cb69ad38a11d None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:16:36.277031 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13cef8-4fcf-4a38-81f9-cb69ad38a11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:16:36.359651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-df13cef8-4fcf-4a38-81f9-cb69ad38a11d None None] MFA Rules not processed for user `6ca43f74f2354a7c8dd7ef9c59bdc801`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:16:36.360853 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-df13cef8-4fcf-4a38-81f9-cb69ad38a11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:16:36.418730 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:16:36.465120 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 500/995] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:16:36 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:16:36.747354 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843daa3-2285-4598-9938-9d50bd6bab22 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:16:36.748874 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f843daa3-2285-4598-9938-9d50bd6bab22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:16:36.867915 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843daa3-2285-4598-9938-9d50bd6bab22 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:16:36.870678 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:16:36.954424 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea4c53-7a95-4ff0-963d-4f265e86a554 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:16:36.955063 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea4c53-7a95-4ff0-963d-4f265e86a554 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:16:36.955341 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea4c53-7a95-4ff0-963d-4f265e86a554 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:16:36.955611 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea4c53-7a95-4ff0-963d-4f265e86a554 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:16:36.957199 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a5ea4c53-7a95-4ff0-963d-4f265e86a554 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:16:37.070095 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea4c53-7a95-4ff0-963d-4f265e86a554 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:16:37.071448 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea4c53-7a95-4ff0-963d-4f265e86a554 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:16:37.090527 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 496/996] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:16:36 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:16:39.939813 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bd7ae-529a-4479-9c0e-3a7894509c7e None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:16:39.940673 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bd7ae-529a-4479-9c0e-3a7894509c7e None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:16:39.940673 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bd7ae-529a-4479-9c0e-3a7894509c7e None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:16:39.942969 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 501/997] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:16:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:16:39.948438 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ce31f-37fc-4cb7-aae1-5cf2d8b0335d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:16:39.948859 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ce31f-37fc-4cb7-aae1-5cf2d8b0335d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:16:39.948976 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ce31f-37fc-4cb7-aae1-5cf2d8b0335d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:16:39.990988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:16:40.029003 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-644ce31f-37fc-4cb7-aae1-5cf2d8b0335d None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:16:40.030242 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-644ce31f-37fc-4cb7-aae1-5cf2d8b0335d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:16:40.132821 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 497/998] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:16:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:16:40.427667 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1bd7ae-529a-4479-9c0e-3a7894509c7e None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:16:40.429207 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-db1bd7ae-529a-4479-9c0e-3a7894509c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:16:40.537077 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1bd7ae-529a-4479-9c0e-3a7894509c7e None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:16:40.626548 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c62a3-f6e6-4835-83fb-bd3463c3b26e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:16:40.627156 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c62a3-f6e6-4835-83fb-bd3463c3b26e service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:16:40.627443 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c62a3-f6e6-4835-83fb-bd3463c3b26e service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:16:40.627703 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c62a3-f6e6-4835-83fb-bd3463c3b26e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:16:40.629303 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-527c62a3-f6e6-4835-83fb-bd3463c3b26e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:16:40.636709 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:16:40.745493 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527c62a3-f6e6-4835-83fb-bd3463c3b26e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:16:40.746973 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527c62a3-f6e6-4835-83fb-bd3463c3b26e service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:16:40.765717 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 502/999] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:16:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:16:43.597678 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26179d5-cecb-41a7-a701-6189b73ae269 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:16:43.598329 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26179d5-cecb-41a7-a701-6189b73ae269 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:16:43.598329 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26179d5-cecb-41a7-a701-6189b73ae269 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:16:43.600230 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 498/1000] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:16:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:16:43.605706 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f8e78-c36d-4322-9eb6-fca33715b177 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:16:43.606114 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f8e78-c36d-4322-9eb6-fca33715b177 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:16:43.606245 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f8e78-c36d-4322-9eb6-fca33715b177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:16:43.682169 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-4e7f8e78-c36d-4322-9eb6-fca33715b177 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:16:43.683394 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-4e7f8e78-c36d-4322-9eb6-fca33715b177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:16:43.747860 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:16:43.790956 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 503/1001] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:16:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:16:44.065360 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26179d5-cecb-41a7-a701-6189b73ae269 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:16:44.066963 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d26179d5-cecb-41a7-a701-6189b73ae269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:16:44.175915 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26179d5-cecb-41a7-a701-6189b73ae269 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:16:44.189625 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:16:44.255415 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0263866-e11e-436e-b54b-b0a71622b448 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:16:44.256083 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0263866-e11e-436e-b54b-b0a71622b448 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:16:44.256360 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0263866-e11e-436e-b54b-b0a71622b448 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:16:44.256629 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0263866-e11e-436e-b54b-b0a71622b448 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:16:44.258246 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b0263866-e11e-436e-b54b-b0a71622b448 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:16:44.371409 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0263866-e11e-436e-b54b-b0a71622b448 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:16:44.372872 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0263866-e11e-436e-b54b-b0a71622b448 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:16:44.392310 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 499/1002] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:16:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:16:46.567248 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a7539-80c4-48af-9063-4af7f64937a7 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:16:46.567858 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a7539-80c4-48af-9063-4af7f64937a7 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:16:46.567946 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a7539-80c4-48af-9063-4af7f64937a7 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:16:46.569297 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 504/1003] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:16:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:16:46.574719 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ca8d7-a91a-4064-999a-d1ae3ae1e0f0 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:16:46.575250 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ca8d7-a91a-4064-999a-d1ae3ae1e0f0 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:16:46.575250 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ca8d7-a91a-4064-999a-d1ae3ae1e0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:16:46.625246 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:16:46.652046 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-446ca8d7-a91a-4064-999a-d1ae3ae1e0f0 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:16:46.653262 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-446ca8d7-a91a-4064-999a-d1ae3ae1e0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:16:46.754036 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 500/1004] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:16:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:16:47.029769 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a7539-80c4-48af-9063-4af7f64937a7 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:16:47.031395 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-635a7539-80c4-48af-9063-4af7f64937a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:16:47.137663 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a7539-80c4-48af-9063-4af7f64937a7 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:16:47.217523 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957cd75b-1694-4a25-af54-43b6f397b23d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:16:47.218157 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cd75b-1694-4a25-af54-43b6f397b23d service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:16:47.218426 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cd75b-1694-4a25-af54-43b6f397b23d service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:16:47.218695 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cd75b-1694-4a25-af54-43b6f397b23d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:16:47.220277 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-957cd75b-1694-4a25-af54-43b6f397b23d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:16:47.238083 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:16:47.337646 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957cd75b-1694-4a25-af54-43b6f397b23d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:16:47.339090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957cd75b-1694-4a25-af54-43b6f397b23d service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:16:47.357294 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 505/1005] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:16:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:16:49.541830 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d40c89-2906-445f-9e42-64d2e2ef49a7 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:16:49.542348 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d40c89-2906-445f-9e42-64d2e2ef49a7 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:16:49.542348 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d40c89-2906-445f-9e42-64d2e2ef49a7 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:16:49.543780 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 501/1006] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:16:49.549041 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a935510-52b5-4dbe-acce-a68bb7dc201d None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:16:49.549629 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a935510-52b5-4dbe-acce-a68bb7dc201d None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:16:49.549629 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a935510-52b5-4dbe-acce-a68bb7dc201d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:16:49.617735 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-1a935510-52b5-4dbe-acce-a68bb7dc201d None None] MFA Rules not processed for user `6ca43f74f2354a7c8dd7ef9c59bdc801`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:16:49.618999 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1a935510-52b5-4dbe-acce-a68bb7dc201d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:16:49.687542 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:16:49.722739 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 506/1007] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:16:49 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:16:50.001824 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d40c89-2906-445f-9e42-64d2e2ef49a7 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:16:50.003412 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-88d40c89-2906-445f-9e42-64d2e2ef49a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:16:50.111100 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d40c89-2906-445f-9e42-64d2e2ef49a7 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:16:50.134896 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:16:50.191009 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9498e-38cb-4e10-8eaf-e2cdb7ffadd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:16:50.191614 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9498e-38cb-4e10-8eaf-e2cdb7ffadd2 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:16:50.191895 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9498e-38cb-4e10-8eaf-e2cdb7ffadd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:16:50.192135 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9498e-38cb-4e10-8eaf-e2cdb7ffadd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:16:50.193998 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-94d9498e-38cb-4e10-8eaf-e2cdb7ffadd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:16:50.303913 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d9498e-38cb-4e10-8eaf-e2cdb7ffadd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:16:50.305403 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d9498e-38cb-4e10-8eaf-e2cdb7ffadd2 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:16:50.324884 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 502/1008] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:16:50 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:16:52.707445 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4156e65-54c4-41c0-acaa-fa8a43eed4de None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:16:52.708150 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4156e65-54c4-41c0-acaa-fa8a43eed4de None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:16:52.708150 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4156e65-54c4-41c0-acaa-fa8a43eed4de None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:16:52.709489 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 507/1009] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:16:52.715891 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaeab3c-405f-4075-ad73-f228aebd77b2 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:16:52.716589 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaeab3c-405f-4075-ad73-f228aebd77b2 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:16:52.716837 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaeab3c-405f-4075-ad73-f228aebd77b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:16:52.795630 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:16:52.799724 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-bfaeab3c-405f-4075-ad73-f228aebd77b2 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:16:52.801776 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-bfaeab3c-405f-4075-ad73-f228aebd77b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:16:52.911432 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 503/1010] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:16:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:16:53.205205 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4156e65-54c4-41c0-acaa-fa8a43eed4de None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:16:53.207744 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d4156e65-54c4-41c0-acaa-fa8a43eed4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:16:53.315935 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4156e65-54c4-41c0-acaa-fa8a43eed4de None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:16:53.390932 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94322106-5bd2-4016-8f91-c48797766bc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:16:53.391532 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94322106-5bd2-4016-8f91-c48797766bc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:16:53.391820 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94322106-5bd2-4016-8f91-c48797766bc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:16:53.392066 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94322106-5bd2-4016-8f91-c48797766bc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:16:53.393649 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-94322106-5bd2-4016-8f91-c48797766bc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:16:53.428337 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:16:53.526710 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94322106-5bd2-4016-8f91-c48797766bc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:16:53.528090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94322106-5bd2-4016-8f91-c48797766bc2 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:16:53.546881 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 508/1011] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:16:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:16:55.716003 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5505b0f-a180-4fda-a7d8-f0feb58239c9 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:16:55.716514 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5505b0f-a180-4fda-a7d8-f0feb58239c9 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:16:55.716514 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5505b0f-a180-4fda-a7d8-f0feb58239c9 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:16:55.717914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 504/1012] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 13:16:55.726632 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d8d76-ac74-4e90-9f92-bcda9ad17d74 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:16:55.727338 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d8d76-ac74-4e90-9f92-bcda9ad17d74 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:16:55.727507 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d8d76-ac74-4e90-9f92-bcda9ad17d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:16:55.803065 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-687d8d76-ac74-4e90-9f92-bcda9ad17d74 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:16:55.804682 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-687d8d76-ac74-4e90-9f92-bcda9ad17d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:16:55.888612 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:16:55.912607 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 509/1013] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:16:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:16:56.197448 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5505b0f-a180-4fda-a7d8-f0feb58239c9 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:16:56.199881 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b5505b0f-a180-4fda-a7d8-f0feb58239c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:16:56.312058 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5505b0f-a180-4fda-a7d8-f0feb58239c9 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:16:56.342730 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:16:56.393124 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d6cf1-ca4f-42cc-8cd3-96c305148e80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:16:56.393745 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d6cf1-ca4f-42cc-8cd3-96c305148e80 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:16:56.394014 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d6cf1-ca4f-42cc-8cd3-96c305148e80 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:16:56.394280 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d6cf1-ca4f-42cc-8cd3-96c305148e80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:16:56.395955 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-da4d6cf1-ca4f-42cc-8cd3-96c305148e80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:16:56.511489 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d6cf1-ca4f-42cc-8cd3-96c305148e80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:16:56.512867 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d6cf1-ca4f-42cc-8cd3-96c305148e80 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:16:56.532754 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 505/1014] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:16:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:16:58.995764 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d862a8-90ee-4cf9-94c2-991322ec9158 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:16:58.996673 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d862a8-90ee-4cf9-94c2-991322ec9158 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:16:58.996673 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d862a8-90ee-4cf9-94c2-991322ec9158 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:16:58.998844 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 510/1015] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:16:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:16:59.007581 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9ae0c-563f-4463-b512-65fb1c72aff2 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:16:59.008024 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9ae0c-563f-4463-b512-65fb1c72aff2 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:16:59.008184 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9ae0c-563f-4463-b512-65fb1c72aff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:16:59.087748 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-0ed9ae0c-563f-4463-b512-65fb1c72aff2 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:16:59.088868 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0ed9ae0c-563f-4463-b512-65fb1c72aff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:16:59.097406 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:16:59.209527 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 506/1016] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:16:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:16:59.489963 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d862a8-90ee-4cf9-94c2-991322ec9158 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:16:59.491512 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e8d862a8-90ee-4cf9-94c2-991322ec9158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:16:59.603780 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d862a8-90ee-4cf9-94c2-991322ec9158 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:16:59.687313 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48398db-eba7-46e5-bc89-43ec4e897915 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:16:59.687838 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48398db-eba7-46e5-bc89-43ec4e897915 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:16:59.688108 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48398db-eba7-46e5-bc89-43ec4e897915 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:16:59.688372 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48398db-eba7-46e5-bc89-43ec4e897915 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:16:59.689994 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f48398db-eba7-46e5-bc89-43ec4e897915 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:16:59.726900 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:16:59.804410 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48398db-eba7-46e5-bc89-43ec4e897915 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:16:59.805894 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48398db-eba7-46e5-bc89-43ec4e897915 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:16:59.825048 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 511/1017] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:16:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:17:03.941957 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b56b5f-4be1-4d06-abc6-51fe68fd82a4 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:03.942535 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b56b5f-4be1-4d06-abc6-51fe68fd82a4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:03.942535 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b56b5f-4be1-4d06-abc6-51fe68fd82a4 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:03.944063 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 507/1018] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:17:03.949506 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dbb614-0c78-4e5b-9aa2-7b0eebe87a19 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:03.949951 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dbb614-0c78-4e5b-9aa2-7b0eebe87a19 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:03.950061 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dbb614-0c78-4e5b-9aa2-7b0eebe87a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:04.020594 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-c0dbb614-0c78-4e5b-9aa2-7b0eebe87a19 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:17:04.021833 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c0dbb614-0c78-4e5b-9aa2-7b0eebe87a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:04.112596 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:17:04.124914 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 512/1019] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:17:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:17:04.401042 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b56b5f-4be1-4d06-abc6-51fe68fd82a4 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:17:04.402703 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-12b56b5f-4be1-4d06-abc6-51fe68fd82a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:04.511519 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b56b5f-4be1-4d06-abc6-51fe68fd82a4 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:17:04.552441 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:17:04.590166 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb08cce-ccec-4928-a8dc-e80dfce8ef4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:17:04.590770 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb08cce-ccec-4928-a8dc-e80dfce8ef4b service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:04.591046 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb08cce-ccec-4928-a8dc-e80dfce8ef4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:04.591310 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb08cce-ccec-4928-a8dc-e80dfce8ef4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:04.592863 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cbb08cce-ccec-4928-a8dc-e80dfce8ef4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:04.705054 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb08cce-ccec-4928-a8dc-e80dfce8ef4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:17:04.706538 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb08cce-ccec-4928-a8dc-e80dfce8ef4b service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:17:04.725931 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 508/1020] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:17:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:17:07.513760 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22250cfc-9fde-450a-92ed-116c5471ca0c None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:07.514340 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22250cfc-9fde-450a-92ed-116c5471ca0c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:07.514340 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22250cfc-9fde-450a-92ed-116c5471ca0c None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:07.515668 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 513/1021] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:17:07.521198 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfdaed-9f71-48a9-98a6-fe1668d1e394 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:07.521700 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfdaed-9f71-48a9-98a6-fe1668d1e394 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:07.521791 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfdaed-9f71-48a9-98a6-fe1668d1e394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:07.590322 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-01bfdaed-9f71-48a9-98a6-fe1668d1e394 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:17:07.591505 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-01bfdaed-9f71-48a9-98a6-fe1668d1e394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:07.610936 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:17:07.697694 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 509/1022] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:17:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:17:07.977007 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22250cfc-9fde-450a-92ed-116c5471ca0c None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:17:07.978583 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-22250cfc-9fde-450a-92ed-116c5471ca0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:08.092226 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22250cfc-9fde-450a-92ed-116c5471ca0c None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:17:08.170956 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c74d6-2ef0-4a85-afee-4cc9e9cae716 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:17:08.171554 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c74d6-2ef0-4a85-afee-4cc9e9cae716 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:08.171821 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c74d6-2ef0-4a85-afee-4cc9e9cae716 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:08.172081 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c74d6-2ef0-4a85-afee-4cc9e9cae716 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:08.173686 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ed8c74d6-2ef0-4a85-afee-4cc9e9cae716 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:08.220588 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:17:08.289676 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8c74d6-2ef0-4a85-afee-4cc9e9cae716 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:17:08.291117 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8c74d6-2ef0-4a85-afee-4cc9e9cae716 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:17:08.309778 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 514/1023] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:17:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:17:12.435010 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990a560-d882-4ad3-84b2-a07f5693667d None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:12.435869 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990a560-d882-4ad3-84b2-a07f5693667d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:12.435869 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990a560-d882-4ad3-84b2-a07f5693667d None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:12.437225 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 510/1024] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:17:12.442526 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51a0cd-16f3-4971-b909-2ebeaa3542c7 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:12.442952 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51a0cd-16f3-4971-b909-2ebeaa3542c7 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:12.443071 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51a0cd-16f3-4971-b909-2ebeaa3542c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:12.523916 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-fe51a0cd-16f3-4971-b909-2ebeaa3542c7 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:17:12.525206 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-fe51a0cd-16f3-4971-b909-2ebeaa3542c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:12.623601 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:17:12.625932 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 515/1025] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:17:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:17:12.908052 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990a560-d882-4ad3-84b2-a07f5693667d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:17:12.910507 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f990a560-d882-4ad3-84b2-a07f5693667d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:13.026445 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990a560-d882-4ad3-84b2-a07f5693667d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:17:13.077134 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:17:13.104019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01398eb3-5e68-4a30-b454-9f7e1000e8fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:17:13.104649 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01398eb3-5e68-4a30-b454-9f7e1000e8fa service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:13.104918 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01398eb3-5e68-4a30-b454-9f7e1000e8fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:13.105180 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01398eb3-5e68-4a30-b454-9f7e1000e8fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:13.106797 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-01398eb3-5e68-4a30-b454-9f7e1000e8fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:13.224448 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01398eb3-5e68-4a30-b454-9f7e1000e8fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:17:13.225932 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01398eb3-5e68-4a30-b454-9f7e1000e8fa service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:17:13.243937 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 511/1026] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:17:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:17:18.066783 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2df882-0f1b-4d55-a7ad-0338d59fece9 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:18.067282 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2df882-0f1b-4d55-a7ad-0338d59fece9 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:18.067389 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2df882-0f1b-4d55-a7ad-0338d59fece9 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:18.070058 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 516/1027] 10.222.0.52 () {54 vars in 921 bytes} [Thu Oct 27 13:17:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:17:18.075119 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a77fcb-91d4-4c04-bc5b-31b8979bd5a3 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:18.075544 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a77fcb-91d4-4c04-bc5b-31b8979bd5a3 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:18.075652 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a77fcb-91d4-4c04-bc5b-31b8979bd5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:18.178674 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-91a77fcb-91d4-4c04-bc5b-31b8979bd5a3 None None] MFA Rules not processed for user `cbcd6da4e42248a3b38101104fbc03cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:17:18.179874 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-91a77fcb-91d4-4c04-bc5b-31b8979bd5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:18.237558 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:17:18.359737 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 512/1028] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Oct 27 13:17:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:17:22.513991 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88908e8-f47d-4da9-a808-a2dff83b01e3 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:22.514583 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88908e8-f47d-4da9-a808-a2dff83b01e3 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:22.514823 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88908e8-f47d-4da9-a808-a2dff83b01e3 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:22.516674 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 517/1029] 10.222.0.52 () {54 vars in 921 bytes} [Thu Oct 27 13:17:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:17:22.522168 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24bb21-9001-4b06-b78b-3d77969f84a2 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:22.522595 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24bb21-9001-4b06-b78b-3d77969f84a2 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:22.522708 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24bb21-9001-4b06-b78b-3d77969f84a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:22.604663 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-cd24bb21-9001-4b06-b78b-3d77969f84a2 None None] MFA Rules not processed for user `cbcd6da4e42248a3b38101104fbc03cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:17:22.606067 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cd24bb21-9001-4b06-b78b-3d77969f84a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:22.681255 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:17:22.721649 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 513/1030] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Oct 27 13:17:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:17:24.046056 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1b0c5-a9d1-4013-8d5b-eb6f26ef3b85 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:24.046652 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1b0c5-a9d1-4013-8d5b-eb6f26ef3b85 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:24.046652 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1b0c5-a9d1-4013-8d5b-eb6f26ef3b85 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:24.048013 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 518/1031] 10.222.0.52 () {54 vars in 921 bytes} [Thu Oct 27 13:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:17:24.053434 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac6bd8-d650-4b7e-b2df-597a5355b058 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:24.053957 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac6bd8-d650-4b7e-b2df-597a5355b058 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:24.054066 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac6bd8-d650-4b7e-b2df-597a5355b058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:24.133668 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-a1ac6bd8-d650-4b7e-b2df-597a5355b058 None None] MFA Rules not processed for user `cbcd6da4e42248a3b38101104fbc03cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:17:24.134863 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a1ac6bd8-d650-4b7e-b2df-597a5355b058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:24.245468 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 514/1032] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Oct 27 13:17:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:17:27.705360 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2211f56-e921-4f91-9159-6e6ca9cc4bdc None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:27.706008 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2211f56-e921-4f91-9159-6e6ca9cc4bdc None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:27.706008 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2211f56-e921-4f91-9159-6e6ca9cc4bdc None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:27.707316 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 519/1033] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:17:27.713561 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7345c5-569b-46fc-a925-9497e643ea98 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:27.714067 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7345c5-569b-46fc-a925-9497e643ea98 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:27.714178 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7345c5-569b-46fc-a925-9497e643ea98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:27.754904 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:17:27.790934 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-df7345c5-569b-46fc-a925-9497e643ea98 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:17:27.792376 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-df7345c5-569b-46fc-a925-9497e643ea98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:27.909681 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 515/1034] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:17:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:17:28.198843 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2beef0f-7484-40a4-b209-171b25539967 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:28.199125 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2beef0f-7484-40a4-b209-171b25539967 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:28.199395 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2beef0f-7484-40a4-b209-171b25539967 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:28.200750 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 520/1035] 10.222.0.52 () {54 vars in 961 bytes} [Thu Oct 27 13:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:17:28.208247 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6359f3-32a9-465f-89ab-5c3614f7383a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:28.208644 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6359f3-32a9-465f-89ab-5c3614f7383a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:28.208871 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6359f3-32a9-465f-89ab-5c3614f7383a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:28.286752 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-ed6359f3-32a9-465f-89ab-5c3614f7383a None None] MFA Rules not processed for user `719e4bf834d6490b96066e55a26fb159`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:17:28.287931 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ed6359f3-32a9-465f-89ab-5c3614f7383a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:28.340405 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:17:28.414232 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 516/1036] 10.222.0.52 () {58 vars in 1058 bytes} [Thu Oct 27 13:17:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:17:28.423875 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2beef0f-7484-40a4-b209-171b25539967 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:17:28.425368 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f2beef0f-7484-40a4-b209-171b25539967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:28.583060 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2beef0f-7484-40a4-b209-171b25539967 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:17:28.663383 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:17:28.706073 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8a54e-e5e8-4e5d-b95d-5f3387fde909 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719e4bf834d6490b96066e55a26fb159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:17:28.707512 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8a54e-e5e8-4e5d-b95d-5f3387fde909 service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:28.707959 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8a54e-e5e8-4e5d-b95d-5f3387fde909 service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:28.708410 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8a54e-e5e8-4e5d-b95d-5f3387fde909 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:28.710177 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-bdc8a54e-e5e8-4e5d-b95d-5f3387fde909 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:28.813441 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc8a54e-e5e8-4e5d-b95d-5f3387fde909 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:17:28.815101 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc8a54e-e5e8-4e5d-b95d-5f3387fde909 service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:17:28.834584 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 521/1037] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:17:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:17:31.190494 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47a8de-efb6-463b-9e56-560deb134783 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:31.191109 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47a8de-efb6-463b-9e56-560deb134783 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:31.191109 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47a8de-efb6-463b-9e56-560deb134783 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:31.192451 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 517/1038] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:17:31.198378 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758e515-6ac7-43d3-aafa-83331cc67746 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:31.198832 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758e515-6ac7-43d3-aafa-83331cc67746 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:31.198936 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758e515-6ac7-43d3-aafa-83331cc67746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:31.321093 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-e758e515-6ac7-43d3-aafa-83331cc67746 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:17:31.322316 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e758e515-6ac7-43d3-aafa-83331cc67746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:31.365849 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:17:31.441167 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 522/1039] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:17:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:17:31.722744 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d47a8de-efb6-463b-9e56-560deb134783 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:17:31.724297 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3d47a8de-efb6-463b-9e56-560deb134783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:31.908656 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d47a8de-efb6-463b-9e56-560deb134783 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:17:31.920761 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:17:32.032876 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e9fc7-f716-4fef-b79d-0b8638545de1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719e4bf834d6490b96066e55a26fb159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:17:32.033489 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e9fc7-f716-4fef-b79d-0b8638545de1 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:32.033804 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e9fc7-f716-4fef-b79d-0b8638545de1 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:32.034073 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e9fc7-f716-4fef-b79d-0b8638545de1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:32.035707 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9f6e9fc7-f716-4fef-b79d-0b8638545de1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:32.129389 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6e9fc7-f716-4fef-b79d-0b8638545de1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:17:32.131080 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6e9fc7-f716-4fef-b79d-0b8638545de1 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:17:32.149922 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 518/1040] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:17:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:17:34.608345 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57151f56-882e-4318-9b6e-ab4f6c03a3b2 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:34.608919 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57151f56-882e-4318-9b6e-ab4f6c03a3b2 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:34.609218 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57151f56-882e-4318-9b6e-ab4f6c03a3b2 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:34.610462 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 523/1041] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:17:34.615957 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a848db1-3a84-42a0-aaa8-da3542da09ba None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:34.616403 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a848db1-3a84-42a0-aaa8-da3542da09ba None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:34.616507 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a848db1-3a84-42a0-aaa8-da3542da09ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:34.632208 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:17:34.685327 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-4a848db1-3a84-42a0-aaa8-da3542da09ba None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:17:34.687530 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4a848db1-3a84-42a0-aaa8-da3542da09ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:34.800066 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 519/1042] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:17:35.086677 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fe44a-a935-483b-8a95-483967b1b2d8 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:35.087068 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fe44a-a935-483b-8a95-483967b1b2d8 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:35.087434 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fe44a-a935-483b-8a95-483967b1b2d8 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:35.088952 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 524/1043] 10.222.0.52 () {54 vars in 961 bytes} [Thu Oct 27 13:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:17:35.094682 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7c74b-0a8b-4046-a4d9-b819a600b6e6 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:35.094978 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7c74b-0a8b-4046-a4d9-b819a600b6e6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:35.095271 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7c74b-0a8b-4046-a4d9-b819a600b6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:35.173187 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-c0a7c74b-0a8b-4046-a4d9-b819a600b6e6 None None] MFA Rules not processed for user `719e4bf834d6490b96066e55a26fb159`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:17:35.174394 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c0a7c74b-0a8b-4046-a4d9-b819a600b6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:35.211849 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:17:35.297306 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 520/1044] 10.222.0.52 () {58 vars in 1058 bytes} [Thu Oct 27 13:17:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:17:35.305443 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63fe44a-a935-483b-8a95-483967b1b2d8 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:17:35.306956 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a63fe44a-a935-483b-8a95-483967b1b2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:35.463805 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63fe44a-a935-483b-8a95-483967b1b2d8 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:17:35.488105 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:17:35.586272 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183fbb15-01d6-4098-907e-2ecb211f30ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719e4bf834d6490b96066e55a26fb159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:17:35.586883 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fbb15-01d6-4098-907e-2ecb211f30ec service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:35.587157 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fbb15-01d6-4098-907e-2ecb211f30ec service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:35.587423 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fbb15-01d6-4098-907e-2ecb211f30ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:35.589011 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-183fbb15-01d6-4098-907e-2ecb211f30ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:35.690493 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183fbb15-01d6-4098-907e-2ecb211f30ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:17:35.692193 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183fbb15-01d6-4098-907e-2ecb211f30ec service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:17:35.711287 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 525/1045] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:17:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:17:35.763015 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9c7ec-a59f-4fbb-9b1b-aefd49cc4b89 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:35.763469 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9c7ec-a59f-4fbb-9b1b-aefd49cc4b89 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:35.763548 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9c7ec-a59f-4fbb-9b1b-aefd49cc4b89 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:35.765049 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 521/1046] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:17:35.770324 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac07cf-917b-4884-8fe1-3a7c38a7ae0e None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:35.770614 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac07cf-917b-4884-8fe1-3a7c38a7ae0e None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:35.770888 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac07cf-917b-4884-8fe1-3a7c38a7ae0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:35.821754 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:17:35.862111 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-6dac07cf-917b-4884-8fe1-3a7c38a7ae0e None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:17:35.863491 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6dac07cf-917b-4884-8fe1-3a7c38a7ae0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:35.984689 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 526/1047] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:17:36.320006 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ccad94-be6b-4db2-9e18-d44cd6e51a18 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:36.320006 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ccad94-be6b-4db2-9e18-d44cd6e51a18 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:36.320006 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ccad94-be6b-4db2-9e18-d44cd6e51a18 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:36.323342 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 522/1048] 10.222.0.52 () {54 vars in 963 bytes} [Thu Oct 27 13:17:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:17:36.326300 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb423318-e440-438d-b33b-1a145b454d91 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:36.326681 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb423318-e440-438d-b33b-1a145b454d91 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:36.327029 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb423318-e440-438d-b33b-1a145b454d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:36.417490 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-eb423318-e440-438d-b33b-1a145b454d91 None None] MFA Rules not processed for user `aa785d7f18b54de48a0ec78ec8642e17`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:17:36.419034 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-eb423318-e440-438d-b33b-1a145b454d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:36.473587 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:17:36.512968 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 527/1049] 10.222.0.52 () {58 vars in 1060 bytes} [Thu Oct 27 13:17:36 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:17:36.520912 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ccad94-be6b-4db2-9e18-d44cd6e51a18 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:17:36.522622 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-88ccad94-be6b-4db2-9e18-d44cd6e51a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:36.635760 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ccad94-be6b-4db2-9e18-d44cd6e51a18 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:17:36.682847 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:17:36.739336 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a001ec-1552-4beb-b42b-27d35e3895ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:17:36.739953 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a001ec-1552-4beb-b42b-27d35e3895ca service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:36.740244 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a001ec-1552-4beb-b42b-27d35e3895ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:36.740505 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a001ec-1552-4beb-b42b-27d35e3895ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:36.742116 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-52a001ec-1552-4beb-b42b-27d35e3895ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:36.867795 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a001ec-1552-4beb-b42b-27d35e3895ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:17:36.869398 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a001ec-1552-4beb-b42b-27d35e3895ca service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:17:36.891324 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 523/1050] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:17:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:17:37.915551 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f84a2-ae71-4afa-b386-39c7fa27083c None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:37.916122 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f84a2-ae71-4afa-b386-39c7fa27083c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:37.916122 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f84a2-ae71-4afa-b386-39c7fa27083c None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:37.917669 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 528/1051] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:17:37.923071 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3218923-0bfc-40cb-b677-d6acd5866b4f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:37.923521 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3218923-0bfc-40cb-b677-d6acd5866b4f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:37.923630 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3218923-0bfc-40cb-b677-d6acd5866b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:37.990706 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-f3218923-0bfc-40cb-b677-d6acd5866b4f None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:17:37.991886 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f3218923-0bfc-40cb-b677-d6acd5866b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:38.012835 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:17:38.090163 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 524/1052] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:17:38.382920 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f84a2-ae71-4afa-b386-39c7fa27083c None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:17:38.384619 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ae9f84a2-ae71-4afa-b386-39c7fa27083c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:38.546811 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f84a2-ae71-4afa-b386-39c7fa27083c None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:17:38.600731 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:17:38.665811 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8575fdc7-4465-466d-b36f-b8c4c784a8f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719e4bf834d6490b96066e55a26fb159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:17:38.666337 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8575fdc7-4465-466d-b36f-b8c4c784a8f5 service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:38.666614 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8575fdc7-4465-466d-b36f-b8c4c784a8f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:38.666880 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8575fdc7-4465-466d-b36f-b8c4c784a8f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:38.668451 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8575fdc7-4465-466d-b36f-b8c4c784a8f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:38.763122 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8575fdc7-4465-466d-b36f-b8c4c784a8f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:17:38.764718 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8575fdc7-4465-466d-b36f-b8c4c784a8f5 service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:17:38.787252 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 529/1053] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:17:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:17:40.995338 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755521bb-d194-4550-9712-4761e7e301c2 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:40.995876 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755521bb-d194-4550-9712-4761e7e301c2 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:40.995876 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755521bb-d194-4550-9712-4761e7e301c2 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:40.997282 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 525/1054] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:17:41.002816 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c871d84-5eb3-4b91-8f7b-3219a7b8fca4 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:41.003315 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c871d84-5eb3-4b91-8f7b-3219a7b8fca4 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:41.003315 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c871d84-5eb3-4b91-8f7b-3219a7b8fca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:41.073498 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-3c871d84-5eb3-4b91-8f7b-3219a7b8fca4 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:17:41.074621 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3c871d84-5eb3-4b91-8f7b-3219a7b8fca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:41.083436 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:17:41.185909 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 530/1055] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:17:41.467121 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755521bb-d194-4550-9712-4761e7e301c2 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:17:41.468781 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-755521bb-d194-4550-9712-4761e7e301c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:41.625686 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755521bb-d194-4550-9712-4761e7e301c2 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:17:41.629763 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:17:41.748958 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d1509-7aa7-4431-a36d-5da1ec0cdb0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719e4bf834d6490b96066e55a26fb159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:17:41.749559 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d1509-7aa7-4431-a36d-5da1ec0cdb0b service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:41.749982 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d1509-7aa7-4431-a36d-5da1ec0cdb0b service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:41.750317 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d1509-7aa7-4431-a36d-5da1ec0cdb0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:41.751931 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-090d1509-7aa7-4431-a36d-5da1ec0cdb0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:41.861798 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d1509-7aa7-4431-a36d-5da1ec0cdb0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:17:41.863647 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d1509-7aa7-4431-a36d-5da1ec0cdb0b service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:17:41.883500 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 526/1056] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:17:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:17:44.071987 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1489f-5ae0-44d9-9a68-732b2ca9a2e2 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:44.072448 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1489f-5ae0-44d9-9a68-732b2ca9a2e2 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:44.072549 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1489f-5ae0-44d9-9a68-732b2ca9a2e2 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:44.077501 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 531/1057] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:17:44.079179 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f9b07-b12c-428e-9180-aa7e4302d25e None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:44.079570 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f9b07-b12c-428e-9180-aa7e4302d25e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:44.079749 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f9b07-b12c-428e-9180-aa7e4302d25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:44.092145 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:17:44.153989 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-342f9b07-b12c-428e-9180-aa7e4302d25e None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:17:44.155382 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-342f9b07-b12c-428e-9180-aa7e4302d25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:44.269276 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 527/1058] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:17:44.559043 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1489f-5ae0-44d9-9a68-732b2ca9a2e2 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:17:44.560828 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-20b1489f-5ae0-44d9-9a68-732b2ca9a2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:44.710003 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:17:44.722252 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1489f-5ae0-44d9-9a68-732b2ca9a2e2 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:17:44.864530 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0385ca7-b421-4184-9a3d-7f0e5c3e50fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719e4bf834d6490b96066e55a26fb159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:17:44.865287 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0385ca7-b421-4184-9a3d-7f0e5c3e50fd service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:44.865571 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0385ca7-b421-4184-9a3d-7f0e5c3e50fd service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:44.865948 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0385ca7-b421-4184-9a3d-7f0e5c3e50fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:44.867980 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e0385ca7-b421-4184-9a3d-7f0e5c3e50fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:44.968683 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0385ca7-b421-4184-9a3d-7f0e5c3e50fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:17:44.970365 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0385ca7-b421-4184-9a3d-7f0e5c3e50fd service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:17:44.980703 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:17:44.989967 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 532/1059] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:17:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:17:47.274310 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec61933-d9f8-4397-812e-60fc93f1f565 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:47.275140 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec61933-d9f8-4397-812e-60fc93f1f565 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:47.275140 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec61933-d9f8-4397-812e-60fc93f1f565 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:47.276823 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 528/1060] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:17:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:17:47.283444 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec813e8-b281-4830-8f69-91dea18afc18 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:47.284072 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec813e8-b281-4830-8f69-91dea18afc18 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:47.284227 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec813e8-b281-4830-8f69-91dea18afc18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:47.367536 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-3ec813e8-b281-4830-8f69-91dea18afc18 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:17:47.368766 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3ec813e8-b281-4830-8f69-91dea18afc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:47.476870 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 533/1061] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:17:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:17:47.763654 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec61933-d9f8-4397-812e-60fc93f1f565 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:17:47.765944 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3ec61933-d9f8-4397-812e-60fc93f1f565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:47.868679 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:17:47.934265 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec61933-d9f8-4397-812e-60fc93f1f565 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:17:48.054838 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea107bbe-2e35-4ad8-8841-f13b1f6988c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719e4bf834d6490b96066e55a26fb159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:17:48.055461 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea107bbe-2e35-4ad8-8841-f13b1f6988c5 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:48.055761 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea107bbe-2e35-4ad8-8841-f13b1f6988c5 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:48.056039 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea107bbe-2e35-4ad8-8841-f13b1f6988c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:48.057823 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ea107bbe-2e35-4ad8-8841-f13b1f6988c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:48.127547 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:17:48.169644 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea107bbe-2e35-4ad8-8841-f13b1f6988c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:17:48.171235 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea107bbe-2e35-4ad8-8841-f13b1f6988c5 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:17:48.190075 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 529/1062] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:17:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:17:50.408899 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad2808-73c5-4a3d-8aa0-0ab14a7307a8 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:50.409511 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad2808-73c5-4a3d-8aa0-0ab14a7307a8 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:50.409511 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad2808-73c5-4a3d-8aa0-0ab14a7307a8 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:50.410886 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 534/1063] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:17:50.416501 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5efa4e6-c465-4787-86db-04c77aceeb00 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:50.416935 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5efa4e6-c465-4787-86db-04c77aceeb00 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:50.417051 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5efa4e6-c465-4787-86db-04c77aceeb00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:50.496799 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-a5efa4e6-c465-4787-86db-04c77aceeb00 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:17:50.498918 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a5efa4e6-c465-4787-86db-04c77aceeb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:50.613284 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 530/1064] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:17:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:17:50.898034 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad2808-73c5-4a3d-8aa0-0ab14a7307a8 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:17:50.899576 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-acad2808-73c5-4a3d-8aa0-0ab14a7307a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:50.983537 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:17:51.057239 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad2808-73c5-4a3d-8aa0-0ab14a7307a8 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:17:51.177978 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7f30f-aae4-4b47-a806-a9845e277b86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719e4bf834d6490b96066e55a26fb159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:17:51.178599 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7f30f-aae4-4b47-a806-a9845e277b86 service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:51.178878 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7f30f-aae4-4b47-a806-a9845e277b86 service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:51.179152 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7f30f-aae4-4b47-a806-a9845e277b86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:51.180752 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e2b7f30f-aae4-4b47-a806-a9845e277b86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:51.225857 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:17:51.284247 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7f30f-aae4-4b47-a806-a9845e277b86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:17:51.285958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7f30f-aae4-4b47-a806-a9845e277b86 service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:17:51.306607 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 535/1065] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:17:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:17:52.032217 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef06445-2237-43aa-912e-f6f1c8ef2ec2 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:52.032762 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef06445-2237-43aa-912e-f6f1c8ef2ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:52.032876 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef06445-2237-43aa-912e-f6f1c8ef2ec2 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:52.034214 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 531/1066] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:17:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:17:52.039911 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5b4f9-2551-4d63-95a9-0013fa96d507 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:52.040457 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5b4f9-2551-4d63-95a9-0013fa96d507 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:52.040570 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5b4f9-2551-4d63-95a9-0013fa96d507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:52.111892 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-43b5b4f9-2551-4d63-95a9-0013fa96d507 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:17:52.113076 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-43b5b4f9-2551-4d63-95a9-0013fa96d507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:52.215744 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 536/1067] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:17:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:17:52.521375 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff379a9-ea1e-43ea-9c90-c175624857e3 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:52.521375 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff379a9-ea1e-43ea-9c90-c175624857e3 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:52.521375 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff379a9-ea1e-43ea-9c90-c175624857e3 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:52.521375 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 532/1068] 10.222.0.52 () {54 vars in 962 bytes} [Thu Oct 27 13:17:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:17:52.527023 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f8bf1-6d3a-42ac-8621-c124b4d56b38 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:52.527330 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f8bf1-6d3a-42ac-8621-c124b4d56b38 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:52.527603 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f8bf1-6d3a-42ac-8621-c124b4d56b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:52.545420 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:17:52.616587 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-606f8bf1-6d3a-42ac-8621-c124b4d56b38 None None] MFA Rules not processed for user `2298dbfcf7b74668902781401f77215e`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:17:52.617833 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-606f8bf1-6d3a-42ac-8621-c124b4d56b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:52.695791 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 537/1069] 10.222.0.52 () {58 vars in 1059 bytes} [Thu Oct 27 13:17:52 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:17:52.703718 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff379a9-ea1e-43ea-9c90-c175624857e3 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:17:52.705387 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5ff379a9-ea1e-43ea-9c90-c175624857e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:52.738997 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:17:52.813978 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff379a9-ea1e-43ea-9c90-c175624857e3 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:17:52.887330 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4cb685-a0f2-42bc-b107-c412e45dca04 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2298dbfcf7b74668902781401f77215e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:17:52.887936 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cb685-a0f2-42bc-b107-c412e45dca04 service glance] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:52.888211 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cb685-a0f2-42bc-b107-c412e45dca04 service glance] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:52.888482 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cb685-a0f2-42bc-b107-c412e45dca04 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:52.890116 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-db4cb685-a0f2-42bc-b107-c412e45dca04 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:52.970665 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:17:53.004333 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4cb685-a0f2-42bc-b107-c412e45dca04 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:17:53.006142 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4cb685-a0f2-42bc-b107-c412e45dca04 service glance] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:17:53.025833 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 533/1070] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:17:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:17:53.522195 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc064bcb-fb7c-4309-8d10-4fb44e4888e7 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:53.522803 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc064bcb-fb7c-4309-8d10-4fb44e4888e7 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:53.522803 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc064bcb-fb7c-4309-8d10-4fb44e4888e7 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:53.524149 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 538/1071] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 13:17:53.529461 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1308f0b-6a19-45aa-bfb6-9bae77d2d17a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:53.529915 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1308f0b-6a19-45aa-bfb6-9bae77d2d17a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:53.530029 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1308f0b-6a19-45aa-bfb6-9bae77d2d17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:53.607234 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e1308f0b-6a19-45aa-bfb6-9bae77d2d17a None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:17:53.608492 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e1308f0b-6a19-45aa-bfb6-9bae77d2d17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:53.718139 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 534/1072] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:17:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:17:53.778231 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ee3f3-9a6b-4c54-be9c-ec6f69ac4e57 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:53.778514 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ee3f3-9a6b-4c54-be9c-ec6f69ac4e57 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:53.778785 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ee3f3-9a6b-4c54-be9c-ec6f69ac4e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:53.849859 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-663ee3f3-9a6b-4c54-be9c-ec6f69ac4e57 None None] MFA Rules not processed for user `cffe930429614615adc2e63e165b9c45`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:17:53.851064 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-663ee3f3-9a6b-4c54-be9c-ec6f69ac4e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:53.907087 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:17:53.940316 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 539/1073] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Oct 27 13:17:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:17:53.988138 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24110d5b-4da7-4a72-b7b7-0f750d56d735 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:53.988631 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24110d5b-4da7-4a72-b7b7-0f750d56d735 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:53.989054 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24110d5b-4da7-4a72-b7b7-0f750d56d735 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:53.990561 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 535/1074] 10.222.0.52 () {54 vars in 943 bytes} [Thu Oct 27 13:17:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:17:53.997649 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180b43b-78cd-465b-b52e-900fbae57a1b None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:53.997962 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180b43b-78cd-465b-b52e-900fbae57a1b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:53.998237 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180b43b-78cd-465b-b52e-900fbae57a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:54.008350 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24110d5b-4da7-4a72-b7b7-0f750d56d735 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:17:54.009969 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-24110d5b-4da7-4a72-b7b7-0f750d56d735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:54.049992 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:17:54.076629 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-e180b43b-78cd-465b-b52e-900fbae57a1b None None] MFA Rules not processed for user `62769acbfca242d6a0b0fe5a6b8bc108`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:17:54.077754 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e180b43b-78cd-465b-b52e-900fbae57a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:54.159084 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24110d5b-4da7-4a72-b7b7-0f750d56d735 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:17:54.186878 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 540/1075] 10.222.0.52 () {58 vars in 1040 bytes} [Thu Oct 27 13:17:53 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:17:54.196475 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180b43b-78cd-465b-b52e-900fbae57a1b None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:17:54.207065 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180b43b-78cd-465b-b52e-900fbae57a1b None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:17:54.244280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:17:54.283108 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:17:54.285433 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4fc869-625f-4466-b80d-8c3956634d33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719e4bf834d6490b96066e55a26fb159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:17:54.286219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4fc869-625f-4466-b80d-8c3956634d33 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:54.286575 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4fc869-625f-4466-b80d-8c3956634d33 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:54.286949 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4fc869-625f-4466-b80d-8c3956634d33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:54.289337 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2b4fc869-625f-4466-b80d-8c3956634d33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:54.324548 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a488eec-c1ec-4adb-a800-9864ca3dfcc4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62769acbfca242d6a0b0fe5a6b8bc108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:17:54.325159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a488eec-c1ec-4adb-a800-9864ca3dfcc4 service swift] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:54.325432 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a488eec-c1ec-4adb-a800-9864ca3dfcc4 service swift] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:54.325729 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a488eec-c1ec-4adb-a800-9864ca3dfcc4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:54.327412 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7a488eec-c1ec-4adb-a800-9864ca3dfcc4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:54.380732 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4fc869-625f-4466-b80d-8c3956634d33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:17:54.382376 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4fc869-625f-4466-b80d-8c3956634d33 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:17:54.401561 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 536/1076] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:17:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:17:54.418059 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a488eec-c1ec-4adb-a800-9864ca3dfcc4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:17:54.419695 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a488eec-c1ec-4adb-a800-9864ca3dfcc4 service swift] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:17:54.427879 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 541/1077] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Oct 27 13:17:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 13:17:56.648244 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cb830-baa4-4aaf-9318-2662bc79c884 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:56.648910 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cb830-baa4-4aaf-9318-2662bc79c884 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:56.648910 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cb830-baa4-4aaf-9318-2662bc79c884 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:56.650192 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 537/1078] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:17:56.655504 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8cbe0-9fce-4e9d-af60-6886dcf8da53 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:56.655988 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8cbe0-9fce-4e9d-af60-6886dcf8da53 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:56.656089 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8cbe0-9fce-4e9d-af60-6886dcf8da53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:56.733423 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-9ff8cbe0-9fce-4e9d-af60-6886dcf8da53 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:17:56.734667 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-9ff8cbe0-9fce-4e9d-af60-6886dcf8da53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:56.742994 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:17:56.851461 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 542/1079] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:17:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:17:57.143668 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0cb830-baa4-4aaf-9318-2662bc79c884 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:17:57.145708 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9f0cb830-baa4-4aaf-9318-2662bc79c884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:57.276268 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:17:57.308428 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0cb830-baa4-4aaf-9318-2662bc79c884 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:17:57.431388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68e78b-3f65-4a71-aeb7-7bb1dc2126f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719e4bf834d6490b96066e55a26fb159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:17:57.432006 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68e78b-3f65-4a71-aeb7-7bb1dc2126f5 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:57.432289 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68e78b-3f65-4a71-aeb7-7bb1dc2126f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:57.432571 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68e78b-3f65-4a71-aeb7-7bb1dc2126f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:57.434212 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5a68e78b-3f65-4a71-aeb7-7bb1dc2126f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:17:57.522954 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:17:57.533859 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a68e78b-3f65-4a71-aeb7-7bb1dc2126f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:17:57.535387 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a68e78b-3f65-4a71-aeb7-7bb1dc2126f5 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:17:57.557315 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 538/1080] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:17:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:17:59.835610 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d63ee-7045-4fce-81cf-ab7dd3e75286 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:59.836180 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d63ee-7045-4fce-81cf-ab7dd3e75286 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:59.836180 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d63ee-7045-4fce-81cf-ab7dd3e75286 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:59.837492 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 543/1081] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:17:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:17:59.845027 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be154a15-fdbb-4bad-9c01-c3486d85dc19 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:17:59.845461 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be154a15-fdbb-4bad-9c01-c3486d85dc19 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:17:59.845679 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be154a15-fdbb-4bad-9c01-c3486d85dc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:17:59.915682 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-be154a15-fdbb-4bad-9c01-c3486d85dc19 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:17:59.916881 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-be154a15-fdbb-4bad-9c01-c3486d85dc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:00.022858 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 539/1082] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:17:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:18:00.312636 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d63ee-7045-4fce-81cf-ab7dd3e75286 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:18:00.314188 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-890d63ee-7045-4fce-81cf-ab7dd3e75286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:00.466760 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:18:00.492551 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d63ee-7045-4fce-81cf-ab7dd3e75286 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:18:00.678185 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44cf5c1-8b5e-4b89-a8e3-ee88f420e3dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719e4bf834d6490b96066e55a26fb159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:18:00.678947 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cf5c1-8b5e-4b89-a8e3-ee88f420e3dc service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:00.679230 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cf5c1-8b5e-4b89-a8e3-ee88f420e3dc service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:00.679500 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cf5c1-8b5e-4b89-a8e3-ee88f420e3dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:00.681140 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c44cf5c1-8b5e-4b89-a8e3-ee88f420e3dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:00.784546 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44cf5c1-8b5e-4b89-a8e3-ee88f420e3dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:18:00.786262 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44cf5c1-8b5e-4b89-a8e3-ee88f420e3dc service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:18:00.801887 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:18:00.814963 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 544/1083] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:18:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:18:03.085047 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ccd93-a29b-41a2-af7c-60b4dad249a0 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:03.085614 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ccd93-a29b-41a2-af7c-60b4dad249a0 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:03.085614 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ccd93-a29b-41a2-af7c-60b4dad249a0 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:03.088241 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 540/1084] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:18:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:18:03.092280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49253067-ffc8-4ffe-a068-0da88b5f9478 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:03.092720 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49253067-ffc8-4ffe-a068-0da88b5f9478 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:03.092817 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49253067-ffc8-4ffe-a068-0da88b5f9478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:03.164252 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-49253067-ffc8-4ffe-a068-0da88b5f9478 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:18:03.165689 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-49253067-ffc8-4ffe-a068-0da88b5f9478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:03.274312 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 545/1085] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:18:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:18:03.551686 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ccd93-a29b-41a2-af7c-60b4dad249a0 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:18:03.553334 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-813ccd93-a29b-41a2-af7c-60b4dad249a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:03.628956 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:18:03.721023 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ccd93-a29b-41a2-af7c-60b4dad249a0 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:18:03.849397 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d697dc-9bb7-46f6-be73-896d93c7e289 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719e4bf834d6490b96066e55a26fb159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:18:03.850031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d697dc-9bb7-46f6-be73-896d93c7e289 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:03.850307 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d697dc-9bb7-46f6-be73-896d93c7e289 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:03.850574 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d697dc-9bb7-46f6-be73-896d93c7e289 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:03.852142 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-87d697dc-9bb7-46f6-be73-896d93c7e289 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:03.877779 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:18:03.952311 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d697dc-9bb7-46f6-be73-896d93c7e289 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:18:03.954058 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d697dc-9bb7-46f6-be73-896d93c7e289 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:18:03.972533 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 541/1086] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:18:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:18:13.265433 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=67 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:18:13.970007 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=35 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:18:17.473961 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fd2fa-e486-4712-8cc6-bc034c0fdd0d None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:17.474525 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fd2fa-e486-4712-8cc6-bc034c0fdd0d None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:17.474525 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fd2fa-e486-4712-8cc6-bc034c0fdd0d None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:17.475846 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 546/1087] 10.222.0.52 () {54 vars in 918 bytes} [Thu Oct 27 13:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:18:17.483965 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1c64e-8a46-4b8c-8c40-c42961e29d61 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:17.484381 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1c64e-8a46-4b8c-8c40-c42961e29d61 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:17.484488 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1c64e-8a46-4b8c-8c40-c42961e29d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:17.563831 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-2bc1c64e-8a46-4b8c-8c40-c42961e29d61 None None] MFA Rules not processed for user `cbcd6da4e42248a3b38101104fbc03cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:18:17.565057 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2bc1c64e-8a46-4b8c-8c40-c42961e29d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:17.676262 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 542/1088] 10.222.0.52 () {58 vars in 1015 bytes} [Thu Oct 27 13:18:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:18:17.692940 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c06189-5e66-4d9b-ae23-d51d1d22d660 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:17.693228 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c06189-5e66-4d9b-ae23-d51d1d22d660 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:17.693496 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c06189-5e66-4d9b-ae23-d51d1d22d660 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:17.694890 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 547/1089] 10.222.0.52 () {54 vars in 918 bytes} [Thu Oct 27 13:18:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:18:17.699672 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cfd8c-342f-48c4-a7ba-3187005109c2 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:17.699953 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cfd8c-342f-48c4-a7ba-3187005109c2 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:17.700227 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cfd8c-342f-48c4-a7ba-3187005109c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:17.775960 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:18:17.779451 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-729cfd8c-342f-48c4-a7ba-3187005109c2 None None] MFA Rules not processed for user `719e4bf834d6490b96066e55a26fb159`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:18:17.781411 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-729cfd8c-342f-48c4-a7ba-3187005109c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:17.904366 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 543/1090] 10.222.0.52 () {58 vars in 1015 bytes} [Thu Oct 27 13:18:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:18:20.459134 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2cf60-7d49-48d4-bbbc-00b4d0ca6bf3 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:20.459753 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2cf60-7d49-48d4-bbbc-00b4d0ca6bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:20.459753 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2cf60-7d49-48d4-bbbc-00b4d0ca6bf3 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:20.461022 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 548/1091] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 13:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:18:20.466622 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb79be-cc04-4d73-8b94-b81a2fee6c52 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:20.467073 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb79be-cc04-4d73-8b94-b81a2fee6c52 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:20.467170 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb79be-cc04-4d73-8b94-b81a2fee6c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:20.536379 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e9fb79be-cc04-4d73-8b94-b81a2fee6c52 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:18:20.537621 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e9fb79be-cc04-4d73-8b94-b81a2fee6c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:20.595671 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:18:20.640225 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 544/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 13:18:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:18:20.935988 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2cf60-7d49-48d4-bbbc-00b4d0ca6bf3 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:18:20.937879 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e2a2cf60-7d49-48d4-bbbc-00b4d0ca6bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:21.089421 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2cf60-7d49-48d4-bbbc-00b4d0ca6bf3 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:18:21.169081 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:18:21.210868 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924e1fd-c302-415e-bfaa-63ed7a90609a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719e4bf834d6490b96066e55a26fb159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:18:21.211487 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924e1fd-c302-415e-bfaa-63ed7a90609a service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:21.211761 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924e1fd-c302-415e-bfaa-63ed7a90609a service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:21.212030 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924e1fd-c302-415e-bfaa-63ed7a90609a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:21.213658 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6924e1fd-c302-415e-bfaa-63ed7a90609a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:21.309212 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924e1fd-c302-415e-bfaa-63ed7a90609a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:18:21.310857 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924e1fd-c302-415e-bfaa-63ed7a90609a service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:18:21.330753 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 549/1093] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:18:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:18:22.446360 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd2e6a-4d9a-4145-8a21-879176a6d519 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:22.447259 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd2e6a-4d9a-4145-8a21-879176a6d519 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:22.447259 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd2e6a-4d9a-4145-8a21-879176a6d519 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:22.449449 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 545/1094] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 27 13:18:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:18:22.454689 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a643b51-38a6-4146-a77f-77eb3c0ad299 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:22.455133 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a643b51-38a6-4146-a77f-77eb3c0ad299 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:22.455248 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a643b51-38a6-4146-a77f-77eb3c0ad299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:22.531842 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-0a643b51-38a6-4146-a77f-77eb3c0ad299 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:18:22.533021 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0a643b51-38a6-4146-a77f-77eb3c0ad299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:22.560435 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:18:22.637773 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 550/1095] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 27 13:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:18:22.798078 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd2e6a-4d9a-4145-8a21-879176a6d519 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:18:22.799520 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-27fd2e6a-4d9a-4145-8a21-879176a6d519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:22.962825 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd2e6a-4d9a-4145-8a21-879176a6d519 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:18:23.004974 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:18:23.091435 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727dd2e0-9f45-41b5-bf60-29ee1529fe86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719e4bf834d6490b96066e55a26fb159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:18:23.091959 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727dd2e0-9f45-41b5-bf60-29ee1529fe86 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:23.092240 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727dd2e0-9f45-41b5-bf60-29ee1529fe86 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:23.092507 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727dd2e0-9f45-41b5-bf60-29ee1529fe86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:23.094134 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-727dd2e0-9f45-41b5-bf60-29ee1529fe86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:23.194658 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727dd2e0-9f45-41b5-bf60-29ee1529fe86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:18:23.196253 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727dd2e0-9f45-41b5-bf60-29ee1529fe86 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:18:23.214843 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 546/1096] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:18:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:18:24.343042 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3aed0c-417a-48ad-9bcd-1819ad0588a1 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:24.343650 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3aed0c-417a-48ad-9bcd-1819ad0588a1 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:24.343650 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3aed0c-417a-48ad-9bcd-1819ad0588a1 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:24.344942 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 551/1097] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 27 13:18:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:18:24.351178 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd25ca8-d7e9-4d27-91b1-e59c14c0b8fa None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:24.351653 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd25ca8-d7e9-4d27-91b1-e59c14c0b8fa None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:24.351757 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd25ca8-d7e9-4d27-91b1-e59c14c0b8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:24.418820 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:18:24.441541 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-dfd25ca8-d7e9-4d27-91b1-e59c14c0b8fa None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:18:24.442816 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-dfd25ca8-d7e9-4d27-91b1-e59c14c0b8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:24.541565 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 547/1098] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 27 13:18:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:18:24.697058 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3aed0c-417a-48ad-9bcd-1819ad0588a1 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:18:24.698631 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-dd3aed0c-417a-48ad-9bcd-1819ad0588a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:24.856887 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3aed0c-417a-48ad-9bcd-1819ad0588a1 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:18:24.869558 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:18:24.994556 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5007686-d9da-4951-b288-a00f29b9ec7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719e4bf834d6490b96066e55a26fb159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:18:24.995160 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5007686-d9da-4951-b288-a00f29b9ec7c service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:24.995428 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5007686-d9da-4951-b288-a00f29b9ec7c service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:24.995693 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5007686-d9da-4951-b288-a00f29b9ec7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:24.997260 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b5007686-d9da-4951-b288-a00f29b9ec7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:25.094647 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5007686-d9da-4951-b288-a00f29b9ec7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:18:25.096243 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5007686-d9da-4951-b288-a00f29b9ec7c service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:18:25.120407 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 552/1099] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:18:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:18:26.205139 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b4acb-1235-44f8-8fa0-0dd9169b16c2 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:26.205986 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b4acb-1235-44f8-8fa0-0dd9169b16c2 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:26.205986 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b4acb-1235-44f8-8fa0-0dd9169b16c2 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:26.207835 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 548/1100] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 27 13:18:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:18:26.213584 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea1b7d-d6e3-4eab-b434-96511ea1d24a None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:26.214039 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea1b7d-d6e3-4eab-b434-96511ea1d24a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:26.214134 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea1b7d-d6e3-4eab-b434-96511ea1d24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:26.242794 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:18:26.309284 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-7fea1b7d-d6e3-4eab-b434-96511ea1d24a None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:18:26.310536 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7fea1b7d-d6e3-4eab-b434-96511ea1d24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:26.414684 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 553/1101] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 27 13:18:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:18:26.568308 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b4acb-1235-44f8-8fa0-0dd9169b16c2 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:18:26.570616 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-be1b4acb-1235-44f8-8fa0-0dd9169b16c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:26.689004 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:18:26.728288 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b4acb-1235-44f8-8fa0-0dd9169b16c2 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:18:26.847076 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d06f25-629f-4e6e-b04b-bbe36ff18275 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719e4bf834d6490b96066e55a26fb159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:18:26.847612 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d06f25-629f-4e6e-b04b-bbe36ff18275 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:26.847884 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d06f25-629f-4e6e-b04b-bbe36ff18275 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:26.848259 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d06f25-629f-4e6e-b04b-bbe36ff18275 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:26.849854 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d5d06f25-629f-4e6e-b04b-bbe36ff18275 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:26.928026 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:18:26.943898 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d06f25-629f-4e6e-b04b-bbe36ff18275 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:18:26.945502 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d06f25-629f-4e6e-b04b-bbe36ff18275 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:18:26.963815 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 549/1102] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:18:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:18:28.067027 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6f884-8f88-4db7-b106-72cebc49565d None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:28.067579 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6f884-8f88-4db7-b106-72cebc49565d None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:28.067579 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6f884-8f88-4db7-b106-72cebc49565d None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:28.068842 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 554/1103] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 27 13:18:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:18:28.075050 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b8dec-4c80-483a-a278-a57eb54ec917 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:28.075953 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b8dec-4c80-483a-a278-a57eb54ec917 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:28.075953 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b8dec-4c80-483a-a278-a57eb54ec917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:28.163899 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-1d7b8dec-4c80-483a-a278-a57eb54ec917 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:18:28.165101 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1d7b8dec-4c80-483a-a278-a57eb54ec917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:28.270136 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 550/1104] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 27 13:18:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:18:28.428344 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6f884-8f88-4db7-b106-72cebc49565d None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:18:28.430720 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b5c6f884-8f88-4db7-b106-72cebc49565d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:28.538665 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:18:28.605289 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6f884-8f88-4db7-b106-72cebc49565d None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:18:28.727826 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1840d52-09c7-467c-a7d0-cce2112dff40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719e4bf834d6490b96066e55a26fb159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:18:28.728332 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1840d52-09c7-467c-a7d0-cce2112dff40 service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:28.728600 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1840d52-09c7-467c-a7d0-cce2112dff40 service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:28.728859 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1840d52-09c7-467c-a7d0-cce2112dff40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:28.730477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e1840d52-09c7-467c-a7d0-cce2112dff40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:28.784064 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:18:28.827356 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1840d52-09c7-467c-a7d0-cce2112dff40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:18:28.829038 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1840d52-09c7-467c-a7d0-cce2112dff40 service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:18:28.847091 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 555/1105] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:18:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:18:29.883286 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266ec74-0a5b-4cf6-91d0-20638397da59 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:29.884135 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266ec74-0a5b-4cf6-91d0-20638397da59 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:29.884135 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266ec74-0a5b-4cf6-91d0-20638397da59 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:29.886317 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 551/1106] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 27 13:18:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:18:29.894155 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167743c5-bc57-4c97-b7ac-329c354de406 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:29.894570 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167743c5-bc57-4c97-b7ac-329c354de406 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:29.894742 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167743c5-bc57-4c97-b7ac-329c354de406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:29.978737 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-167743c5-bc57-4c97-b7ac-329c354de406 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:18:29.979938 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-167743c5-bc57-4c97-b7ac-329c354de406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:30.079736 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 556/1107] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 27 13:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:18:30.240310 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266ec74-0a5b-4cf6-91d0-20638397da59 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:18:30.241836 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d266ec74-0a5b-4cf6-91d0-20638397da59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:30.294390 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:18:30.395141 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266ec74-0a5b-4cf6-91d0-20638397da59 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:18:30.515605 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7cd8d9-7ff9-43ff-b5bd-cdf774682e56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719e4bf834d6490b96066e55a26fb159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:18:30.516208 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7cd8d9-7ff9-43ff-b5bd-cdf774682e56 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:30.516483 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7cd8d9-7ff9-43ff-b5bd-cdf774682e56 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:30.516747 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7cd8d9-7ff9-43ff-b5bd-cdf774682e56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:30.518634 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4a7cd8d9-7ff9-43ff-b5bd-cdf774682e56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:30.525745 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:18:30.614340 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7cd8d9-7ff9-43ff-b5bd-cdf774682e56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:18:30.615933 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7cd8d9-7ff9-43ff-b5bd-cdf774682e56 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:18:30.634716 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 552/1108] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:18:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:18:31.680480 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21baeaf5-5c26-40a1-9a10-c57b17790464 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:31.681327 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21baeaf5-5c26-40a1-9a10-c57b17790464 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:31.681327 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21baeaf5-5c26-40a1-9a10-c57b17790464 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:31.683565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 557/1109] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 27 13:18:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:18:31.689893 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd2ec6-58b9-43d5-9d1a-46257bd3d681 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:31.690372 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd2ec6-58b9-43d5-9d1a-46257bd3d681 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:31.690479 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd2ec6-58b9-43d5-9d1a-46257bd3d681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:31.776079 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-09cd2ec6-58b9-43d5-9d1a-46257bd3d681 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:18:31.777259 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-09cd2ec6-58b9-43d5-9d1a-46257bd3d681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:31.851248 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:18:31.880728 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 553/1110] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 27 13:18:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:18:32.039250 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21baeaf5-5c26-40a1-9a10-c57b17790464 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:18:32.041581 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-21baeaf5-5c26-40a1-9a10-c57b17790464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:32.070274 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:18:32.213970 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21baeaf5-5c26-40a1-9a10-c57b17790464 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:18:32.308467 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:18:32.336143 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5535d-ff63-46a5-8546-bd27df49a3a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719e4bf834d6490b96066e55a26fb159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:18:32.336750 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5535d-ff63-46a5-8546-bd27df49a3a0 service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:32.337018 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5535d-ff63-46a5-8546-bd27df49a3a0 service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:32.337287 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5535d-ff63-46a5-8546-bd27df49a3a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:32.338895 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-63e5535d-ff63-46a5-8546-bd27df49a3a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:32.430954 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e5535d-ff63-46a5-8546-bd27df49a3a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:18:32.432553 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e5535d-ff63-46a5-8546-bd27df49a3a0 service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:18:32.451298 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 558/1111] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:18:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:18:33.483989 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6ad1e-a6c4-4060-acd7-1de648c94971 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:33.484603 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6ad1e-a6c4-4060-acd7-1de648c94971 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:33.484603 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6ad1e-a6c4-4060-acd7-1de648c94971 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:33.485904 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 554/1112] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 27 13:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:18:33.491137 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7efe77-0c62-4de1-9ae4-057621bb29f3 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:33.491582 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7efe77-0c62-4de1-9ae4-057621bb29f3 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:33.491674 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7efe77-0c62-4de1-9ae4-057621bb29f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:33.575063 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-cc7efe77-0c62-4de1-9ae4-057621bb29f3 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:18:33.576294 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-cc7efe77-0c62-4de1-9ae4-057621bb29f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:33.626791 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:18:33.685712 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 559/1113] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 27 13:18:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:18:33.842465 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6ad1e-a6c4-4060-acd7-1de648c94971 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:18:33.843979 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5ec6ad1e-a6c4-4060-acd7-1de648c94971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:33.999976 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6ad1e-a6c4-4060-acd7-1de648c94971 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:18:34.067345 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:18:34.136469 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7e8e9-a7f2-4450-a37a-4fd1dbf52bc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719e4bf834d6490b96066e55a26fb159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:18:34.137077 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7e8e9-a7f2-4450-a37a-4fd1dbf52bc2 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:34.137356 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7e8e9-a7f2-4450-a37a-4fd1dbf52bc2 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:34.137648 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7e8e9-a7f2-4450-a37a-4fd1dbf52bc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:34.139257 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-69d7e8e9-a7f2-4450-a37a-4fd1dbf52bc2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:34.234050 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7e8e9-a7f2-4450-a37a-4fd1dbf52bc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:18:34.235655 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7e8e9-a7f2-4450-a37a-4fd1dbf52bc2 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:18:34.253837 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 555/1114] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:18:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:18:35.284889 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577d32a-9179-4093-9842-85b68ce6553e None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:35.285872 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577d32a-9179-4093-9842-85b68ce6553e None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:35.285872 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577d32a-9179-4093-9842-85b68ce6553e None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:35.288201 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 560/1115] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 27 13:18:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:18:35.293278 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a4742-556c-42dd-8e96-41da66742d0b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:35.293747 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a4742-556c-42dd-8e96-41da66742d0b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:35.293841 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a4742-556c-42dd-8e96-41da66742d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:35.371935 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-719a4742-556c-42dd-8e96-41da66742d0b None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:18:35.373110 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-719a4742-556c-42dd-8e96-41da66742d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:35.375128 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:18:35.472552 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 556/1116] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 27 13:18:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:18:35.627998 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577d32a-9179-4093-9842-85b68ce6553e None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:18:35.629586 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3577d32a-9179-4093-9842-85b68ce6553e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:35.791151 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577d32a-9179-4093-9842-85b68ce6553e None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:18:35.822043 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:18:35.915013 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da4df5-2820-4ae5-89d9-4b675f373ead service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719e4bf834d6490b96066e55a26fb159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:18:35.915536 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da4df5-2820-4ae5-89d9-4b675f373ead service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:35.915810 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da4df5-2820-4ae5-89d9-4b675f373ead service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:35.916081 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da4df5-2820-4ae5-89d9-4b675f373ead service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:35.917713 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e5da4df5-2820-4ae5-89d9-4b675f373ead service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:36.019701 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5da4df5-2820-4ae5-89d9-4b675f373ead service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:18:36.021651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5da4df5-2820-4ae5-89d9-4b675f373ead service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:18:36.040973 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 561/1117] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:18:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:18:38.077759 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6763a-f6f3-46af-8b3c-150fc3fefaa9 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:38.078397 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6763a-f6f3-46af-8b3c-150fc3fefaa9 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:38.078397 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6763a-f6f3-46af-8b3c-150fc3fefaa9 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:38.079579 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 557/1118] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 13:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:18:38.086218 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a8365-555e-4f51-bc77-8fcc2d792aec None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:38.086989 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a8365-555e-4f51-bc77-8fcc2d792aec None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:38.087167 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a8365-555e-4f51-bc77-8fcc2d792aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:38.132563 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:18:38.159112 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-1f9a8365-555e-4f51-bc77-8fcc2d792aec None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:18:38.160300 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1f9a8365-555e-4f51-bc77-8fcc2d792aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:38.264128 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 562/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 13:18:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:18:38.550069 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6763a-f6f3-46af-8b3c-150fc3fefaa9 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:18:38.552490 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d9f6763a-f6f3-46af-8b3c-150fc3fefaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:38.673936 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6763a-f6f3-46af-8b3c-150fc3fefaa9 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:18:38.710268 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:18:38.753882 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d225340-e72a-41e2-ab3e-838cdb25e8d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:18:38.754528 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d225340-e72a-41e2-ab3e-838cdb25e8d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:38.754805 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d225340-e72a-41e2-ab3e-838cdb25e8d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:38.755073 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d225340-e72a-41e2-ab3e-838cdb25e8d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:38.756712 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9d225340-e72a-41e2-ab3e-838cdb25e8d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:38.872409 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d225340-e72a-41e2-ab3e-838cdb25e8d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:18:38.873874 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d225340-e72a-41e2-ab3e-838cdb25e8d4 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:18:38.892574 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 558/1120] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:18:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:18:41.201195 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88bed9c-afaf-4602-b4e4-6abf6f275c83 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:41.202144 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88bed9c-afaf-4602-b4e4-6abf6f275c83 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:41.202144 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88bed9c-afaf-4602-b4e4-6abf6f275c83 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:41.204205 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 563/1121] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 13:18:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:18:41.211369 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897b5ad-855b-48cc-9a6e-7c72f5b2eebc None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:41.211776 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897b5ad-855b-48cc-9a6e-7c72f5b2eebc None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:41.211884 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897b5ad-855b-48cc-9a6e-7c72f5b2eebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:41.281057 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-0897b5ad-855b-48cc-9a6e-7c72f5b2eebc None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:18:41.282274 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0897b5ad-855b-48cc-9a6e-7c72f5b2eebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:41.295470 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:18:41.385169 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 559/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 13:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:18:41.671273 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88bed9c-afaf-4602-b4e4-6abf6f275c83 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:18:41.673752 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a88bed9c-afaf-4602-b4e4-6abf6f275c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:41.799051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88bed9c-afaf-4602-b4e4-6abf6f275c83 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:18:41.813651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:18:41.881340 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5c711-15af-44bd-b50d-ae2e9f955695 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:18:41.881952 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5c711-15af-44bd-b50d-ae2e9f955695 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:41.882227 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5c711-15af-44bd-b50d-ae2e9f955695 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:41.882495 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5c711-15af-44bd-b50d-ae2e9f955695 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:41.884129 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b0d5c711-15af-44bd-b50d-ae2e9f955695 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:42.003906 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d5c711-15af-44bd-b50d-ae2e9f955695 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:18:42.005376 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d5c711-15af-44bd-b50d-ae2e9f955695 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:18:42.025663 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 564/1123] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:18:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:18:44.483322 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309598c8-55c7-4e57-bc16-daa820ba1f8c None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:44.484241 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309598c8-55c7-4e57-bc16-daa820ba1f8c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:44.484241 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309598c8-55c7-4e57-bc16-daa820ba1f8c None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:44.486396 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 560/1124] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 13:18:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:18:44.491982 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862fdcff-645f-4b3c-870e-56b5d21a94f9 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:44.492424 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862fdcff-645f-4b3c-870e-56b5d21a94f9 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:44.492515 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862fdcff-645f-4b3c-870e-56b5d21a94f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:44.542379 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:18:44.561231 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-862fdcff-645f-4b3c-870e-56b5d21a94f9 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:18:44.562853 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-862fdcff-645f-4b3c-870e-56b5d21a94f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:44.665434 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 565/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 13:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:18:44.960366 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309598c8-55c7-4e57-bc16-daa820ba1f8c None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:18:44.961921 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-309598c8-55c7-4e57-bc16-daa820ba1f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:45.072747 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309598c8-55c7-4e57-bc16-daa820ba1f8c None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:18:45.123961 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:18:45.161853 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386677e-6c2a-44ae-8117-0682b43065bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:18:45.162483 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386677e-6c2a-44ae-8117-0682b43065bf service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:45.162799 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386677e-6c2a-44ae-8117-0682b43065bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:45.163069 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386677e-6c2a-44ae-8117-0682b43065bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:45.164701 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8386677e-6c2a-44ae-8117-0682b43065bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:45.280740 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386677e-6c2a-44ae-8117-0682b43065bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:18:45.282220 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386677e-6c2a-44ae-8117-0682b43065bf service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:18:45.301878 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 561/1126] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:18:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:18:47.563090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3057df-61a6-4ae9-918e-d6d3ead1c265 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:47.563959 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3057df-61a6-4ae9-918e-d6d3ead1c265 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:47.563959 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3057df-61a6-4ae9-918e-d6d3ead1c265 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:47.566119 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 566/1127] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 13:18:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:18:47.574496 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a526e9-b825-4575-a859-38416077c211 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:47.574948 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a526e9-b825-4575-a859-38416077c211 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:47.575056 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a526e9-b825-4575-a859-38416077c211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:47.641939 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-10a526e9-b825-4575-a859-38416077c211 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:18:47.643120 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-10a526e9-b825-4575-a859-38416077c211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:47.665229 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:18:47.746333 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 562/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 13:18:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:18:48.031566 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3057df-61a6-4ae9-918e-d6d3ead1c265 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:18:48.034071 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1f3057df-61a6-4ae9-918e-d6d3ead1c265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:48.155415 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3057df-61a6-4ae9-918e-d6d3ead1c265 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:18:48.178649 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:18:48.239159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781681d-660e-4a47-87d5-49c39e8cf55b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:18:48.239770 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781681d-660e-4a47-87d5-49c39e8cf55b service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:48.240042 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781681d-660e-4a47-87d5-49c39e8cf55b service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:48.240309 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781681d-660e-4a47-87d5-49c39e8cf55b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:48.241929 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d781681d-660e-4a47-87d5-49c39e8cf55b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:48.359567 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d781681d-660e-4a47-87d5-49c39e8cf55b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:18:48.360927 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d781681d-660e-4a47-87d5-49c39e8cf55b service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:18:48.381104 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 567/1129] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:18:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:18:50.671573 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bce873-dd22-498a-9aa9-2b6cb20d3fa5 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:50.672483 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bce873-dd22-498a-9aa9-2b6cb20d3fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:50.672483 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bce873-dd22-498a-9aa9-2b6cb20d3fa5 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:50.674684 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 563/1130] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 13:18:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:18:50.683925 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411eba1-aff9-426e-a40a-f0fa8112bc18 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:50.684347 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411eba1-aff9-426e-a40a-f0fa8112bc18 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:50.684495 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411eba1-aff9-426e-a40a-f0fa8112bc18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:50.765720 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:18:50.768690 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-7411eba1-aff9-426e-a40a-f0fa8112bc18 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:18:50.770653 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7411eba1-aff9-426e-a40a-f0fa8112bc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:50.872355 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 568/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 13:18:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:18:51.162459 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bce873-dd22-498a-9aa9-2b6cb20d3fa5 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:18:51.164869 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-38bce873-dd22-498a-9aa9-2b6cb20d3fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:51.277232 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bce873-dd22-498a-9aa9-2b6cb20d3fa5 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:18:51.329226 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:18:51.356524 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5337043-810a-4a4c-90bf-40bed0398466 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:18:51.357124 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5337043-810a-4a4c-90bf-40bed0398466 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:51.357398 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5337043-810a-4a4c-90bf-40bed0398466 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:51.357697 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5337043-810a-4a4c-90bf-40bed0398466 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:51.359263 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d5337043-810a-4a4c-90bf-40bed0398466 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:51.474827 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5337043-810a-4a4c-90bf-40bed0398466 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:18:51.476284 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5337043-810a-4a4c-90bf-40bed0398466 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:18:51.495369 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 564/1132] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:18:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:18:53.781178 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e304a1d-17f9-4aad-b970-6e33e6d6df14 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:53.782111 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e304a1d-17f9-4aad-b970-6e33e6d6df14 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:53.782111 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e304a1d-17f9-4aad-b970-6e33e6d6df14 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:53.784308 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 569/1133] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 13:18:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:18:53.790699 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d690979-3a19-4bff-8763-b6d298d4effb None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:53.791171 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d690979-3a19-4bff-8763-b6d298d4effb None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:53.791282 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d690979-3a19-4bff-8763-b6d298d4effb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:53.862828 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-9d690979-3a19-4bff-8763-b6d298d4effb None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:18:53.864214 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9d690979-3a19-4bff-8763-b6d298d4effb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:53.895301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:18:53.967894 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 565/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 13:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:18:54.263016 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e304a1d-17f9-4aad-b970-6e33e6d6df14 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:18:54.264564 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8e304a1d-17f9-4aad-b970-6e33e6d6df14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:54.374142 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e304a1d-17f9-4aad-b970-6e33e6d6df14 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:18:54.405401 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:18:54.454911 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc1eae-c2c8-4864-be19-025fa1615300 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:18:54.455533 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc1eae-c2c8-4864-be19-025fa1615300 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:54.455789 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc1eae-c2c8-4864-be19-025fa1615300 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:54.456065 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc1eae-c2c8-4864-be19-025fa1615300 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:54.457999 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-13bc1eae-c2c8-4864-be19-025fa1615300 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:54.578599 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc1eae-c2c8-4864-be19-025fa1615300 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:18:54.579952 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc1eae-c2c8-4864-be19-025fa1615300 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:18:54.600392 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 570/1135] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:18:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:18:56.801152 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341dc34f-f7be-4e01-96ed-53ddf4e6efc9 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:56.801914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341dc34f-f7be-4e01-96ed-53ddf4e6efc9 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:56.801914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341dc34f-f7be-4e01-96ed-53ddf4e6efc9 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:56.804152 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 566/1136] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 13:18:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:18:56.812959 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad9c43-8156-46de-a4ca-83ceb545705f None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:56.813440 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad9c43-8156-46de-a4ca-83ceb545705f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:56.813440 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad9c43-8156-46de-a4ca-83ceb545705f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:56.888729 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-c3ad9c43-8156-46de-a4ca-83ceb545705f None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:18:56.889988 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c3ad9c43-8156-46de-a4ca-83ceb545705f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:56.898826 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:18:56.994981 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 571/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 13:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:18:57.274975 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341dc34f-f7be-4e01-96ed-53ddf4e6efc9 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:18:57.276562 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-341dc34f-f7be-4e01-96ed-53ddf4e6efc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:57.399787 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341dc34f-f7be-4e01-96ed-53ddf4e6efc9 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:18:57.460464 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:18:57.480151 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a0f126-c98e-4442-b6ee-2507b5c112a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:18:57.480745 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0f126-c98e-4442-b6ee-2507b5c112a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:57.481017 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0f126-c98e-4442-b6ee-2507b5c112a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:57.481277 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0f126-c98e-4442-b6ee-2507b5c112a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:57.482872 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-10a0f126-c98e-4442-b6ee-2507b5c112a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:57.598365 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a0f126-c98e-4442-b6ee-2507b5c112a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:18:57.599705 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a0f126-c98e-4442-b6ee-2507b5c112a2 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:18:57.618766 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 567/1138] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:18:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:18:59.795017 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fea1bd-356e-4a06-b449-af2e01e76b54 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:59.795809 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fea1bd-356e-4a06-b449-af2e01e76b54 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:59.795809 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fea1bd-356e-4a06-b449-af2e01e76b54 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:59.797941 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 572/1139] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 13:18:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:18:59.807245 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3759a2-43f9-4419-923f-ebc40977cf62 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:18:59.807245 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3759a2-43f9-4419-923f-ebc40977cf62 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:18:59.807697 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3759a2-43f9-4419-923f-ebc40977cf62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:18:59.883913 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-4b3759a2-43f9-4419-923f-ebc40977cf62 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:18:59.885121 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4b3759a2-43f9-4419-923f-ebc40977cf62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:18:59.926700 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:18:59.995151 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 568/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 13:18:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:19:00.320216 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fea1bd-356e-4a06-b449-af2e01e76b54 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:19:00.321831 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-77fea1bd-356e-4a06-b449-af2e01e76b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:19:00.456509 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fea1bd-356e-4a06-b449-af2e01e76b54 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:19:00.509319 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:19:00.555485 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c5458-1f37-4712-a7bc-f90644d5049b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:19:00.556096 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c5458-1f37-4712-a7bc-f90644d5049b service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:19:00.556380 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c5458-1f37-4712-a7bc-f90644d5049b service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:19:00.556650 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c5458-1f37-4712-a7bc-f90644d5049b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:19:00.558399 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-760c5458-1f37-4712-a7bc-f90644d5049b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:19:00.689288 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c5458-1f37-4712-a7bc-f90644d5049b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:19:00.690770 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c5458-1f37-4712-a7bc-f90644d5049b service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:19:00.713304 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 573/1141] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:19:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:19:02.870877 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464a806-7891-4ec3-b2ee-d3f026404fb0 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:19:02.871739 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464a806-7891-4ec3-b2ee-d3f026404fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:19:02.871739 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464a806-7891-4ec3-b2ee-d3f026404fb0 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:19:02.874089 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 569/1142] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 13:19:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:19:02.879645 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09a8c8-9210-4f34-bf69-8bdaad2947e3 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:19:02.880090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09a8c8-9210-4f34-bf69-8bdaad2947e3 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:19:02.880183 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09a8c8-9210-4f34-bf69-8bdaad2947e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:19:02.953840 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-1b09a8c8-9210-4f34-bf69-8bdaad2947e3 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:19:02.955048 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1b09a8c8-9210-4f34-bf69-8bdaad2947e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:19:02.974813 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:19:03.057701 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 574/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 13:19:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:19:03.339753 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464a806-7891-4ec3-b2ee-d3f026404fb0 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:19:03.341281 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5464a806-7891-4ec3-b2ee-d3f026404fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:19:03.456711 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464a806-7891-4ec3-b2ee-d3f026404fb0 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:19:03.538472 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:19:03.545949 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55cc81-d6fb-4d23-8fbb-03b1273e70a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:19:03.546559 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55cc81-d6fb-4d23-8fbb-03b1273e70a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:19:03.546834 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55cc81-d6fb-4d23-8fbb-03b1273e70a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:19:03.547132 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55cc81-d6fb-4d23-8fbb-03b1273e70a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:19:03.548750 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-df55cc81-d6fb-4d23-8fbb-03b1273e70a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:19:03.663877 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df55cc81-d6fb-4d23-8fbb-03b1273e70a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:19:03.665257 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df55cc81-d6fb-4d23-8fbb-03b1273e70a6 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:19:03.685431 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 570/1144] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:19:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:19:05.908273 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e1217-2a57-4246-a68c-99713dcaff7f None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:19:05.908864 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e1217-2a57-4246-a68c-99713dcaff7f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:19:05.908864 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e1217-2a57-4246-a68c-99713dcaff7f None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:19:05.910300 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 575/1145] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 13:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:19:05.915877 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a43a08-486a-401e-b320-f7229e606eed None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:19:05.916303 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a43a08-486a-401e-b320-f7229e606eed None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:19:05.916397 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a43a08-486a-401e-b320-f7229e606eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:19:05.984804 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-c1a43a08-486a-401e-b320-f7229e606eed None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:19:05.986048 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c1a43a08-486a-401e-b320-f7229e606eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:19:06.037644 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:19:06.091079 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 571/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 13:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:19:06.373985 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e1217-2a57-4246-a68c-99713dcaff7f None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:19:06.376467 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-257e1217-2a57-4246-a68c-99713dcaff7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:19:06.487653 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e1217-2a57-4246-a68c-99713dcaff7f None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:19:06.541718 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:19:06.568671 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b26a3-5f15-4639-8053-6b1298b49bc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:19:06.569273 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b26a3-5f15-4639-8053-6b1298b49bc9 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:19:06.569571 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b26a3-5f15-4639-8053-6b1298b49bc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:19:06.569834 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b26a3-5f15-4639-8053-6b1298b49bc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:19:06.571374 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-9b1b26a3-5f15-4639-8053-6b1298b49bc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:19:06.686172 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b26a3-5f15-4639-8053-6b1298b49bc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:19:06.687919 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b26a3-5f15-4639-8053-6b1298b49bc9 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:19:06.708058 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 576/1147] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:19:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:19:16.089800 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=22 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:19:16.705259 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=66 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:19:26.516749 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa14bf-d45f-497c-8b21-b9bac151a406 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:19:26.517319 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa14bf-d45f-497c-8b21-b9bac151a406 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:19:26.517319 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa14bf-d45f-497c-8b21-b9bac151a406 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:19:26.519076 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 572/1148] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:19:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:19:26.525397 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cde840-dd3c-49e4-8e67-469039ab828a None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:19:26.525854 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cde840-dd3c-49e4-8e67-469039ab828a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:19:26.526051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cde840-dd3c-49e4-8e67-469039ab828a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:19:26.605096 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-83cde840-dd3c-49e4-8e67-469039ab828a None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:19:26.606368 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-83cde840-dd3c-49e4-8e67-469039ab828a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:19:26.706037 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 577/1149] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:19:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:19:27.004544 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d880a-9ed6-4f90-b352-2341948ecbde None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:19:27.004829 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d880a-9ed6-4f90-b352-2341948ecbde None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:19:27.005103 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d880a-9ed6-4f90-b352-2341948ecbde None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:19:27.006879 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 573/1150] 10.222.0.52 () {54 vars in 962 bytes} [Thu Oct 27 13:19:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:19:27.014344 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587a145-dcb2-4940-9ece-45c2f9710d61 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:19:27.014729 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587a145-dcb2-4940-9ece-45c2f9710d61 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:19:27.015172 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587a145-dcb2-4940-9ece-45c2f9710d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:19:27.099310 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-b587a145-dcb2-4940-9ece-45c2f9710d61 None None] MFA Rules not processed for user `2298dbfcf7b74668902781401f77215e`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:19:27.100926 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b587a145-dcb2-4940-9ece-45c2f9710d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:19:27.124513 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:19:27.183412 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 578/1151] 10.222.0.52 () {58 vars in 1059 bytes} [Thu Oct 27 13:19:27 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:19:27.191838 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d880a-9ed6-4f90-b352-2341948ecbde None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:19:27.193362 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d23d880a-9ed6-4f90-b352-2341948ecbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:19:27.299122 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d880a-9ed6-4f90-b352-2341948ecbde None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:19:27.378390 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be039d-9b29-4045-8298-11b6f540d7b1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2298dbfcf7b74668902781401f77215e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:19:27.378916 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be039d-9b29-4045-8298-11b6f540d7b1 service glance] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:19:27.379192 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be039d-9b29-4045-8298-11b6f540d7b1 service glance] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:19:27.379459 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be039d-9b29-4045-8298-11b6f540d7b1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:19:27.381033 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d3be039d-9b29-4045-8298-11b6f540d7b1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:19:27.435185 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:19:27.503167 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be039d-9b29-4045-8298-11b6f540d7b1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:19:27.504603 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be039d-9b29-4045-8298-11b6f540d7b1 service glance] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:19:27.524865 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 574/1152] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:19:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:19:29.734988 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5c7e6-5d7f-46e9-b822-3e8f0853a358 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:19:29.735564 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5c7e6-5d7f-46e9-b822-3e8f0853a358 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:19:29.735564 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5c7e6-5d7f-46e9-b822-3e8f0853a358 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:19:29.737014 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 579/1153] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:19:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:19:29.742310 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e7f57-4e3b-4ce9-92ab-54e9bf2f2c89 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:19:29.742770 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e7f57-4e3b-4ce9-92ab-54e9bf2f2c89 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:19:29.742868 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e7f57-4e3b-4ce9-92ab-54e9bf2f2c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:19:29.816372 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-862e7f57-4e3b-4ce9-92ab-54e9bf2f2c89 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:19:29.817591 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-862e7f57-4e3b-4ce9-92ab-54e9bf2f2c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:19:29.924225 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 575/1154] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:19:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:19:30.192816 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5c7e6-5d7f-46e9-b822-3e8f0853a358 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:19:30.194402 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-53e5c7e6-5d7f-46e9-b822-3e8f0853a358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:19:30.333583 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5c7e6-5d7f-46e9-b822-3e8f0853a358 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:19:30.387412 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:19:30.433266 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e02d1a5-ebc7-4726-98a6-55cf8579fc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:19:30.433902 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02d1a5-ebc7-4726-98a6-55cf8579fc20 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:19:30.434173 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02d1a5-ebc7-4726-98a6-55cf8579fc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:19:30.434437 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02d1a5-ebc7-4726-98a6-55cf8579fc20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:19:30.435079 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e02d1a5-ebc7-4726-98a6-55cf8579fc20 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:19:30.436113 dv-cinder-862432-3-smb devstack@keystone.service[81482]: WARNING py.warnings [None req-7e02d1a5-ebc7-4726-98a6-55cf8579fc20 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:19:30.436113 dv-cinder-862432-3-smb devstack@keystone.service[81482]: warnings.warn(msg) Oct 27 13:19:30.436113 dv-cinder-862432-3-smb devstack@keystone.service[81482]: Oct 27 13:19:30.437569 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e02d1a5-ebc7-4726-98a6-55cf8579fc20 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:19:30.457028 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 580/1155] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Oct 27 13:19:30 2022] GET /identity/v3/projects => generated 2553 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:19:32.628758 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efe129-ddf5-4544-b6e8-604175f0cd77 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:19:32.629354 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efe129-ddf5-4544-b6e8-604175f0cd77 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:19:32.629354 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efe129-ddf5-4544-b6e8-604175f0cd77 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:19:32.630686 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 576/1156] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:19:32.636196 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f453f-7f8f-4f46-b421-69cfd6440dee None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:19:32.636647 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f453f-7f8f-4f46-b421-69cfd6440dee None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:19:32.636750 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f453f-7f8f-4f46-b421-69cfd6440dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:19:32.705810 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-cd1f453f-7f8f-4f46-b421-69cfd6440dee None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:19:32.707015 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-cd1f453f-7f8f-4f46-b421-69cfd6440dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:19:32.808327 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 581/1157] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:19:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:19:33.102734 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efe129-ddf5-4544-b6e8-604175f0cd77 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:19:33.105187 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f4efe129-ddf5-4544-b6e8-604175f0cd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:19:33.118336 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:19:33.272141 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efe129-ddf5-4544-b6e8-604175f0cd77 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:19:33.357889 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:19:33.398711 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c11fe-8729-441c-8060-ce69dc38e2f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719e4bf834d6490b96066e55a26fb159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:19:33.399316 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c11fe-8729-441c-8060-ce69dc38e2f0 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:19:33.399594 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c11fe-8729-441c-8060-ce69dc38e2f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:19:33.399857 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c11fe-8729-441c-8060-ce69dc38e2f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:19:33.401467 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8f4c11fe-8729-441c-8060-ce69dc38e2f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:19:33.494781 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4c11fe-8729-441c-8060-ce69dc38e2f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:19:33.496371 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4c11fe-8729-441c-8060-ce69dc38e2f0 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:19:33.514822 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 577/1158] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:19:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:19:35.822294 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666cdea-5984-47e3-853d-27f0c2202143 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:19:35.822803 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666cdea-5984-47e3-853d-27f0c2202143 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:19:35.822803 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666cdea-5984-47e3-853d-27f0c2202143 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:19:35.824183 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 582/1159] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:19:35.829661 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ed9d2-a95d-4de4-a802-9995fab5a40d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:19:35.830135 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ed9d2-a95d-4de4-a802-9995fab5a40d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:19:35.830242 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ed9d2-a95d-4de4-a802-9995fab5a40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:19:35.896952 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-b10ed9d2-a95d-4de4-a802-9995fab5a40d None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:19:35.898165 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b10ed9d2-a95d-4de4-a802-9995fab5a40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:19:35.945548 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:19:36.009453 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 578/1160] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:19:36.296908 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666cdea-5984-47e3-853d-27f0c2202143 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:19:36.299497 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6666cdea-5984-47e3-853d-27f0c2202143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:19:36.328715 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:19:36.417648 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666cdea-5984-47e3-853d-27f0c2202143 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:19:36.494253 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca07fe-52b1-4e80-b544-ec353b0972af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:19:36.494863 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca07fe-52b1-4e80-b544-ec353b0972af service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:19:36.495139 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca07fe-52b1-4e80-b544-ec353b0972af service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:19:36.495408 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca07fe-52b1-4e80-b544-ec353b0972af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:19:36.497001 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-bfca07fe-52b1-4e80-b544-ec353b0972af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:19:36.577774 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:19:36.615816 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca07fe-52b1-4e80-b544-ec353b0972af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:19:36.617294 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca07fe-52b1-4e80-b544-ec353b0972af service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:19:36.636260 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 583/1161] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:19:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:19:38.816519 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bf8d9-e8b2-46a6-a43f-ce0d4b734ebd None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:19:38.817005 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bf8d9-e8b2-46a6-a43f-ce0d4b734ebd None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:19:38.817113 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bf8d9-e8b2-46a6-a43f-ce0d4b734ebd None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:19:38.818488 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 579/1162] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:19:38.824094 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a01654-a302-48d7-b15c-f82713b7120d None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:19:38.824521 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a01654-a302-48d7-b15c-f82713b7120d None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:19:38.824613 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a01654-a302-48d7-b15c-f82713b7120d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:19:38.900610 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-13a01654-a302-48d7-b15c-f82713b7120d None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:19:38.901856 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-13a01654-a302-48d7-b15c-f82713b7120d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:19:39.004116 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 584/1163] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:19:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:19:39.295903 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25bf8d9-e8b2-46a6-a43f-ce0d4b734ebd None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:19:39.297449 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e25bf8d9-e8b2-46a6-a43f-ce0d4b734ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:19:39.407900 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25bf8d9-e8b2-46a6-a43f-ce0d4b734ebd None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:19:39.489259 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:19:39.491244 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e78043-257c-46f2-a706-6379d16fd4ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:19:39.492030 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e78043-257c-46f2-a706-6379d16fd4ad service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:19:39.492340 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e78043-257c-46f2-a706-6379d16fd4ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:19:39.492697 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e78043-257c-46f2-a706-6379d16fd4ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:19:39.496274 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c7e78043-257c-46f2-a706-6379d16fd4ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:19:39.615967 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e78043-257c-46f2-a706-6379d16fd4ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:19:39.617324 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e78043-257c-46f2-a706-6379d16fd4ad service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:19:39.637682 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 580/1164] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:19:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:19:41.898578 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52c59e-5663-405a-b510-ef9c7b69f678 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:19:41.899164 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52c59e-5663-405a-b510-ef9c7b69f678 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:19:41.899164 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52c59e-5663-405a-b510-ef9c7b69f678 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:19:41.901210 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 585/1165] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:19:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:19:41.910289 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2116a0a-b6b2-4bbe-bd90-bf2a412af0a3 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:19:41.910713 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2116a0a-b6b2-4bbe-bd90-bf2a412af0a3 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:19:41.910956 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2116a0a-b6b2-4bbe-bd90-bf2a412af0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:19:41.984155 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d2116a0a-b6b2-4bbe-bd90-bf2a412af0a3 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:19:41.985354 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d2116a0a-b6b2-4bbe-bd90-bf2a412af0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:19:42.042863 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:19:42.089944 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 581/1166] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:19:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:19:42.380264 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52c59e-5663-405a-b510-ef9c7b69f678 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:19:42.381854 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-fd52c59e-5663-405a-b510-ef9c7b69f678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:19:42.422163 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:19:42.491852 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52c59e-5663-405a-b510-ef9c7b69f678 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:19:42.577092 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf205653-9cb5-4e07-8a84-bd56d0112700 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:19:42.577769 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf205653-9cb5-4e07-8a84-bd56d0112700 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:19:42.578044 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf205653-9cb5-4e07-8a84-bd56d0112700 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:19:42.578310 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf205653-9cb5-4e07-8a84-bd56d0112700 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:19:42.579908 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-cf205653-9cb5-4e07-8a84-bd56d0112700 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:19:42.666097 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:19:42.696686 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf205653-9cb5-4e07-8a84-bd56d0112700 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:19:42.698161 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf205653-9cb5-4e07-8a84-bd56d0112700 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:19:42.716606 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 586/1167] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:19:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:19:45.069639 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7aa774-9587-4010-ad7f-4cec4e2705c9 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:19:45.070149 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7aa774-9587-4010-ad7f-4cec4e2705c9 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:19:45.070149 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7aa774-9587-4010-ad7f-4cec4e2705c9 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:19:45.072166 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 582/1168] 10.222.0.52 () {54 vars in 927 bytes} [Thu Oct 27 13:19:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:19:45.080346 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3707143-4846-4fe7-88ce-f71363f608f8 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:19:45.080759 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3707143-4846-4fe7-88ce-f71363f608f8 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:19:45.080914 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3707143-4846-4fe7-88ce-f71363f608f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:19:45.153914 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-c3707143-4846-4fe7-88ce-f71363f608f8 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:19:45.155688 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c3707143-4846-4fe7-88ce-f71363f608f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:19:45.264151 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 587/1169] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Oct 27 13:19:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:19:45.550165 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7aa774-9587-4010-ad7f-4cec4e2705c9 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:19:45.552568 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ad7aa774-9587-4010-ad7f-4cec4e2705c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:19:45.675167 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7aa774-9587-4010-ad7f-4cec4e2705c9 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:19:45.753307 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f68e6e-6d4b-48a2-8710-e0731ca68af9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:19:45.753937 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f68e6e-6d4b-48a2-8710-e0731ca68af9 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:19:45.754191 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f68e6e-6d4b-48a2-8710-e0731ca68af9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:19:45.754490 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f68e6e-6d4b-48a2-8710-e0731ca68af9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:19:45.756061 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b1f68e6e-6d4b-48a2-8710-e0731ca68af9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:19:45.764577 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:19:45.886772 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f68e6e-6d4b-48a2-8710-e0731ca68af9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:19:45.888776 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f68e6e-6d4b-48a2-8710-e0731ca68af9 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:19:45.910253 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 583/1170] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:19:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:19:55.262380 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=82 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:19:55.907953 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=50 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:20:59.536742 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e638bb-f67a-4c2e-bc79-8868181de1ad None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:20:59.537276 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e638bb-f67a-4c2e-bc79-8868181de1ad None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:20:59.537276 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e638bb-f67a-4c2e-bc79-8868181de1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:20:59.614839 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-18e638bb-f67a-4c2e-bc79-8868181de1ad None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:20:59.616028 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-18e638bb-f67a-4c2e-bc79-8868181de1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:20:59.726287 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 588/1171] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:20:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:20:59.734478 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66946478-abf7-4c8c-b1f4-5c6240a6a0a1 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:20:59.735011 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66946478-abf7-4c8c-b1f4-5c6240a6a0a1 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:20:59.735011 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66946478-abf7-4c8c-b1f4-5c6240a6a0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:20:59.814291 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-66946478-abf7-4c8c-b1f4-5c6240a6a0a1 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:20:59.815532 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-66946478-abf7-4c8c-b1f4-5c6240a6a0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:20:59.921766 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 584/1172] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:20:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:20:59.926629 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e638bb-f67a-4c2e-bc79-8868181de1ad None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:20:59.927902 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-18e638bb-f67a-4c2e-bc79-8868181de1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:20:59.940583 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e638bb-f67a-4c2e-bc79-8868181de1ad None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:21:00.007651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:21:00.043468 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cba7c9-08fd-49c9-adc7-ed73fa84001c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:21:00.044072 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cba7c9-08fd-49c9-adc7-ed73fa84001c admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:21:00.044345 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cba7c9-08fd-49c9-adc7-ed73fa84001c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:21:00.044666 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cba7c9-08fd-49c9-adc7-ed73fa84001c admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:21:00.045338 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cba7c9-08fd-49c9-adc7-ed73fa84001c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:21:00.045625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cba7c9-08fd-49c9-adc7-ed73fa84001c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:21:00.046757 dv-cinder-862432-3-smb devstack@keystone.service[81482]: WARNING py.warnings [None req-00cba7c9-08fd-49c9-adc7-ed73fa84001c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:21:00.046757 dv-cinder-862432-3-smb devstack@keystone.service[81482]: warnings.warn(msg) Oct 27 13:21:00.046757 dv-cinder-862432-3-smb devstack@keystone.service[81482]: Oct 27 13:21:00.047640 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cba7c9-08fd-49c9-adc7-ed73fa84001c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:21:00.058875 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 589/1173] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:20:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:21:00.073989 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66946478-abf7-4c8c-b1f4-5c6240a6a0a1 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:21:00.083937 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66946478-abf7-4c8c-b1f4-5c6240a6a0a1 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:21:00.150207 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:21:00.185087 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25bc383-a9b6-4b7c-8461-197820cdc2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:21:00.186037 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bc383-a9b6-4b7c-8461-197820cdc2a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:21:00.186329 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bc383-a9b6-4b7c-8461-197820cdc2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:21:00.186581 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bc383-a9b6-4b7c-8461-197820cdc2a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:21:00.187259 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25bc383-a9b6-4b7c-8461-197820cdc2a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:21:00.188413 dv-cinder-862432-3-smb devstack@keystone.service[81481]: WARNING py.warnings [None req-e25bc383-a9b6-4b7c-8461-197820cdc2a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:21:00.188413 dv-cinder-862432-3-smb devstack@keystone.service[81481]: warnings.warn(msg) Oct 27 13:21:00.188413 dv-cinder-862432-3-smb devstack@keystone.service[81481]: Oct 27 13:21:00.189639 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25bc383-a9b6-4b7c-8461-197820cdc2a7 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:21:00.252046 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 585/1174] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:21:00 2022] POST /identity/v3/projects => generated 377 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:21:00.256349 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cba7c9-08fd-49c9-adc7-ed73fa84001c admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:21:00.258265 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-00cba7c9-08fd-49c9-adc7-ed73fa84001c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:21:00.291692 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cba7c9-08fd-49c9-adc7-ed73fa84001c admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:21:00.389688 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c3928-7df8-4be1-b535-deb3371b3a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:21:00.390354 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c3928-7df8-4be1-b535-deb3371b3a13 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:21:00.390720 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c3928-7df8-4be1-b535-deb3371b3a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:21:00.390986 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c3928-7df8-4be1-b535-deb3371b3a13 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:21:00.391610 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c3928-7df8-4be1-b535-deb3371b3a13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:21:00.392637 dv-cinder-862432-3-smb devstack@keystone.service[81482]: WARNING py.warnings [None req-964c3928-7df8-4be1-b535-deb3371b3a13 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:21:00.392637 dv-cinder-862432-3-smb devstack@keystone.service[81482]: warnings.warn(msg) Oct 27 13:21:00.392637 dv-cinder-862432-3-smb devstack@keystone.service[81482]: Oct 27 13:21:00.393857 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c3928-7df8-4be1-b535-deb3371b3a13 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:21:00.448115 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 590/1175] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:21:00 2022] POST /identity/v3/users => generated 289 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:21:00.452385 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25bc383-a9b6-4b7c-8461-197820cdc2a7 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:21:00.453959 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e25bc383-a9b6-4b7c-8461-197820cdc2a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:21:00.516994 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25bc383-a9b6-4b7c-8461-197820cdc2a7 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:21:00.620235 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:21:00.632021 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b0041-d4cc-4d90-b4c6-7788d6a370e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:21:00.632636 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b0041-d4cc-4d90-b4c6-7788d6a370e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:21:00.632919 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b0041-d4cc-4d90-b4c6-7788d6a370e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:21:00.633196 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b0041-d4cc-4d90-b4c6-7788d6a370e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:21:00.633866 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b0041-d4cc-4d90-b4c6-7788d6a370e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:21:00.635465 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b0041-d4cc-4d90-b4c6-7788d6a370e7 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:21:00.648253 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 586/1176] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:21:00.652679 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c3928-7df8-4be1-b535-deb3371b3a13 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:21:00.654229 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-964c3928-7df8-4be1-b535-deb3371b3a13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:21:00.666231 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c3928-7df8-4be1-b535-deb3371b3a13 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:21:00.694759 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:21:00.767595 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29687fb9-0b83-45ca-8fb6-400e2f8afe13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:21:00.768115 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29687fb9-0b83-45ca-8fb6-400e2f8afe13 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:21:00.768387 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29687fb9-0b83-45ca-8fb6-400e2f8afe13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:21:00.768655 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29687fb9-0b83-45ca-8fb6-400e2f8afe13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:21:00.769288 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29687fb9-0b83-45ca-8fb6-400e2f8afe13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:21:00.770933 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29687fb9-0b83-45ca-8fb6-400e2f8afe13 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:21:00.783562 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 591/1177] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:21:00.788114 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b0041-d4cc-4d90-b4c6-7788d6a370e7 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:21:00.789750 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6f9b0041-d4cc-4d90-b4c6-7788d6a370e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:21:00.824789 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b0041-d4cc-4d90-b4c6-7788d6a370e7 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:21:00.930906 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199585b6-e992-4160-aad8-faefc81e45cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:21:00.931554 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199585b6-e992-4160-aad8-faefc81e45cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:21:00.931831 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199585b6-e992-4160-aad8-faefc81e45cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:21:00.932100 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199585b6-e992-4160-aad8-faefc81e45cf admin admin] PATH_INFO: `/v3/projects/9b7c1bb236fe4373960cff9e11acae0f/users/ea8e32860e5c4e4885eda35ba57d8574/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:21:00.955432 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199585b6-e992-4160-aad8-faefc81e45cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b7c1bb236fe4373960cff9e11acae0f, user_id=ea8e32860e5c4e4885eda35ba57d8574, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:21:00.958137 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199585b6-e992-4160-aad8-faefc81e45cf admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:21:00.987596 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 587/1178] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:21:00 2022] PUT /identity/v3/projects/9b7c1bb236fe4373960cff9e11acae0f/users/ea8e32860e5c4e4885eda35ba57d8574/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:21:00.999112 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb197620-cad0-4fe9-adf7-2165f543bc55 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:21:00.999397 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb197620-cad0-4fe9-adf7-2165f543bc55 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:21:00.999740 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb197620-cad0-4fe9-adf7-2165f543bc55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:21:01.060911 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-eb197620-cad0-4fe9-adf7-2165f543bc55 None None] MFA Rules not processed for user `ea8e32860e5c4e4885eda35ba57d8574`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:21:01.062084 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-eb197620-cad0-4fe9-adf7-2165f543bc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:21:01.147609 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 592/1179] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:21:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:21:01.161546 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f749902-41cd-42db-b710-58d9aec74d6c None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:21:01.161836 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f749902-41cd-42db-b710-58d9aec74d6c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:21:01.162111 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f749902-41cd-42db-b710-58d9aec74d6c None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:21:01.163532 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 588/1180] 10.222.0.52 () {54 vars in 963 bytes} [Thu Oct 27 13:21:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:21:01.168384 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d4c60-f79c-4d2f-bafd-36913d10f9aa None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:21:01.168689 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d4c60-f79c-4d2f-bafd-36913d10f9aa None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:21:01.168959 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d4c60-f79c-4d2f-bafd-36913d10f9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:21:01.201273 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:21:01.258090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-b24d4c60-f79c-4d2f-bafd-36913d10f9aa None None] MFA Rules not processed for user `aa785d7f18b54de48a0ec78ec8642e17`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:21:01.259310 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b24d4c60-f79c-4d2f-bafd-36913d10f9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:21:01.341586 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 593/1181] 10.222.0.52 () {58 vars in 1060 bytes} [Thu Oct 27 13:21:01 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:21:01.349434 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f749902-41cd-42db-b710-58d9aec74d6c None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:21:01.350974 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7f749902-41cd-42db-b710-58d9aec74d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:21:01.405952 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:21:01.464622 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f749902-41cd-42db-b710-58d9aec74d6c None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:21:01.555935 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee66f9-abf2-4b94-ab69-1b3d8dd62a73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:21:01.556529 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee66f9-abf2-4b94-ab69-1b3d8dd62a73 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:21:01.556797 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee66f9-abf2-4b94-ab69-1b3d8dd62a73 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:21:01.557057 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee66f9-abf2-4b94-ab69-1b3d8dd62a73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:21:01.558656 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c5ee66f9-abf2-4b94-ab69-1b3d8dd62a73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:21:01.660306 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee66f9-abf2-4b94-ab69-1b3d8dd62a73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:21:01.661708 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee66f9-abf2-4b94-ab69-1b3d8dd62a73 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:21:01.665226 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:21:01.686033 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 589/1182] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:21:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:21:01.732429 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3024fd9-3654-46ad-bfb3-e22fc06c0a9a None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:21:01.732877 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3024fd9-3654-46ad-bfb3-e22fc06c0a9a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:21:01.733070 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3024fd9-3654-46ad-bfb3-e22fc06c0a9a None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:21:01.734522 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 594/1183] 10.222.0.52 () {52 vars in 830 bytes} [Thu Oct 27 13:21:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:21:01.738485 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee66f9-abf2-4b94-ab69-1b3d8dd62a73 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:21:01.739718 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c5ee66f9-abf2-4b94-ab69-1b3d8dd62a73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:21:01.850699 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee66f9-abf2-4b94-ab69-1b3d8dd62a73 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:21:01.960940 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388c9ff-88bb-4b45-888f-8a0a48e891cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:21:01.961581 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388c9ff-88bb-4b45-888f-8a0a48e891cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:21:01.961867 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388c9ff-88bb-4b45-888f-8a0a48e891cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:21:01.962145 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388c9ff-88bb-4b45-888f-8a0a48e891cb admin admin] PATH_INFO: `/v3/users/ea8e32860e5c4e4885eda35ba57d8574` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:21:01.976356 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5388c9ff-88bb-4b45-888f-8a0a48e891cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea8e32860e5c4e4885eda35ba57d8574)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:21:01.977504 dv-cinder-862432-3-smb devstack@keystone.service[81481]: WARNING py.warnings [None req-5388c9ff-88bb-4b45-888f-8a0a48e891cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:21:01.977504 dv-cinder-862432-3-smb devstack@keystone.service[81481]: warnings.warn(msg) Oct 27 13:21:01.977504 dv-cinder-862432-3-smb devstack@keystone.service[81481]: Oct 27 13:21:01.979356 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5388c9ff-88bb-4b45-888f-8a0a48e891cb admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:21:01.990247 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:21:02.050285 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5388c9ff-88bb-4b45-888f-8a0a48e891cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea8e32860e5c4e4885eda35ba57d8574'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:21:02.050723 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5388c9ff-88bb-4b45-888f-8a0a48e891cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea8e32860e5c4e4885eda35ba57d8574'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:21:02.069382 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5388c9ff-88bb-4b45-888f-8a0a48e891cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea8e32860e5c4e4885eda35ba57d8574'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:21:02.098555 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5388c9ff-88bb-4b45-888f-8a0a48e891cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea8e32860e5c4e4885eda35ba57d8574'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:21:02.099161 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5388c9ff-88bb-4b45-888f-8a0a48e891cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea8e32860e5c4e4885eda35ba57d8574'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:21:02.118741 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 590/1184] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:21:01 2022] DELETE /identity/v3/users/ea8e32860e5c4e4885eda35ba57d8574 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:21:02.123541 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819dd87-d3e6-4fc2-bad6-b355d667ddf7 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:21:02.123816 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819dd87-d3e6-4fc2-bad6-b355d667ddf7 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:21:02.124177 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819dd87-d3e6-4fc2-bad6-b355d667ddf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:21:02.196609 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-1819dd87-d3e6-4fc2-bad6-b355d667ddf7 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:21:02.198566 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1819dd87-d3e6-4fc2-bad6-b355d667ddf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:21:02.294986 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:21:02.308910 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 595/1185] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:21:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:21:02.320966 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388c9ff-88bb-4b45-888f-8a0a48e891cb admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:21:02.322234 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5388c9ff-88bb-4b45-888f-8a0a48e891cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:21:02.441298 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388c9ff-88bb-4b45-888f-8a0a48e891cb admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:21:02.509783 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:21:02.532888 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d240f226-e8f3-4893-b5aa-e1e1d86cba8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:21:02.533487 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240f226-e8f3-4893-b5aa-e1e1d86cba8f service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:21:02.533782 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240f226-e8f3-4893-b5aa-e1e1d86cba8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:21:02.534044 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240f226-e8f3-4893-b5aa-e1e1d86cba8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:21:02.535630 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d240f226-e8f3-4893-b5aa-e1e1d86cba8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:21:02.673664 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d240f226-e8f3-4893-b5aa-e1e1d86cba8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:21:02.676130 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d240f226-e8f3-4893-b5aa-e1e1d86cba8f service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:21:02.700165 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 591/1186] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:21:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:21:03.100349 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819dd87-d3e6-4fc2-bad6-b355d667ddf7 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:21:03.101665 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1819dd87-d3e6-4fc2-bad6-b355d667ddf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:21:03.113787 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819dd87-d3e6-4fc2-bad6-b355d667ddf7 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:21:03.230178 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33fa31-1d57-406c-8edf-d5af5b5a7b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:21:03.230718 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33fa31-1d57-406c-8edf-d5af5b5a7b2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:21:03.230995 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33fa31-1d57-406c-8edf-d5af5b5a7b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:21:03.231261 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33fa31-1d57-406c-8edf-d5af5b5a7b2b admin admin] PATH_INFO: `/v3/projects/9b7c1bb236fe4373960cff9e11acae0f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:21:03.241884 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33fa31-1d57-406c-8edf-d5af5b5a7b2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b7c1bb236fe4373960cff9e11acae0f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:21:03.242923 dv-cinder-862432-3-smb devstack@keystone.service[81482]: WARNING py.warnings [None req-1f33fa31-1d57-406c-8edf-d5af5b5a7b2b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:21:03.242923 dv-cinder-862432-3-smb devstack@keystone.service[81482]: warnings.warn(msg) Oct 27 13:21:03.242923 dv-cinder-862432-3-smb devstack@keystone.service[81482]: Oct 27 13:21:03.244139 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33fa31-1d57-406c-8edf-d5af5b5a7b2b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:21:03.307323 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1f33fa31-1d57-406c-8edf-d5af5b5a7b2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b7c1bb236fe4373960cff9e11acae0f', 'request_id': 'req-1f33fa31-1d57-406c-8edf-d5af5b5a7b2b'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:21:03.319630 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1f33fa31-1d57-406c-8edf-d5af5b5a7b2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b7c1bb236fe4373960cff9e11acae0f', 'request_id': 'req-1f33fa31-1d57-406c-8edf-d5af5b5a7b2b'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:21:03.335236 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1f33fa31-1d57-406c-8edf-d5af5b5a7b2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b7c1bb236fe4373960cff9e11acae0f', 'request_id': 'req-1f33fa31-1d57-406c-8edf-d5af5b5a7b2b'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:21:03.359155 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1f33fa31-1d57-406c-8edf-d5af5b5a7b2b admin admin] The token cache is being invalidate because project 9b7c1bb236fe4373960cff9e11acae0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:21:03.359433 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1f33fa31-1d57-406c-8edf-d5af5b5a7b2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:21:03.359861 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1f33fa31-1d57-406c-8edf-d5af5b5a7b2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:21:03.361252 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 596/1187] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:21:03 2022] DELETE /identity/v3/projects/9b7c1bb236fe4373960cff9e11acae0f => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:21:12.696473 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=62 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:21:13.356889 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:22:36.933331 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd25576-1c86-4f96-9e00-3d335d9425ad None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:22:36.933985 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd25576-1c86-4f96-9e00-3d335d9425ad None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:22:36.933985 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd25576-1c86-4f96-9e00-3d335d9425ad None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:22:36.936212 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 592/1188] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 27 13:22:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:22:36.941358 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257ed12-2715-419a-9244-69fd72615a6b None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:22:36.941869 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257ed12-2715-419a-9244-69fd72615a6b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:22:36.941869 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257ed12-2715-419a-9244-69fd72615a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:22:37.028946 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-9257ed12-2715-419a-9244-69fd72615a6b None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:22:37.030229 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-9257ed12-2715-419a-9244-69fd72615a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:22:37.157177 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 597/1189] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 27 13:22:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:22:37.323681 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd25576-1c86-4f96-9e00-3d335d9425ad None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:22:37.327423 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-bdd25576-1c86-4f96-9e00-3d335d9425ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:22:37.461913 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd25576-1c86-4f96-9e00-3d335d9425ad None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:22:37.467960 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d39908-a81d-41ef-b3af-e66d7a1a5b9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719e4bf834d6490b96066e55a26fb159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:22:37.468542 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d39908-a81d-41ef-b3af-e66d7a1a5b9b service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:22:37.468840 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d39908-a81d-41ef-b3af-e66d7a1a5b9b service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:22:37.469095 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d39908-a81d-41ef-b3af-e66d7a1a5b9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:22:37.477416 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d39908-a81d-41ef-b3af-e66d7a1a5b9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:22:37.479111 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d39908-a81d-41ef-b3af-e66d7a1a5b9b service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:22:37.489642 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 593/1190] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:22:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:22:38.547005 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48003a0a-d2ed-49cb-a426-830d9929198b None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:22:38.547588 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48003a0a-d2ed-49cb-a426-830d9929198b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:22:38.547702 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48003a0a-d2ed-49cb-a426-830d9929198b None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:22:38.549062 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 598/1191] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 27 13:22:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:22:38.554104 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea232c-3177-48c3-b218-af64d6d200f2 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:22:38.554542 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea232c-3177-48c3-b218-af64d6d200f2 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:22:38.554650 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea232c-3177-48c3-b218-af64d6d200f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:22:38.575503 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-c5ea232c-3177-48c3-b218-af64d6d200f2 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:22:38.576778 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c5ea232c-3177-48c3-b218-af64d6d200f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:22:38.586411 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 594/1192] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 27 13:22:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:22:38.745098 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48003a0a-d2ed-49cb-a426-830d9929198b None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:22:38.760769 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48003a0a-d2ed-49cb-a426-830d9929198b None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:22:38.767202 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad28ec-12aa-4bea-ad77-18c26c2f78f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719e4bf834d6490b96066e55a26fb159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:22:38.767801 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad28ec-12aa-4bea-ad77-18c26c2f78f0 service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:22:38.768077 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad28ec-12aa-4bea-ad77-18c26c2f78f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:22:38.768348 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad28ec-12aa-4bea-ad77-18c26c2f78f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:22:38.776661 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fad28ec-12aa-4bea-ad77-18c26c2f78f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:22:38.778623 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fad28ec-12aa-4bea-ad77-18c26c2f78f0 service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:22:38.788726 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 599/1193] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:22:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:22:38.950084 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2ed44-8ac4-4f68-bc3d-e69f1ea14cee None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:22:38.950372 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2ed44-8ac4-4f68-bc3d-e69f1ea14cee None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:22:38.950661 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2ed44-8ac4-4f68-bc3d-e69f1ea14cee None None] PATH_INFO: `/v3` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:22:38.951965 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 595/1194] 10.222.0.49 () {54 vars in 925 bytes} [Thu Oct 27 13:22:38 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:22:38.958239 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba1d2d-bf5f-47bf-a862-ecddcd2063fe None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:22:38.958519 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba1d2d-bf5f-47bf-a862-ecddcd2063fe None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:22:38.958787 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba1d2d-bf5f-47bf-a862-ecddcd2063fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:22:39.023076 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-11ba1d2d-bf5f-47bf-a862-ecddcd2063fe None None] MFA Rules not processed for user `cbcd6da4e42248a3b38101104fbc03cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:22:39.024303 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-11ba1d2d-bf5f-47bf-a862-ecddcd2063fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:22:39.042044 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:22:39.099988 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 600/1195] 10.222.0.49 () {58 vars in 1015 bytes} [Thu Oct 27 13:22:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:22:42.690373 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05bdb9-a03c-4fcb-bcc1-08357b1e1161 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:22:42.690818 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05bdb9-a03c-4fcb-bcc1-08357b1e1161 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:22:42.690931 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05bdb9-a03c-4fcb-bcc1-08357b1e1161 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:22:42.692758 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 596/1196] 10.222.0.52 () {54 vars in 961 bytes} [Thu Oct 27 13:22:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:22:42.700279 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83437f1a-6249-4ec1-af93-b116abf4dcd6 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:22:42.700759 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83437f1a-6249-4ec1-af93-b116abf4dcd6 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:22:42.700865 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83437f1a-6249-4ec1-af93-b116abf4dcd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:22:42.720706 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-83437f1a-6249-4ec1-af93-b116abf4dcd6 None None] MFA Rules not processed for user `cbcd6da4e42248a3b38101104fbc03cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:22:42.721950 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-83437f1a-6249-4ec1-af93-b116abf4dcd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:22:42.731272 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 601/1197] 10.222.0.52 () {58 vars in 1058 bytes} [Thu Oct 27 13:22:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:22:42.739008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05bdb9-a03c-4fcb-bcc1-08357b1e1161 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:22:42.754040 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05bdb9-a03c-4fcb-bcc1-08357b1e1161 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:22:42.759763 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fbfd67-26d5-4540-b9b7-dc5446c63d6c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbcd6da4e42248a3b38101104fbc03cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:22:42.760567 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbfd67-26d5-4540-b9b7-dc5446c63d6c service placement] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:22:42.760841 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbfd67-26d5-4540-b9b7-dc5446c63d6c service placement] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:22:42.761107 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbfd67-26d5-4540-b9b7-dc5446c63d6c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:22:42.769892 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fbfd67-26d5-4540-b9b7-dc5446c63d6c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:22:42.771509 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fbfd67-26d5-4540-b9b7-dc5446c63d6c service placement] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:22:42.781410 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 597/1198] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:22:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:22:50.259374 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468704b-cf04-4aeb-a552-82379a570058 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:22:50.260222 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468704b-cf04-4aeb-a552-82379a570058 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:22:50.260222 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468704b-cf04-4aeb-a552-82379a570058 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:22:50.262320 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 602/1199] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 27 13:22:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:22:50.267698 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801867f6-4e35-400b-bd35-04c6173953e8 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:22:50.268156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801867f6-4e35-400b-bd35-04c6173953e8 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:22:50.268264 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801867f6-4e35-400b-bd35-04c6173953e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:22:50.290620 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-801867f6-4e35-400b-bd35-04c6173953e8 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:22:50.291802 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-801867f6-4e35-400b-bd35-04c6173953e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:22:50.302387 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 598/1200] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 27 13:22:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:22:50.465776 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468704b-cf04-4aeb-a552-82379a570058 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:22:50.486050 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468704b-cf04-4aeb-a552-82379a570058 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:22:50.491830 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538f87d-3737-4603-9808-3b6d08aa5356 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719e4bf834d6490b96066e55a26fb159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:22:50.492478 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538f87d-3737-4603-9808-3b6d08aa5356 service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:22:50.492752 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538f87d-3737-4603-9808-3b6d08aa5356 service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:22:50.493020 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538f87d-3737-4603-9808-3b6d08aa5356 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:22:50.501985 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2538f87d-3737-4603-9808-3b6d08aa5356 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:22:50.503581 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2538f87d-3737-4603-9808-3b6d08aa5356 service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:22:50.513299 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 603/1201] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:22:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:22:51.559339 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d26bf0-1607-4a0f-9431-816caa3a3e96 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:22:51.560597 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d26bf0-1607-4a0f-9431-816caa3a3e96 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:22:51.560597 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d26bf0-1607-4a0f-9431-816caa3a3e96 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:22:51.562790 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 599/1202] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 27 13:22:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:22:51.568627 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108eb61-c7c1-4178-89af-eca2a68f7191 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:22:51.569433 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108eb61-c7c1-4178-89af-eca2a68f7191 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:22:51.569609 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108eb61-c7c1-4178-89af-eca2a68f7191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:22:51.598377 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-4108eb61-c7c1-4178-89af-eca2a68f7191 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:22:51.599579 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-4108eb61-c7c1-4178-89af-eca2a68f7191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:22:51.608437 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 604/1203] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 27 13:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:22:51.762658 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d26bf0-1607-4a0f-9431-816caa3a3e96 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:22:51.779790 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d26bf0-1607-4a0f-9431-816caa3a3e96 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:22:51.786732 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcd610-cb48-4429-a59e-0119b6b58307 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719e4bf834d6490b96066e55a26fb159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:22:51.787337 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcd610-cb48-4429-a59e-0119b6b58307 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:22:51.787619 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcd610-cb48-4429-a59e-0119b6b58307 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:22:51.787860 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcd610-cb48-4429-a59e-0119b6b58307 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:22:51.797093 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dcd610-cb48-4429-a59e-0119b6b58307 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:22:51.798761 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dcd610-cb48-4429-a59e-0119b6b58307 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:22:51.808479 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 600/1204] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:22:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:22:55.907003 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fa05f-ce89-4292-a279-a7ef785189e4 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:22:55.907577 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fa05f-ce89-4292-a279-a7ef785189e4 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:22:55.907577 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fa05f-ce89-4292-a279-a7ef785189e4 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:22:55.909688 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 605/1205] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 13:22:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:22:55.917855 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fc992-4990-4d82-bb17-46b57d7c0466 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:22:55.918327 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fc992-4990-4d82-bb17-46b57d7c0466 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:22:55.918663 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fc992-4990-4d82-bb17-46b57d7c0466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:22:55.940381 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-5d7fc992-4990-4d82-bb17-46b57d7c0466 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:22:55.941570 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5d7fc992-4990-4d82-bb17-46b57d7c0466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:22:55.950105 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 601/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 13:22:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:22:56.247159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7fa05f-ce89-4292-a279-a7ef785189e4 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:22:56.250608 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-da7fa05f-ce89-4292-a279-a7ef785189e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:22:56.350428 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7fa05f-ce89-4292-a279-a7ef785189e4 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:22:56.354504 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4786d6-2eae-4461-9554-48e094d2b751 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:22:56.355108 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4786d6-2eae-4461-9554-48e094d2b751 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:22:56.355501 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4786d6-2eae-4461-9554-48e094d2b751 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:22:56.355749 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4786d6-2eae-4461-9554-48e094d2b751 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:22:56.365036 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4786d6-2eae-4461-9554-48e094d2b751 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:22:56.366582 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4786d6-2eae-4461-9554-48e094d2b751 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:22:56.376048 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 606/1207] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:22:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:22:58.492983 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81854768-f062-4813-af2f-72886e448f7d None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:22:58.493893 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81854768-f062-4813-af2f-72886e448f7d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:22:58.493893 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81854768-f062-4813-af2f-72886e448f7d None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:22:58.496323 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 602/1208] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 13:22:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:22:58.505428 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc01b2a-ea0e-4c70-9931-81948b757bcd None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:22:58.505888 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc01b2a-ea0e-4c70-9931-81948b757bcd None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:22:58.506034 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc01b2a-ea0e-4c70-9931-81948b757bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:22:58.528936 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-3fc01b2a-ea0e-4c70-9931-81948b757bcd None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:22:58.530170 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3fc01b2a-ea0e-4c70-9931-81948b757bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:22:58.539641 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 607/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 13:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:22:58.824268 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81854768-f062-4813-af2f-72886e448f7d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:22:58.842105 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81854768-f062-4813-af2f-72886e448f7d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:22:58.846215 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32ff8c-0214-4ccd-be40-5c173fdd8f67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:22:58.846816 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32ff8c-0214-4ccd-be40-5c173fdd8f67 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:22:58.847094 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32ff8c-0214-4ccd-be40-5c173fdd8f67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:22:58.847364 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32ff8c-0214-4ccd-be40-5c173fdd8f67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:22:58.857316 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32ff8c-0214-4ccd-be40-5c173fdd8f67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:22:58.858801 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32ff8c-0214-4ccd-be40-5c173fdd8f67 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:22:58.868595 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 603/1210] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:22:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:23:02.598512 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e97f96-5cb7-4099-9d96-2e69bfa3ae23 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:23:02.599434 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e97f96-5cb7-4099-9d96-2e69bfa3ae23 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:23:02.599434 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e97f96-5cb7-4099-9d96-2e69bfa3ae23 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:23:02.601568 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 608/1211] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 13:23:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:23:02.610424 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755646fe-fd66-46fc-b163-6c14afac9fd1 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:23:02.610866 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755646fe-fd66-46fc-b163-6c14afac9fd1 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:23:02.610966 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755646fe-fd66-46fc-b163-6c14afac9fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:23:02.636548 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-755646fe-fd66-46fc-b163-6c14afac9fd1 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:23:02.637942 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-755646fe-fd66-46fc-b163-6c14afac9fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:23:02.647327 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 604/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 13:23:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:23:02.946661 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e97f96-5cb7-4099-9d96-2e69bfa3ae23 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:23:02.948665 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-45e97f96-5cb7-4099-9d96-2e69bfa3ae23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:23:03.015300 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:23:03.029705 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e97f96-5cb7-4099-9d96-2e69bfa3ae23 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:23:03.033747 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e099d-2b31-4451-9b89-be3c7917f12e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:23:03.034352 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e099d-2b31-4451-9b89-be3c7917f12e service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:23:03.034626 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e099d-2b31-4451-9b89-be3c7917f12e service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:23:03.034899 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e099d-2b31-4451-9b89-be3c7917f12e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:23:03.044586 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e099d-2b31-4451-9b89-be3c7917f12e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:23:03.046053 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e099d-2b31-4451-9b89-be3c7917f12e service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:23:03.055454 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 609/1213] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:23:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:23:05.223729 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd56cea-e1ed-4ca9-a7dc-da65ad4566c6 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:23:05.224318 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd56cea-e1ed-4ca9-a7dc-da65ad4566c6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:23:05.224424 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd56cea-e1ed-4ca9-a7dc-da65ad4566c6 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:23:05.226322 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 605/1214] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 13:23:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:23:05.238717 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c944e2-9f1e-42a8-b3aa-66fd09234eaf None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:23:05.239234 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c944e2-9f1e-42a8-b3aa-66fd09234eaf None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:23:05.239338 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c944e2-9f1e-42a8-b3aa-66fd09234eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:23:05.264347 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-a7c944e2-9f1e-42a8-b3aa-66fd09234eaf None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:23:05.265601 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a7c944e2-9f1e-42a8-b3aa-66fd09234eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:23:05.275213 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 610/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 13:23:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:23:05.587657 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd56cea-e1ed-4ca9-a7dc-da65ad4566c6 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:23:05.589704 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-abd56cea-e1ed-4ca9-a7dc-da65ad4566c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:23:05.598365 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=84 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:23:05.605434 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd56cea-e1ed-4ca9-a7dc-da65ad4566c6 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:23:05.609980 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590458a-8cf7-4a9c-95a2-d24f051836f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:23:05.610592 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590458a-8cf7-4a9c-95a2-d24f051836f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:23:05.610867 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590458a-8cf7-4a9c-95a2-d24f051836f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:23:05.611134 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590458a-8cf7-4a9c-95a2-d24f051836f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:23:05.620898 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c590458a-8cf7-4a9c-95a2-d24f051836f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:23:05.623092 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c590458a-8cf7-4a9c-95a2-d24f051836f8 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:23:05.632139 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 606/1216] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:23:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:23:15.258260 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=11 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:23:15.627967 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:35.645127 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ceab8-9592-4348-ad96-e9ae94624ac1 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:35.646280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ceab8-9592-4348-ad96-e9ae94624ac1 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:35.646791 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ceab8-9592-4348-ad96-e9ae94624ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:35.682862 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-605ceab8-9592-4348-ad96-e9ae94624ac1 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:35.684550 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-605ceab8-9592-4348-ad96-e9ae94624ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:35.694393 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 611/1217] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:24:35.704536 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53d1e0-f832-4046-9cde-506e2c1a1b93 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:35.705825 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53d1e0-f832-4046-9cde-506e2c1a1b93 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:35.705825 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53d1e0-f832-4046-9cde-506e2c1a1b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:35.734565 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-be53d1e0-f832-4046-9cde-506e2c1a1b93 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:35.735909 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-be53d1e0-f832-4046-9cde-506e2c1a1b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:35.747083 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 607/1218] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:24:35.751560 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ceab8-9592-4348-ad96-e9ae94624ac1 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:35.766928 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ceab8-9592-4348-ad96-e9ae94624ac1 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:35.777627 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67941d-9800-4224-b825-f0ad3a4a8cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:35.778629 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67941d-9800-4224-b825-f0ad3a4a8cea admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:35.779154 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67941d-9800-4224-b825-f0ad3a4a8cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:35.779643 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67941d-9800-4224-b825-f0ad3a4a8cea admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:35.781084 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e67941d-9800-4224-b825-f0ad3a4a8cea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:24:35.781632 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e67941d-9800-4224-b825-f0ad3a4a8cea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:35.783495 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e67941d-9800-4224-b825-f0ad3a4a8cea admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:35.797202 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 612/1219] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:24:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:24:35.811614 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53d1e0-f832-4046-9cde-506e2c1a1b93 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:35.821607 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd961a-f976-4332-852c-a1b8cbb41bf4 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:35.822269 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd961a-f976-4332-852c-a1b8cbb41bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:35.822764 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd961a-f976-4332-852c-a1b8cbb41bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:35.823415 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53d1e0-f832-4046-9cde-506e2c1a1b93 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:35.833268 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1841a-741f-48f9-a90c-b49779a8d46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:35.833493 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1841a-741f-48f9-a90c-b49779a8d46a admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:35.833639 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1841a-741f-48f9-a90c-b49779a8d46a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:35.833910 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1841a-741f-48f9-a90c-b49779a8d46a admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:35.834524 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c1841a-741f-48f9-a90c-b49779a8d46a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:35.836438 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c1841a-741f-48f9-a90c-b49779a8d46a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:35.845697 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-2bfd961a-f976-4332-852c-a1b8cbb41bf4 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:35.847608 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2bfd961a-f976-4332-852c-a1b8cbb41bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:35.860410 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 613/1220] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:24:35.862123 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a890bc-87f5-471f-8fc9-5821ec73ddbb None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:35.862691 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a890bc-87f5-471f-8fc9-5821ec73ddbb None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:35.863178 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a890bc-87f5-471f-8fc9-5821ec73ddbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:35.887760 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-22a890bc-87f5-471f-8fc9-5821ec73ddbb None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:35.889364 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-22a890bc-87f5-471f-8fc9-5821ec73ddbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:35.901509 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 614/1221] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:24:35.903248 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d8a8a-6bc8-4b6a-b9c2-909498d3edb7 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:35.903684 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d8a8a-6bc8-4b6a-b9c2-909498d3edb7 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:35.904129 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d8a8a-6bc8-4b6a-b9c2-909498d3edb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:35.907386 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 608/1222] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:24:35 2022] POST /identity/v3/projects => generated 393 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:24:35.909169 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27beed-1007-44ca-b143-3e0a911f6034 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:35.909572 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27beed-1007-44ca-b143-3e0a911f6034 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:35.913094 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27beed-1007-44ca-b143-3e0a911f6034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:35.931412 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-3d4d8a8a-6bc8-4b6a-b9c2-909498d3edb7 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:35.932901 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3d4d8a8a-6bc8-4b6a-b9c2-909498d3edb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:35.934199 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-3f27beed-1007-44ca-b143-3e0a911f6034 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:35.935908 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3f27beed-1007-44ca-b143-3e0a911f6034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:36.005074 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 615/1223] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:24:36.006098 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 609/1224] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:24:36.006254 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39453d-81b8-44aa-912e-dcbb55da9e50 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:36.006611 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39453d-81b8-44aa-912e-dcbb55da9e50 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:36.006959 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39453d-81b8-44aa-912e-dcbb55da9e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:36.008349 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad7418-5e73-4ca4-b533-ab0e1cd0c7a1 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:36.008873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad7418-5e73-4ca4-b533-ab0e1cd0c7a1 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:36.009466 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad7418-5e73-4ca4-b533-ab0e1cd0c7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:36.027835 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-fb39453d-81b8-44aa-912e-dcbb55da9e50 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:36.029123 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-fb39453d-81b8-44aa-912e-dcbb55da9e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:36.034103 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-1cad7418-5e73-4ca4-b533-ab0e1cd0c7a1 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:36.035335 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1cad7418-5e73-4ca4-b533-ab0e1cd0c7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:36.037479 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 616/1225] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:24:36.042110 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5d69e-c9bd-463c-b2cb-efa495e83a5a None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:36.042463 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5d69e-c9bd-463c-b2cb-efa495e83a5a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:36.042811 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5d69e-c9bd-463c-b2cb-efa495e83a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:36.045652 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 610/1226] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:24:36.045652 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad7418-5e73-4ca4-b533-ab0e1cd0c7a1 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:36.054705 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad7418-5e73-4ca4-b533-ab0e1cd0c7a1 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:36.061385 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d254f-48ed-4f72-9308-f084d0c3d9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:36.062436 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d254f-48ed-4f72-9308-f084d0c3d9ac admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:36.062436 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d254f-48ed-4f72-9308-f084d0c3d9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:36.062944 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d254f-48ed-4f72-9308-f084d0c3d9ac admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:36.063735 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d254f-48ed-4f72-9308-f084d0c3d9ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:36.065709 dv-cinder-862432-3-smb devstack@keystone.service[81481]: WARNING py.warnings [None req-a81d254f-48ed-4f72-9308-f084d0c3d9ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:24:36.065709 dv-cinder-862432-3-smb devstack@keystone.service[81481]: warnings.warn(msg) Oct 27 13:24:36.065709 dv-cinder-862432-3-smb devstack@keystone.service[81481]: Oct 27 13:24:36.066987 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d254f-48ed-4f72-9308-f084d0c3d9ac admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:36.071161 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-42a5d69e-c9bd-463c-b2cb-efa495e83a5a None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:36.072499 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-42a5d69e-c9bd-463c-b2cb-efa495e83a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:36.080397 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 617/1227] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:24:36.081639 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4b677-b133-478e-a9c3-4ae9512ab104 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:36.081927 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4b677-b133-478e-a9c3-4ae9512ab104 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:36.082162 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4b677-b133-478e-a9c3-4ae9512ab104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:36.091327 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 611/1228] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:24:36 2022] POST /identity/v3/users => generated 297 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:24:36.092883 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfd3ea-7223-47d7-ae7a-a9b354628d6f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:36.093175 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfd3ea-7223-47d7-ae7a-a9b354628d6f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:36.093448 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfd3ea-7223-47d7-ae7a-a9b354628d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:36.101365 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-75e4b677-b133-478e-a9c3-4ae9512ab104 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:36.102575 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-75e4b677-b133-478e-a9c3-4ae9512ab104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:36.111529 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 618/1229] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:24:36.112842 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277e320-df54-4725-b1d4-035bbf01d9ce None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:36.113122 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277e320-df54-4725-b1d4-035bbf01d9ce None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:36.113393 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277e320-df54-4725-b1d4-035bbf01d9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:36.114269 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-cfcfd3ea-7223-47d7-ae7a-a9b354628d6f None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:36.115616 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cfcfd3ea-7223-47d7-ae7a-a9b354628d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:36.123547 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 612/1230] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:24:36.124531 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfd3ea-7223-47d7-ae7a-a9b354628d6f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:36.133936 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfd3ea-7223-47d7-ae7a-a9b354628d6f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:36.134092 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-7277e320-df54-4725-b1d4-035bbf01d9ce None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:36.135304 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7277e320-df54-4725-b1d4-035bbf01d9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:36.139182 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2e3ce-a061-4409-abdc-7efbce965174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:36.139786 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2e3ce-a061-4409-abdc-7efbce965174 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:36.140068 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2e3ce-a061-4409-abdc-7efbce965174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:36.140343 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2e3ce-a061-4409-abdc-7efbce965174 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:36.140981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff2e3ce-a061-4409-abdc-7efbce965174 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:24:36.141352 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff2e3ce-a061-4409-abdc-7efbce965174 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:36.142425 dv-cinder-862432-3-smb devstack@keystone.service[81481]: WARNING py.warnings [None req-3ff2e3ce-a061-4409-abdc-7efbce965174 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:24:36.142425 dv-cinder-862432-3-smb devstack@keystone.service[81481]: warnings.warn(msg) Oct 27 13:24:36.142425 dv-cinder-862432-3-smb devstack@keystone.service[81481]: Oct 27 13:24:36.143333 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff2e3ce-a061-4409-abdc-7efbce965174 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:36.143885 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 619/1231] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:24:36.145052 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117c018-2c81-4a3f-bdd2-94e2250caac1 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:36.145332 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117c018-2c81-4a3f-bdd2-94e2250caac1 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:36.145628 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117c018-2c81-4a3f-bdd2-94e2250caac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:36.163413 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 613/1232] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:24:36.163413 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e994a-aea2-4dab-a7e5-e97d007550d0 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:36.163413 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e994a-aea2-4dab-a7e5-e97d007550d0 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:36.163413 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e994a-aea2-4dab-a7e5-e97d007550d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:36.164466 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-e117c018-2c81-4a3f-bdd2-94e2250caac1 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:36.165999 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e117c018-2c81-4a3f-bdd2-94e2250caac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:36.175291 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 620/1233] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:24:36.179756 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117c018-2c81-4a3f-bdd2-94e2250caac1 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:36.183295 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-4b2e994a-aea2-4dab-a7e5-e97d007550d0 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:36.184540 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4b2e994a-aea2-4dab-a7e5-e97d007550d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:36.189933 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117c018-2c81-4a3f-bdd2-94e2250caac1 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:36.192728 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 614/1234] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:24:36.193493 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e994a-aea2-4dab-a7e5-e97d007550d0 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:36.194479 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d939e-449a-4d4b-afd5-2bb718386ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:36.195070 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d939e-449a-4d4b-afd5-2bb718386ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:36.195349 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d939e-449a-4d4b-afd5-2bb718386ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:36.195644 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d939e-449a-4d4b-afd5-2bb718386ab4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:36.196274 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d939e-449a-4d4b-afd5-2bb718386ab4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:24:36.196578 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d939e-449a-4d4b-afd5-2bb718386ab4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:36.198668 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d939e-449a-4d4b-afd5-2bb718386ab4 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:36.203188 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e994a-aea2-4dab-a7e5-e97d007550d0 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:36.207826 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36dd27-7d02-4650-b898-dfe1d8eb08a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:36.208427 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36dd27-7d02-4650-b898-dfe1d8eb08a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:36.208699 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36dd27-7d02-4650-b898-dfe1d8eb08a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:36.208965 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36dd27-7d02-4650-b898-dfe1d8eb08a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:36.209624 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36dd27-7d02-4650-b898-dfe1d8eb08a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:36.211222 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36dd27-7d02-4650-b898-dfe1d8eb08a6 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:36.217463 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 621/1235] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:24:36.217463 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87a905-81f1-4046-ae70-f328d4b79a3e None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:36.217463 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87a905-81f1-4046-ae70-f328d4b79a3e None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:36.217463 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87a905-81f1-4046-ae70-f328d4b79a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:36.226626 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 615/1236] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:24:36.227327 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36dd27-7d02-4650-b898-dfe1d8eb08a6 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:36.236776 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36dd27-7d02-4650-b898-dfe1d8eb08a6 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:36.236949 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-7d87a905-81f1-4046-ae70-f328d4b79a3e None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:36.238029 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7d87a905-81f1-4046-ae70-f328d4b79a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:36.241472 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270fd9b-8c1d-4b90-8f62-36b69459900e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:36.242102 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270fd9b-8c1d-4b90-8f62-36b69459900e admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:36.242383 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270fd9b-8c1d-4b90-8f62-36b69459900e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:36.242654 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270fd9b-8c1d-4b90-8f62-36b69459900e admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:36.243288 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270fd9b-8c1d-4b90-8f62-36b69459900e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:24:36.243590 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270fd9b-8c1d-4b90-8f62-36b69459900e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:36.245208 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270fd9b-8c1d-4b90-8f62-36b69459900e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:36.246122 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 622/1237] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:24:36.247013 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d87a905-81f1-4046-ae70-f328d4b79a3e None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:36.257055 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d87a905-81f1-4046-ae70-f328d4b79a3e None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:36.257706 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 616/1238] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:24:36.258509 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270fd9b-8c1d-4b90-8f62-36b69459900e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:36.262052 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b844e-5d3e-4abc-b1aa-a866600a6cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:36.262661 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b844e-5d3e-4abc-b1aa-a866600a6cde admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:36.262939 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b844e-5d3e-4abc-b1aa-a866600a6cde admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:36.263353 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b844e-5d3e-4abc-b1aa-a866600a6cde admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:36.263878 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8b844e-5d3e-4abc-b1aa-a866600a6cde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:24:36.264181 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8b844e-5d3e-4abc-b1aa-a866600a6cde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:36.265966 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8b844e-5d3e-4abc-b1aa-a866600a6cde admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:36.268494 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270fd9b-8c1d-4b90-8f62-36b69459900e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:36.272996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204e623-6e9c-4c2d-920c-adb88632d463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:36.273635 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204e623-6e9c-4c2d-920c-adb88632d463 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:36.273917 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204e623-6e9c-4c2d-920c-adb88632d463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:36.274189 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204e623-6e9c-4c2d-920c-adb88632d463 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:36.274808 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1204e623-6e9c-4c2d-920c-adb88632d463 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:36.276786 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1204e623-6e9c-4c2d-920c-adb88632d463 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:36.285094 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 623/1239] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:24:36.285094 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b844e-5d3e-4abc-b1aa-a866600a6cde admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:36.289587 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b844e-5d3e-4abc-b1aa-a866600a6cde admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:36.294575 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f56b8-2c69-4193-937a-b25abfd5294f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:36.295326 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f56b8-2c69-4193-937a-b25abfd5294f admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:36.295642 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f56b8-2c69-4193-937a-b25abfd5294f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:36.296063 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f56b8-2c69-4193-937a-b25abfd5294f admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:36.296815 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f56b8-2c69-4193-937a-b25abfd5294f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:24:36.297116 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f56b8-2c69-4193-937a-b25abfd5294f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:36.298976 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f56b8-2c69-4193-937a-b25abfd5294f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:36.308502 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 617/1240] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:24:36 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:24:36.308502 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3c9d9-1c3b-4b19-88ca-73ede869a293 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:36.308502 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3c9d9-1c3b-4b19-88ca-73ede869a293 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:36.308502 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3c9d9-1c3b-4b19-88ca-73ede869a293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:36.312481 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 624/1241] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:24:36.313635 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f56b8-2c69-4193-937a-b25abfd5294f admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:36.323748 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f56b8-2c69-4193-937a-b25abfd5294f admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:36.331805 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-8be3c9d9-1c3b-4b19-88ca-73ede869a293 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:36.333008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8be3c9d9-1c3b-4b19-88ca-73ede869a293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:36.352909 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:36.368941 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:36.381489 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebcb5bb-bb8a-4492-8b42-38df61b81298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:36.382140 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcb5bb-bb8a-4492-8b42-38df61b81298 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:36.382426 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcb5bb-bb8a-4492-8b42-38df61b81298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:36.382686 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcb5bb-bb8a-4492-8b42-38df61b81298 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:36.383324 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebcb5bb-bb8a-4492-8b42-38df61b81298 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:36.384442 dv-cinder-862432-3-smb devstack@keystone.service[81482]: WARNING py.warnings [None req-0ebcb5bb-bb8a-4492-8b42-38df61b81298 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:24:36.384442 dv-cinder-862432-3-smb devstack@keystone.service[81482]: warnings.warn(msg) Oct 27 13:24:36.384442 dv-cinder-862432-3-smb devstack@keystone.service[81482]: Oct 27 13:24:36.385956 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebcb5bb-bb8a-4492-8b42-38df61b81298 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:36.393312 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 618/1242] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:24:36.394374 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3c9d9-1c3b-4b19-88ca-73ede869a293 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:36.404068 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3c9d9-1c3b-4b19-88ca-73ede869a293 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:36.408836 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c76899-e868-47f5-9c9f-21f8a003f302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:36.409437 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c76899-e868-47f5-9c9f-21f8a003f302 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:36.409804 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c76899-e868-47f5-9c9f-21f8a003f302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:36.410002 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c76899-e868-47f5-9c9f-21f8a003f302 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:36.410670 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c76899-e868-47f5-9c9f-21f8a003f302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:36.412262 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c76899-e868-47f5-9c9f-21f8a003f302 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:36.419665 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 625/1243] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:24:36 2022] POST /identity/v3/projects => generated 409 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:24:36.419665 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebcb5bb-bb8a-4492-8b42-38df61b81298 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:36.423299 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 619/1244] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:24:36.424104 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c76899-e868-47f5-9c9f-21f8a003f302 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:36.437365 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c76899-e868-47f5-9c9f-21f8a003f302 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:36.482042 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebcb5bb-bb8a-4492-8b42-38df61b81298 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:36.486864 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec2cf93-dc56-427e-acd1-e7e95e4453e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:36.487478 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2cf93-dc56-427e-acd1-e7e95e4453e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:36.487755 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2cf93-dc56-427e-acd1-e7e95e4453e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:36.488026 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2cf93-dc56-427e-acd1-e7e95e4453e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:36.488671 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec2cf93-dc56-427e-acd1-e7e95e4453e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:24:36.488963 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec2cf93-dc56-427e-acd1-e7e95e4453e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:36.490917 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec2cf93-dc56-427e-acd1-e7e95e4453e9 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:36.495113 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ac235-8673-49a1-815c-5e82de414d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:36.495723 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ac235-8673-49a1-815c-5e82de414d9a admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:36.496001 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ac235-8673-49a1-815c-5e82de414d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:36.496273 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ac235-8673-49a1-815c-5e82de414d9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:36.496903 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ac235-8673-49a1-815c-5e82de414d9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:36.499792 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ac235-8673-49a1-815c-5e82de414d9a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:36.503434 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 626/1245] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:24:36.504445 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec2cf93-dc56-427e-acd1-e7e95e4453e9 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:36.515284 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec2cf93-dc56-427e-acd1-e7e95e4453e9 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:36.520462 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4be1a6-d9d0-4201-b441-fce8d2002e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:36.521065 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4be1a6-d9d0-4201-b441-fce8d2002e4a admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:36.521348 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4be1a6-d9d0-4201-b441-fce8d2002e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:36.521642 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4be1a6-d9d0-4201-b441-fce8d2002e4a admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:36.522286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4be1a6-d9d0-4201-b441-fce8d2002e4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:36.524196 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4be1a6-d9d0-4201-b441-fce8d2002e4a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:36.530188 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 620/1246] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:24:36 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:24:36.531099 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ac235-8673-49a1-815c-5e82de414d9a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:36.558705 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 627/1247] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:24:36 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:24:36.558705 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4be1a6-d9d0-4201-b441-fce8d2002e4a admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:36.596349 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ac235-8673-49a1-815c-5e82de414d9a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:36.620275 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4be1a6-d9d0-4201-b441-fce8d2002e4a admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:36.625016 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ced79-0b93-450f-8e97-f54a6af490cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:36.625652 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ced79-0b93-450f-8e97-f54a6af490cb admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:36.625935 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ced79-0b93-450f-8e97-f54a6af490cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:36.626201 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ced79-0b93-450f-8e97-f54a6af490cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:36.626834 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ced79-0b93-450f-8e97-f54a6af490cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:36.628770 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ced79-0b93-450f-8e97-f54a6af490cb admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:36.643064 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:36.656917 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a3b64-3ec0-453d-89ab-f0c8c09a3316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:36.657108 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 628/1248] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:24:36 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:24:36.657686 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a3b64-3ec0-453d-89ab-f0c8c09a3316 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:36.658018 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a3b64-3ec0-453d-89ab-f0c8c09a3316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:36.658130 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ced79-0b93-450f-8e97-f54a6af490cb admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:36.658387 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a3b64-3ec0-453d-89ab-f0c8c09a3316 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:36.659067 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a3b64-3ec0-453d-89ab-f0c8c09a3316 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:36.661186 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a3b64-3ec0-453d-89ab-f0c8c09a3316 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:36.682242 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 621/1249] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:24:36 2022] POST /identity/v3/users => generated 293 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:24:36.683166 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a3b64-3ec0-453d-89ab-f0c8c09a3316 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:36.693661 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a3b64-3ec0-453d-89ab-f0c8c09a3316 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:36.696583 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:36.727716 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ced79-0b93-450f-8e97-f54a6af490cb admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:36.733063 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dface489-a7a9-41bd-b214-13bb55fd3375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:36.733710 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dface489-a7a9-41bd-b214-13bb55fd3375 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:36.733993 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dface489-a7a9-41bd-b214-13bb55fd3375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:36.734265 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dface489-a7a9-41bd-b214-13bb55fd3375 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:36.734944 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dface489-a7a9-41bd-b214-13bb55fd3375 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:24:36.735220 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dface489-a7a9-41bd-b214-13bb55fd3375 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:36.736972 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dface489-a7a9-41bd-b214-13bb55fd3375 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:36.750091 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 629/1250] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:24:36.750824 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dface489-a7a9-41bd-b214-13bb55fd3375 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:36.752904 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da9013-de0a-4a20-8d0e-b04d55280747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:36.753517 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da9013-de0a-4a20-8d0e-b04d55280747 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:36.753824 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da9013-de0a-4a20-8d0e-b04d55280747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:36.754094 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da9013-de0a-4a20-8d0e-b04d55280747 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:36.754722 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da9013-de0a-4a20-8d0e-b04d55280747 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:36.756858 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da9013-de0a-4a20-8d0e-b04d55280747 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:36.760936 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dface489-a7a9-41bd-b214-13bb55fd3375 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:36.765445 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91630bc-25b3-4f77-9ad7-e2bd9f68caff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:36.766110 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91630bc-25b3-4f77-9ad7-e2bd9f68caff admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:36.766394 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91630bc-25b3-4f77-9ad7-e2bd9f68caff admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:36.766643 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91630bc-25b3-4f77-9ad7-e2bd9f68caff admin admin] PATH_INFO: `/v3/projects/62b96c940c24456abbcc0811f7b0507d/users/beaa55c832594b9a873b802efe381e97/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:36.780562 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 622/1251] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:24:36 2022] POST /identity/v3/users => generated 305 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:24:36.781295 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91630bc-25b3-4f77-9ad7-e2bd9f68caff admin admin] RBAC: Authorizing `identity:create_grant(project_id=62b96c940c24456abbcc0811f7b0507d, user_id=beaa55c832594b9a873b802efe381e97, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:36.781462 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da9013-de0a-4a20-8d0e-b04d55280747 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:36.787245 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91630bc-25b3-4f77-9ad7-e2bd9f68caff admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:36.792622 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da9013-de0a-4a20-8d0e-b04d55280747 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:36.797402 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf30c6-cfe0-4c16-a60b-05660c28093c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:36.798045 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf30c6-cfe0-4c16-a60b-05660c28093c admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:36.798326 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf30c6-cfe0-4c16-a60b-05660c28093c admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:36.798598 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf30c6-cfe0-4c16-a60b-05660c28093c admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:36.799227 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf30c6-cfe0-4c16-a60b-05660c28093c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:36.801145 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf30c6-cfe0-4c16-a60b-05660c28093c admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:36.805277 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 630/1252] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:24:36 2022] PUT /identity/v3/projects/62b96c940c24456abbcc0811f7b0507d/users/beaa55c832594b9a873b802efe381e97/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:24:36.806521 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91630bc-25b3-4f77-9ad7-e2bd9f68caff admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:36.832454 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 623/1253] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:24:36 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:24:36.833336 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf30c6-cfe0-4c16-a60b-05660c28093c admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:36.876072 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91630bc-25b3-4f77-9ad7-e2bd9f68caff admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:36.898520 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf30c6-cfe0-4c16-a60b-05660c28093c admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:36.903489 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a60876-b11f-4f78-a5b3-6e4828d7d7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:36.904125 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a60876-b11f-4f78-a5b3-6e4828d7d7b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:36.904400 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a60876-b11f-4f78-a5b3-6e4828d7d7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:36.904677 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a60876-b11f-4f78-a5b3-6e4828d7d7b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:36.905444 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a60876-b11f-4f78-a5b3-6e4828d7d7b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:36.907476 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a60876-b11f-4f78-a5b3-6e4828d7d7b5 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:36.931287 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 624/1254] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:24:36 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:24:36.934532 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a60876-b11f-4f78-a5b3-6e4828d7d7b5 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:36.937043 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fdbec6-6086-4c3b-a471-bd33a2304233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:36.937711 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fdbec6-6086-4c3b-a471-bd33a2304233 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:36.938104 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fdbec6-6086-4c3b-a471-bd33a2304233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:36.938391 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fdbec6-6086-4c3b-a471-bd33a2304233 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:36.939047 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fdbec6-6086-4c3b-a471-bd33a2304233 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:36.941771 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fdbec6-6086-4c3b-a471-bd33a2304233 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:36.944092 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a60876-b11f-4f78-a5b3-6e4828d7d7b5 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:36.948603 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362dd33-8973-447d-87b1-e19c40c545db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:36.949188 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362dd33-8973-447d-87b1-e19c40c545db admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:36.949458 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362dd33-8973-447d-87b1-e19c40c545db admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:36.949761 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362dd33-8973-447d-87b1-e19c40c545db admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:36.950379 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c362dd33-8973-447d-87b1-e19c40c545db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:36.952411 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c362dd33-8973-447d-87b1-e19c40c545db admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:36.964818 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 631/1255] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:24:36 2022] POST /identity/v3/users => generated 290 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:24:36.965821 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fdbec6-6086-4c3b-a471-bd33a2304233 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:36.975013 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 625/1256] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:24:36 2022] POST /identity/v3/users => generated 292 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:24:36.976042 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362dd33-8973-447d-87b1-e19c40c545db admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:36.980553 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fdbec6-6086-4c3b-a471-bd33a2304233 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:36.985639 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362dd33-8973-447d-87b1-e19c40c545db admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:36.986351 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48f548-a365-4de7-ba0c-f1184603dc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:36.986933 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48f548-a365-4de7-ba0c-f1184603dc11 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:36.987203 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48f548-a365-4de7-ba0c-f1184603dc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:36.987478 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48f548-a365-4de7-ba0c-f1184603dc11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:36.988114 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab48f548-a365-4de7-ba0c-f1184603dc11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:36.989739 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab48f548-a365-4de7-ba0c-f1184603dc11 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:36.990595 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace343b8-f787-4107-ba1e-1e5aef4cb7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:36.991241 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace343b8-f787-4107-ba1e-1e5aef4cb7b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:36.991582 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace343b8-f787-4107-ba1e-1e5aef4cb7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:36.991918 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace343b8-f787-4107-ba1e-1e5aef4cb7b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:36.992532 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace343b8-f787-4107-ba1e-1e5aef4cb7b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:36.994485 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace343b8-f787-4107-ba1e-1e5aef4cb7b8 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:37.000438 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 632/1257] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:24:37.001304 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48f548-a365-4de7-ba0c-f1184603dc11 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:37.011403 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48f548-a365-4de7-ba0c-f1184603dc11 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:37.012372 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=86,keystone:INSERT=14 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:37.016473 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a07c51-d5d0-4d04-ac78-b16e269d9b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:37.017111 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a07c51-d5d0-4d04-ac78-b16e269d9b25 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:37.017464 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a07c51-d5d0-4d04-ac78-b16e269d9b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:37.017803 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a07c51-d5d0-4d04-ac78-b16e269d9b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:37.018446 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a07c51-d5d0-4d04-ac78-b16e269d9b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:37.020157 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a07c51-d5d0-4d04-ac78-b16e269d9b25 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:37.025588 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 626/1258] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:24:36 2022] POST /identity/v3/projects => generated 367 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:24:37.026969 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63816dcc-dcaf-45a3-8a2c-419cc55b6b43 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:37.027252 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63816dcc-dcaf-45a3-8a2c-419cc55b6b43 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:37.027522 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63816dcc-dcaf-45a3-8a2c-419cc55b6b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:37.034778 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 633/1259] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:24:37.034778 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a07c51-d5d0-4d04-ac78-b16e269d9b25 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:37.042731 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a07c51-d5d0-4d04-ac78-b16e269d9b25 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:37.046319 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-63816dcc-dcaf-45a3-8a2c-419cc55b6b43 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:37.047507 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-63816dcc-dcaf-45a3-8a2c-419cc55b6b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:37.054584 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:37.100755 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07719f-e454-476a-85f8-948b45c828f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:37.101421 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07719f-e454-476a-85f8-948b45c828f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:37.101736 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07719f-e454-476a-85f8-948b45c828f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:37.102005 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07719f-e454-476a-85f8-948b45c828f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:37.102629 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c07719f-e454-476a-85f8-948b45c828f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:37.104581 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c07719f-e454-476a-85f8-948b45c828f4 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:37.109215 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 627/1260] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:24:37.109903 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63816dcc-dcaf-45a3-8a2c-419cc55b6b43 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:37.122031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63816dcc-dcaf-45a3-8a2c-419cc55b6b43 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:37.126577 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5334c-49ad-4d1d-b3aa-371ca62f09ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:37.126731 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 634/1261] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:24:37 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:24:37.127181 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5334c-49ad-4d1d-b3aa-371ca62f09ef admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:37.127458 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5334c-49ad-4d1d-b3aa-371ca62f09ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:37.127553 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07719f-e454-476a-85f8-948b45c828f4 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:37.127729 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5334c-49ad-4d1d-b3aa-371ca62f09ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:37.128369 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e5334c-49ad-4d1d-b3aa-371ca62f09ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:37.129990 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e5334c-49ad-4d1d-b3aa-371ca62f09ef admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:37.139553 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07719f-e454-476a-85f8-948b45c828f4 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:37.143316 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 628/1262] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:24:37.143316 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5334c-49ad-4d1d-b3aa-371ca62f09ef admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:37.146887 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee69a7-8b9b-4406-b85a-512e789b5fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:37.147494 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee69a7-8b9b-4406-b85a-512e789b5fef admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:37.147824 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee69a7-8b9b-4406-b85a-512e789b5fef admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:37.148097 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee69a7-8b9b-4406-b85a-512e789b5fef admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:37.148753 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee69a7-8b9b-4406-b85a-512e789b5fef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:37.150617 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee69a7-8b9b-4406-b85a-512e789b5fef admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:37.150887 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5334c-49ad-4d1d-b3aa-371ca62f09ef admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:37.155516 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05bab49-a816-47df-a3ed-3630c1058dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:37.156125 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bab49-a816-47df-a3ed-3630c1058dea admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:37.156400 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bab49-a816-47df-a3ed-3630c1058dea admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:37.156665 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bab49-a816-47df-a3ed-3630c1058dea admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:37.157282 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05bab49-a816-47df-a3ed-3630c1058dea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:37.158912 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05bab49-a816-47df-a3ed-3630c1058dea admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:37.161227 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 635/1263] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:24:37.162134 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee69a7-8b9b-4406-b85a-512e789b5fef admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:37.173349 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 629/1264] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:24:37.173349 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05bab49-a816-47df-a3ed-3630c1058dea admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:37.173998 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee69a7-8b9b-4406-b85a-512e789b5fef admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:37.177859 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678322e-e325-4de8-bdd0-4c00da9286bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:37.178694 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678322e-e325-4de8-bdd0-4c00da9286bb admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:37.178983 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678322e-e325-4de8-bdd0-4c00da9286bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:37.179251 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678322e-e325-4de8-bdd0-4c00da9286bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:37.179884 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678322e-e325-4de8-bdd0-4c00da9286bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:37.181614 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678322e-e325-4de8-bdd0-4c00da9286bb admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:37.183465 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05bab49-a816-47df-a3ed-3630c1058dea admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:37.189219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1f7ab-1189-40c6-a0aa-bfb9bce32531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:37.189796 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1f7ab-1189-40c6-a0aa-bfb9bce32531 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:37.190076 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1f7ab-1189-40c6-a0aa-bfb9bce32531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:37.190348 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1f7ab-1189-40c6-a0aa-bfb9bce32531 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:37.190974 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e1f7ab-1189-40c6-a0aa-bfb9bce32531 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:37.192876 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e1f7ab-1189-40c6-a0aa-bfb9bce32531 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:37.192984 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 636/1265] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:24:37.193779 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678322e-e325-4de8-bdd0-4c00da9286bb admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:37.204090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678322e-e325-4de8-bdd0-4c00da9286bb admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:37.208967 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9548eb-f040-4c7f-8b34-b97d40862c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:37.209585 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9548eb-f040-4c7f-8b34-b97d40862c38 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:37.209844 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9548eb-f040-4c7f-8b34-b97d40862c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:37.210112 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9548eb-f040-4c7f-8b34-b97d40862c38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:37.210746 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9548eb-f040-4c7f-8b34-b97d40862c38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:37.212334 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9548eb-f040-4c7f-8b34-b97d40862c38 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:37.218176 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 630/1266] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:24:37 2022] POST /identity/v3/users => generated 284 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:24:37.218896 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1f7ab-1189-40c6-a0aa-bfb9bce32531 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:37.228762 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 637/1267] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:24:37.228762 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9548eb-f040-4c7f-8b34-b97d40862c38 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:37.236257 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9548eb-f040-4c7f-8b34-b97d40862c38 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:37.241489 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629f92f-ad85-42ac-8f3d-29eed48b86dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:37.242088 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629f92f-ad85-42ac-8f3d-29eed48b86dc admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:37.242357 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629f92f-ad85-42ac-8f3d-29eed48b86dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:37.242620 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629f92f-ad85-42ac-8f3d-29eed48b86dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:37.243243 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e629f92f-ad85-42ac-8f3d-29eed48b86dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:37.244866 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e629f92f-ad85-42ac-8f3d-29eed48b86dc admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:37.259087 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 638/1268] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:24:37.259087 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629f92f-ad85-42ac-8f3d-29eed48b86dc admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:37.266883 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629f92f-ad85-42ac-8f3d-29eed48b86dc admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:37.271649 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff5c07-1aa1-4e1d-933c-e7283d57337f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:37.272301 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff5c07-1aa1-4e1d-933c-e7283d57337f admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:37.272572 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff5c07-1aa1-4e1d-933c-e7283d57337f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:37.272865 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff5c07-1aa1-4e1d-933c-e7283d57337f admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:37.273496 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff5c07-1aa1-4e1d-933c-e7283d57337f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:37.274476 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1f7ab-1189-40c6-a0aa-bfb9bce32531 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:37.275405 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff5c07-1aa1-4e1d-933c-e7283d57337f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:37.278261 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d27602-cb87-4947-9b3e-149dc49a114d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:37.278858 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d27602-cb87-4947-9b3e-149dc49a114d service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:37.279131 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d27602-cb87-4947-9b3e-149dc49a114d service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:37.279398 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d27602-cb87-4947-9b3e-149dc49a114d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:37.287344 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 639/1269] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:24:37.288129 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff5c07-1aa1-4e1d-933c-e7283d57337f admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:37.288977 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d27602-cb87-4947-9b3e-149dc49a114d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:37.290772 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d27602-cb87-4947-9b3e-149dc49a114d service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:37.297497 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff5c07-1aa1-4e1d-933c-e7283d57337f admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:37.300876 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 631/1270] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:24:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:24:37.301703 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d27602-cb87-4947-9b3e-149dc49a114d service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:37.301981 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e0c74-3a49-4b15-8d7d-c0c5c7cdd8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:37.302569 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e0c74-3a49-4b15-8d7d-c0c5c7cdd8c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:37.302836 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e0c74-3a49-4b15-8d7d-c0c5c7cdd8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:37.303104 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e0c74-3a49-4b15-8d7d-c0c5c7cdd8c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:37.303737 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e0c74-3a49-4b15-8d7d-c0c5c7cdd8c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:37.305333 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e0c74-3a49-4b15-8d7d-c0c5c7cdd8c2 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:37.311242 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d27602-cb87-4947-9b3e-149dc49a114d service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:37.316700 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a490bb3-8cf2-4ebb-a130-0ae9c78d8fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:37.320157 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 640/1271] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:24:37.320319 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a490bb3-8cf2-4ebb-a130-0ae9c78d8fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:37.320319 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a490bb3-8cf2-4ebb-a130-0ae9c78d8fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:37.320479 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e0c74-3a49-4b15-8d7d-c0c5c7cdd8c2 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:37.320569 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a490bb3-8cf2-4ebb-a130-0ae9c78d8fa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:37.320569 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a490bb3-8cf2-4ebb-a130-0ae9c78d8fa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:37.320569 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a490bb3-8cf2-4ebb-a130-0ae9c78d8fa1 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:37.335132 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 632/1272] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:24:37.335132 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a490bb3-8cf2-4ebb-a130-0ae9c78d8fa1 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:37.335490 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e0c74-3a49-4b15-8d7d-c0c5c7cdd8c2 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:37.340236 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2874fd2-42e0-4f7d-a036-c166148907c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:37.340992 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2874fd2-42e0-4f7d-a036-c166148907c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:37.341341 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2874fd2-42e0-4f7d-a036-c166148907c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:37.341776 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2874fd2-42e0-4f7d-a036-c166148907c0 admin admin] PATH_INFO: `/v3/projects/6f96dcaa57f644b79627548f5cfee85b/users/0d1d5b6ec974472eb5d1f4ddbdc43c58/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:37.345795 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a490bb3-8cf2-4ebb-a130-0ae9c78d8fa1 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:37.350509 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db71849-8aae-4620-b232-0fba4ca3b71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:37.351140 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db71849-8aae-4620-b232-0fba4ca3b71f admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:37.351403 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db71849-8aae-4620-b232-0fba4ca3b71f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:37.351663 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db71849-8aae-4620-b232-0fba4ca3b71f admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:37.352500 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db71849-8aae-4620-b232-0fba4ca3b71f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:37.354163 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db71849-8aae-4620-b232-0fba4ca3b71f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:37.358491 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2874fd2-42e0-4f7d-a036-c166148907c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f96dcaa57f644b79627548f5cfee85b, user_id=0d1d5b6ec974472eb5d1f4ddbdc43c58, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:37.361252 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2874fd2-42e0-4f7d-a036-c166148907c0 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:37.367684 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 633/1273] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:24:37.367684 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db71849-8aae-4620-b232-0fba4ca3b71f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:37.375790 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db71849-8aae-4620-b232-0fba4ca3b71f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:37.389680 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 641/1274] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:24:37 2022] PUT /identity/v3/projects/6f96dcaa57f644b79627548f5cfee85b/users/0d1d5b6ec974472eb5d1f4ddbdc43c58/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:24:37.389680 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2874fd2-42e0-4f7d-a036-c166148907c0 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:37.419946 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:37.448921 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a8d56-5a91-490e-a97e-115bfad1158d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:37.449653 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a8d56-5a91-490e-a97e-115bfad1158d admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:37.450004 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a8d56-5a91-490e-a97e-115bfad1158d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:37.450276 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a8d56-5a91-490e-a97e-115bfad1158d admin admin] PATH_INFO: `/v3/projects/8417ceda73534d50b053c9652d752612/users/31983041c98f4df495e7aa4a38a568db/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:37.462416 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2874fd2-42e0-4f7d-a036-c166148907c0 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:37.467426 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a8d56-5a91-490e-a97e-115bfad1158d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8417ceda73534d50b053c9652d752612, user_id=31983041c98f4df495e7aa4a38a568db, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:37.468749 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58787bfe-b86f-43cf-abe0-27d4abff0f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:37.469411 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58787bfe-b86f-43cf-abe0-27d4abff0f51 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:37.469776 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58787bfe-b86f-43cf-abe0-27d4abff0f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:37.470098 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58787bfe-b86f-43cf-abe0-27d4abff0f51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:37.470212 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a8d56-5a91-490e-a97e-115bfad1158d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:37.470746 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58787bfe-b86f-43cf-abe0-27d4abff0f51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:37.472545 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58787bfe-b86f-43cf-abe0-27d4abff0f51 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:37.487431 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 642/1275] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:24:37.488306 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58787bfe-b86f-43cf-abe0-27d4abff0f51 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:37.489719 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 634/1276] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:24:37 2022] PUT /identity/v3/projects/8417ceda73534d50b053c9652d752612/users/31983041c98f4df495e7aa4a38a568db/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:24:37.491350 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a8d56-5a91-490e-a97e-115bfad1158d admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:37.501742 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58787bfe-b86f-43cf-abe0-27d4abff0f51 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:37.513063 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:37.569069 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2e9a6-d7c7-41b0-ab37-22a177a554da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:37.569582 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a8d56-5a91-490e-a97e-115bfad1158d admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:37.570022 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2e9a6-d7c7-41b0-ab37-22a177a554da admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:37.570788 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2e9a6-d7c7-41b0-ab37-22a177a554da admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:37.570788 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2e9a6-d7c7-41b0-ab37-22a177a554da admin admin] PATH_INFO: `/v3/projects/d5e1d3a8ff354698b4bd5f81a4a04395/users/041ffe6cdf2d42008f41858ebe015be8/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:37.574599 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b16f1a-312d-440c-9b23-3c58e3e9f1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:37.575267 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b16f1a-312d-440c-9b23-3c58e3e9f1ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:37.575544 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b16f1a-312d-440c-9b23-3c58e3e9f1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:37.575818 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b16f1a-312d-440c-9b23-3c58e3e9f1ca admin admin] PATH_INFO: `/v3/projects/09838d6914f447ed9ef0c61f04a47eee/users/f3bdef77b4c14ad895f797c303c09671/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:37.587104 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2e9a6-d7c7-41b0-ab37-22a177a554da admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5e1d3a8ff354698b4bd5f81a4a04395, user_id=041ffe6cdf2d42008f41858ebe015be8, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:37.590577 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2e9a6-d7c7-41b0-ab37-22a177a554da admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:37.591904 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b16f1a-312d-440c-9b23-3c58e3e9f1ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=09838d6914f447ed9ef0c61f04a47eee, user_id=f3bdef77b4c14ad895f797c303c09671, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:37.594439 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b16f1a-312d-440c-9b23-3c58e3e9f1ca admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:37.606353 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 643/1277] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:24:37 2022] PUT /identity/v3/projects/d5e1d3a8ff354698b4bd5f81a4a04395/users/041ffe6cdf2d42008f41858ebe015be8/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:24:37.608985 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 635/1278] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:24:37 2022] PUT /identity/v3/projects/09838d6914f447ed9ef0c61f04a47eee/users/f3bdef77b4c14ad895f797c303c09671/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:24:37.609786 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b16f1a-312d-440c-9b23-3c58e3e9f1ca admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:37.610654 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2e9a6-d7c7-41b0-ab37-22a177a554da admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:37.686751 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2e9a6-d7c7-41b0-ab37-22a177a554da admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:37.687945 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b16f1a-312d-440c-9b23-3c58e3e9f1ca admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:37.692708 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe70efa-8f30-4f4e-a83a-074aba3280a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:37.693403 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe70efa-8f30-4f4e-a83a-074aba3280a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:37.693728 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe70efa-8f30-4f4e-a83a-074aba3280a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:37.694006 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe70efa-8f30-4f4e-a83a-074aba3280a7 admin admin] PATH_INFO: `/v3/projects/810d8a2400464dee8c9a6b6ab5034984/users/946833c2a74f46528ec7c12cfef4e1c9/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:37.695535 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9698b321-fa36-4ddc-9a55-cf6b481af88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:37.696492 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698b321-fa36-4ddc-9a55-cf6b481af88f admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:37.697193 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698b321-fa36-4ddc-9a55-cf6b481af88f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:37.697780 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698b321-fa36-4ddc-9a55-cf6b481af88f admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:37.698458 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9698b321-fa36-4ddc-9a55-cf6b481af88f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:37.700834 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9698b321-fa36-4ddc-9a55-cf6b481af88f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:37.714456 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe70efa-8f30-4f4e-a83a-074aba3280a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=810d8a2400464dee8c9a6b6ab5034984, user_id=946833c2a74f46528ec7c12cfef4e1c9, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:37.715901 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 636/1279] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:24:37.717315 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68440c-0466-44e5-9040-87061046726a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:37.717831 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68440c-0466-44e5-9040-87061046726a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:37.718183 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe70efa-8f30-4f4e-a83a-074aba3280a7 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:37.718320 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68440c-0466-44e5-9040-87061046726a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:37.738226 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 644/1280] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:24:37 2022] PUT /identity/v3/projects/810d8a2400464dee8c9a6b6ab5034984/users/946833c2a74f46528ec7c12cfef4e1c9/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:24:37.739128 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe70efa-8f30-4f4e-a83a-074aba3280a7 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:37.753406 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-ab68440c-0466-44e5-9040-87061046726a None None] MFA Rules not processed for user `0d1d5b6ec974472eb5d1f4ddbdc43c58`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:37.756168 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ab68440c-0466-44e5-9040-87061046726a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:37.793611 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:37.828490 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe70efa-8f30-4f4e-a83a-074aba3280a7 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:37.833670 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec7ab7-a467-4672-ba89-088462740e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:37.834341 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec7ab7-a467-4672-ba89-088462740e9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:37.834616 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec7ab7-a467-4672-ba89-088462740e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:37.834888 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec7ab7-a467-4672-ba89-088462740e9e admin admin] PATH_INFO: `/v3/projects/4a4af039772a41b0956859f911975613/users/6b715ce1b1b2441c968102cadb1dea50/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:37.842442 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 637/1281] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:24:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:24:37.843831 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31a9cd-9730-408a-a238-04fc1b3e8db4 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:37.844159 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31a9cd-9730-408a-a238-04fc1b3e8db4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:37.844438 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31a9cd-9730-408a-a238-04fc1b3e8db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:37.857442 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec7ab7-a467-4672-ba89-088462740e9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a4af039772a41b0956859f911975613, user_id=6b715ce1b1b2441c968102cadb1dea50, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:37.859922 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec7ab7-a467-4672-ba89-088462740e9e admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:37.872727 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:37.881387 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 645/1282] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:24:37 2022] PUT /identity/v3/projects/4a4af039772a41b0956859f911975613/users/6b715ce1b1b2441c968102cadb1dea50/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:24:37.885569 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-cd31a9cd-9730-408a-a238-04fc1b3e8db4 None None] MFA Rules not processed for user `31983041c98f4df495e7aa4a38a568db`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:37.886844 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23cb47-8b03-4fbb-8344-fefa6f7fa4dd None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:37.887125 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23cb47-8b03-4fbb-8344-fefa6f7fa4dd None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:37.887395 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23cb47-8b03-4fbb-8344-fefa6f7fa4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:37.887688 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cd31a9cd-9730-408a-a238-04fc1b3e8db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:37.908531 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-2b23cb47-8b03-4fbb-8344-fefa6f7fa4dd None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:37.909896 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2b23cb47-8b03-4fbb-8344-fefa6f7fa4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:37.963868 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 638/1283] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:24:37 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:24:37.965234 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0825c4-f033-43d4-b81f-e7ad32c2a3e4 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:37.965483 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0825c4-f033-43d4-b81f-e7ad32c2a3e4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:37.965805 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0825c4-f033-43d4-b81f-e7ad32c2a3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:37.980506 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 646/1284] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:24:37.981358 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23cb47-8b03-4fbb-8344-fefa6f7fa4dd None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:37.992999 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23cb47-8b03-4fbb-8344-fefa6f7fa4dd None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:37.997943 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b92a8d-bd3b-43b4-a0b3-1b5cd3e9e20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:37.998829 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b92a8d-bd3b-43b4-a0b3-1b5cd3e9e20c admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:37.998995 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b92a8d-bd3b-43b4-a0b3-1b5cd3e9e20c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:37.999182 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b92a8d-bd3b-43b4-a0b3-1b5cd3e9e20c admin admin] PATH_INFO: `/v3/projects/492e683b83ab4a6f8dd0c16a98ae3d0a/users/d87859ab4c704711aa80e31803697faa/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:38.005131 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-0e0825c4-f033-43d4-b81f-e7ad32c2a3e4 None None] MFA Rules not processed for user `f3bdef77b4c14ad895f797c303c09671`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:38.006384 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0e0825c4-f033-43d4-b81f-e7ad32c2a3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:38.016231 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b92a8d-bd3b-43b4-a0b3-1b5cd3e9e20c admin admin] RBAC: Authorizing `identity:create_grant(project_id=492e683b83ab4a6f8dd0c16a98ae3d0a, user_id=d87859ab4c704711aa80e31803697faa, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:38.018973 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b92a8d-bd3b-43b4-a0b3-1b5cd3e9e20c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:38.033404 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 647/1285] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:24:37 2022] PUT /identity/v3/projects/492e683b83ab4a6f8dd0c16a98ae3d0a/users/d87859ab4c704711aa80e31803697faa/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:24:38.039508 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19efe0-7b83-416b-b150-966caedab744 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:38.039952 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19efe0-7b83-416b-b150-966caedab744 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:38.040573 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19efe0-7b83-416b-b150-966caedab744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:38.064116 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-3f19efe0-7b83-416b-b150-966caedab744 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:38.065366 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3f19efe0-7b83-416b-b150-966caedab744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:38.100925 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 639/1286] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:24:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:24:38.102341 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea0c73-8748-4d99-a0c4-36a4d699b784 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:38.102726 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea0c73-8748-4d99-a0c4-36a4d699b784 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:38.103004 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea0c73-8748-4d99-a0c4-36a4d699b784 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:38.104741 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 640/1287] 10.222.0.52 () {54 vars in 961 bytes} [Thu Oct 27 13:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:24:38.105993 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c25924-a024-4a38-b64b-1514921fa5b6 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:38.106220 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c25924-a024-4a38-b64b-1514921fa5b6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:38.106486 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c25924-a024-4a38-b64b-1514921fa5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:38.128916 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-74c25924-a024-4a38-b64b-1514921fa5b6 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:38.130533 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-74c25924-a024-4a38-b64b-1514921fa5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:38.146319 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 648/1288] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:24:38.147497 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f19efe0-7b83-416b-b150-966caedab744 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:38.168380 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f19efe0-7b83-416b-b150-966caedab744 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:38.177443 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d3fed-0b4e-4b4d-a02b-c9e4d79b67b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:38.178445 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d3fed-0b4e-4b4d-a02b-c9e4d79b67b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:38.178883 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d3fed-0b4e-4b4d-a02b-c9e4d79b67b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:38.179458 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d3fed-0b4e-4b4d-a02b-c9e4d79b67b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:38.180320 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d3fed-0b4e-4b4d-a02b-c9e4d79b67b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:38.183408 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d3fed-0b4e-4b4d-a02b-c9e4d79b67b5 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:38.197864 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:38.223208 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 649/1289] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:24:38 2022] POST /identity/v3/projects => generated 409 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:24:38.224021 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d3fed-0b4e-4b4d-a02b-c9e4d79b67b5 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:38.225692 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a33d3fed-0b4e-4b4d-a02b-c9e4d79b67b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:38.226256 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 641/1290] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:24:38.228780 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1b529-b4ba-49af-91f7-5d0317c0c5ef None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:38.229126 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1b529-b4ba-49af-91f7-5d0317c0c5ef None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:38.229396 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1b529-b4ba-49af-91f7-5d0317c0c5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:38.263355 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-98f1b529-b4ba-49af-91f7-5d0317c0c5ef None None] MFA Rules not processed for user `d87859ab4c704711aa80e31803697faa`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:38.265001 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-98f1b529-b4ba-49af-91f7-5d0317c0c5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:38.312030 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d3fed-0b4e-4b4d-a02b-c9e4d79b67b5 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:38.316543 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d3d38-3fbd-40b0-b57b-d79a58238601 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:38.317382 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d3d38-3fbd-40b0-b57b-d79a58238601 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:38.318050 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d3d38-3fbd-40b0-b57b-d79a58238601 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:38.318570 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d3d38-3fbd-40b0-b57b-d79a58238601 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:38.330626 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:38.347236 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 642/1291] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:24:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:24:38.348251 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f1b529-b4ba-49af-91f7-5d0317c0c5ef None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:38.445449 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d3d38-3fbd-40b0-b57b-d79a58238601 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:38.448129 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d3d38-3fbd-40b0-b57b-d79a58238601 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:38.451758 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f1b529-b4ba-49af-91f7-5d0317c0c5ef None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:38.457160 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ad289-f15c-459c-b21c-2ef2e97356e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:38.457954 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ad289-f15c-459c-b21c-2ef2e97356e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:38.458235 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ad289-f15c-459c-b21c-2ef2e97356e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:38.458510 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ad289-f15c-459c-b21c-2ef2e97356e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:38.459154 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ad289-f15c-459c-b21c-2ef2e97356e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:38.461483 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ad289-f15c-459c-b21c-2ef2e97356e0 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:38.462047 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 650/1292] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:24:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:24:38.463450 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9ca44-dc78-4c50-ad6e-6d102b9c3df2 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:38.463755 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9ca44-dc78-4c50-ad6e-6d102b9c3df2 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:38.463964 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9ca44-dc78-4c50-ad6e-6d102b9c3df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:38.500549 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 643/1293] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:24:38 2022] POST /identity/v3/projects => generated 381 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:24:38.501747 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ad289-f15c-459c-b21c-2ef2e97356e0 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:38.560237 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-34b9ca44-dc78-4c50-ad6e-6d102b9c3df2 None None] MFA Rules not processed for user `719e4bf834d6490b96066e55a26fb159`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:38.564433 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-34b9ca44-dc78-4c50-ad6e-6d102b9c3df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:38.583589 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ad289-f15c-459c-b21c-2ef2e97356e0 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:38.588542 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3355d-e888-4927-af42-98d752988351 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:38.589762 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3355d-e888-4927-af42-98d752988351 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:38.590045 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3355d-e888-4927-af42-98d752988351 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:38.590316 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3355d-e888-4927-af42-98d752988351 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:38.612865 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:38.672283 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3355d-e888-4927-af42-98d752988351 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:38.674367 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3355d-e888-4927-af42-98d752988351 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:38.687451 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 644/1294] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:24:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:24:38.689151 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3355d-e888-4927-af42-98d752988351 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:38.701431 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3355d-e888-4927-af42-98d752988351 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:38.708019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9f0c7-fd63-4e8d-8206-7208d73e2284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:38.708647 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9f0c7-fd63-4e8d-8206-7208d73e2284 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:38.708975 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9f0c7-fd63-4e8d-8206-7208d73e2284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:38.709299 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9f0c7-fd63-4e8d-8206-7208d73e2284 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:38.710075 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9f0c7-fd63-4e8d-8206-7208d73e2284 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:38.712824 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9f0c7-fd63-4e8d-8206-7208d73e2284 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:38.749153 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 645/1295] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:24:38 2022] POST /identity/v3/users => generated 311 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:24:38.754402 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9f0c7-fd63-4e8d-8206-7208d73e2284 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:38.765011 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 651/1296] 10.222.0.52 () {58 vars in 1058 bytes} [Thu Oct 27 13:24:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:24:38.776420 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9ca44-dc78-4c50-ad6e-6d102b9c3df2 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:38.788348 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9f0c7-fd63-4e8d-8206-7208d73e2284 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:38.796431 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad3b63-1bea-41ce-a70b-3c4066e8bb85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:38.798509 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad3b63-1bea-41ce-a70b-3c4066e8bb85 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:38.799382 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad3b63-1bea-41ce-a70b-3c4066e8bb85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:38.799665 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad3b63-1bea-41ce-a70b-3c4066e8bb85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:38.819816 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad3b63-1bea-41ce-a70b-3c4066e8bb85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:38.821445 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad3b63-1bea-41ce-a70b-3c4066e8bb85 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:38.834282 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 646/1297] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:24:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:24:38.835527 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad3b63-1bea-41ce-a70b-3c4066e8bb85 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:38.846660 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad3b63-1bea-41ce-a70b-3c4066e8bb85 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:38.854373 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5624f20-6670-4f60-9778-c26a31c0708b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:38.855483 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5624f20-6670-4f60-9778-c26a31c0708b admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:38.855953 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5624f20-6670-4f60-9778-c26a31c0708b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:38.856435 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5624f20-6670-4f60-9778-c26a31c0708b admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:38.857679 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5624f20-6670-4f60-9778-c26a31c0708b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:38.865431 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5624f20-6670-4f60-9778-c26a31c0708b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:38.925893 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9ca44-dc78-4c50-ad6e-6d102b9c3df2 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:38.930317 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 647/1298] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:24:38 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:24:38.932112 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5624f20-6670-4f60-9778-c26a31c0708b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:38.937090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c944c33-05b6-4ca7-a02a-6a48c3d54dcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:38.937817 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c944c33-05b6-4ca7-a02a-6a48c3d54dcb service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:38.938105 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c944c33-05b6-4ca7-a02a-6a48c3d54dcb service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:38.938382 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c944c33-05b6-4ca7-a02a-6a48c3d54dcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:38.957397 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5624f20-6670-4f60-9778-c26a31c0708b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:38.966623 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280cfd60-3d12-4986-863d-7eebfda8b275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:38.970659 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280cfd60-3d12-4986-863d-7eebfda8b275 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:38.973636 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280cfd60-3d12-4986-863d-7eebfda8b275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:38.973949 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280cfd60-3d12-4986-863d-7eebfda8b275 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:38.975775 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280cfd60-3d12-4986-863d-7eebfda8b275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:38.979694 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280cfd60-3d12-4986-863d-7eebfda8b275 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:39.017430 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 648/1299] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:24:39.019166 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280cfd60-3d12-4986-863d-7eebfda8b275 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:39.046228 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280cfd60-3d12-4986-863d-7eebfda8b275 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:39.048316 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:39.055118 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b907f5-4505-443f-97db-595a8260ce54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719e4bf834d6490b96066e55a26fb159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:39.056055 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b907f5-4505-443f-97db-595a8260ce54 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:39.056511 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b907f5-4505-443f-97db-595a8260ce54 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:39.056958 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b907f5-4505-443f-97db-595a8260ce54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:39.074661 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c944c33-05b6-4ca7-a02a-6a48c3d54dcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:39.076329 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c944c33-05b6-4ca7-a02a-6a48c3d54dcb service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:39.106016 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 652/1300] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:24:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:24:39.107964 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c944c33-05b6-4ca7-a02a-6a48c3d54dcb service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:39.135266 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c944c33-05b6-4ca7-a02a-6a48c3d54dcb service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:39.148050 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3941904d-91d2-4123-a7ae-8f53b2396e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:39.150608 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941904d-91d2-4123-a7ae-8f53b2396e5f admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:39.151481 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941904d-91d2-4123-a7ae-8f53b2396e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:39.154706 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941904d-91d2-4123-a7ae-8f53b2396e5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:39.155682 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3941904d-91d2-4123-a7ae-8f53b2396e5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:39.160760 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3941904d-91d2-4123-a7ae-8f53b2396e5f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:39.181634 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 653/1301] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:24:39.181634 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3941904d-91d2-4123-a7ae-8f53b2396e5f admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:39.222228 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3941904d-91d2-4123-a7ae-8f53b2396e5f admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:39.237130 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b907f5-4505-443f-97db-595a8260ce54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:39.237621 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22ca08-fed9-4f63-9f0f-426d1063355a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:39.238806 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b907f5-4505-443f-97db-595a8260ce54 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:39.239610 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22ca08-fed9-4f63-9f0f-426d1063355a admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:39.240497 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22ca08-fed9-4f63-9f0f-426d1063355a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:39.241336 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22ca08-fed9-4f63-9f0f-426d1063355a admin admin] PATH_INFO: `/v3/projects/fe5ce2a92dce41d5a920026e336b1f25/users/aa0d26b61e1b43d899c4c781fc221b5c/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:39.257061 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 649/1302] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:24:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:24:39.258015 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b907f5-4505-443f-97db-595a8260ce54 service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:39.344810 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b907f5-4505-443f-97db-595a8260ce54 service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:39.344810 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee030a-77d6-4087-af4d-ce3d92946ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:39.344810 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee030a-77d6-4087-af4d-ce3d92946ea8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:39.344810 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee030a-77d6-4087-af4d-ce3d92946ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:39.352984 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee030a-77d6-4087-af4d-ce3d92946ea8 admin admin] PATH_INFO: `/v3/projects/69bcfdbd0d764ebf984b7a3802a6861b/users/06e0663a47df4f49b47673b2119b59b2/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:39.354009 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22ca08-fed9-4f63-9f0f-426d1063355a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe5ce2a92dce41d5a920026e336b1f25, user_id=aa0d26b61e1b43d899c4c781fc221b5c, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:39.354837 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22ca08-fed9-4f63-9f0f-426d1063355a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:39.360238 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee030a-77d6-4087-af4d-ce3d92946ea8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69bcfdbd0d764ebf984b7a3802a6861b, user_id=06e0663a47df4f49b47673b2119b59b2, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:39.369610 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee030a-77d6-4087-af4d-ce3d92946ea8 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:39.409046 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 650/1304] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:24:39 2022] PUT /identity/v3/projects/69bcfdbd0d764ebf984b7a3802a6861b/users/06e0663a47df4f49b47673b2119b59b2/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:24:39.412227 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 654/1304] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:24:39 2022] PUT /identity/v3/projects/fe5ce2a92dce41d5a920026e336b1f25/users/aa0d26b61e1b43d899c4c781fc221b5c/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:24:39.413762 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee030a-77d6-4087-af4d-ce3d92946ea8 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:39.422660 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22ca08-fed9-4f63-9f0f-426d1063355a admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:39.537286 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:39.616125 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22ca08-fed9-4f63-9f0f-426d1063355a admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:39.623979 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee030a-77d6-4087-af4d-ce3d92946ea8 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:39.626819 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5889c1-2e7c-4407-afc7-d28829767020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:39.627675 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5889c1-2e7c-4407-afc7-d28829767020 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:39.627827 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5889c1-2e7c-4407-afc7-d28829767020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:39.627983 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5889c1-2e7c-4407-afc7-d28829767020 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:39.628635 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5889c1-2e7c-4407-afc7-d28829767020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:39.630279 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5889c1-2e7c-4407-afc7-d28829767020 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:39.641345 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2269d8a-6e44-43b1-8260-20e88d387ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:39.642045 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2269d8a-6e44-43b1-8260-20e88d387ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:39.642326 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2269d8a-6e44-43b1-8260-20e88d387ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:39.642593 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2269d8a-6e44-43b1-8260-20e88d387ac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:39.643249 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2269d8a-6e44-43b1-8260-20e88d387ac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:39.644879 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2269d8a-6e44-43b1-8260-20e88d387ac8 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:39.656486 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 655/1305] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:24:39.656963 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5889c1-2e7c-4407-afc7-d28829767020 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:39.670181 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 651/1306] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:24:39.671870 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2269d8a-6e44-43b1-8260-20e88d387ac8 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:39.675697 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5889c1-2e7c-4407-afc7-d28829767020 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:39.681667 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aad797-ada3-4d3c-9711-88dae3c6a743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:39.682609 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aad797-ada3-4d3c-9711-88dae3c6a743 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:39.683037 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aad797-ada3-4d3c-9711-88dae3c6a743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:39.683605 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aad797-ada3-4d3c-9711-88dae3c6a743 admin admin] PATH_INFO: `/v3/projects/fe5ce2a92dce41d5a920026e336b1f25/users/aa0d26b61e1b43d899c4c781fc221b5c/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:39.686579 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aad797-ada3-4d3c-9711-88dae3c6a743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe5ce2a92dce41d5a920026e336b1f25, user_id=aa0d26b61e1b43d899c4c781fc221b5c, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:39.690116 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aad797-ada3-4d3c-9711-88dae3c6a743 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:39.693918 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2269d8a-6e44-43b1-8260-20e88d387ac8 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:39.700838 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9dd2a-a2f2-4219-9c8f-4a115dca3bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:39.701918 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9dd2a-a2f2-4219-9c8f-4a115dca3bf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:39.702202 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9dd2a-a2f2-4219-9c8f-4a115dca3bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:39.702537 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9dd2a-a2f2-4219-9c8f-4a115dca3bf4 admin admin] PATH_INFO: `/v3/projects/69bcfdbd0d764ebf984b7a3802a6861b/users/06e0663a47df4f49b47673b2119b59b2/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:39.706386 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9dd2a-a2f2-4219-9c8f-4a115dca3bf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69bcfdbd0d764ebf984b7a3802a6861b, user_id=06e0663a47df4f49b47673b2119b59b2, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:39.707890 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 656/1307] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:24:39 2022] PUT /identity/v3/projects/fe5ce2a92dce41d5a920026e336b1f25/users/aa0d26b61e1b43d899c4c781fc221b5c/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:24:39.710103 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9dd2a-a2f2-4219-9c8f-4a115dca3bf4 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:39.719644 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f6cf4-f3a6-41a2-beac-69a93a5405df None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:39.720163 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f6cf4-f3a6-41a2-beac-69a93a5405df None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:39.721213 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f6cf4-f3a6-41a2-beac-69a93a5405df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:39.723557 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 652/1308] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:24:39 2022] PUT /identity/v3/projects/69bcfdbd0d764ebf984b7a3802a6861b/users/06e0663a47df4f49b47673b2119b59b2/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:24:39.735762 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487d258-8198-4234-a467-6b02f4912b41 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:39.735762 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487d258-8198-4234-a467-6b02f4912b41 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:39.736073 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487d258-8198-4234-a467-6b02f4912b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:39.773069 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-4487d258-8198-4234-a467-6b02f4912b41 None None] MFA Rules not processed for user `06e0663a47df4f49b47673b2119b59b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:39.776213 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4487d258-8198-4234-a467-6b02f4912b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:39.784411 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-6e9f6cf4-f3a6-41a2-beac-69a93a5405df None None] MFA Rules not processed for user `aa0d26b61e1b43d899c4c781fc221b5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:39.789628 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6e9f6cf4-f3a6-41a2-beac-69a93a5405df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:39.922941 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 653/1309] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:24:39 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:24:39.933155 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487d258-8198-4234-a467-6b02f4912b41 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:39.968012 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 657/1310] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:24:39 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:24:39.991147 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4fe0b7-ecb9-493c-bf19-28cd973e3fd7 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:39.991427 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4fe0b7-ecb9-493c-bf19-28cd973e3fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:39.991701 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4fe0b7-ecb9-493c-bf19-28cd973e3fd7 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:39.993325 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 658/1311] 10.222.0.52 () {54 vars in 912 bytes} [Thu Oct 27 13:24:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 13:24:39.999930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5af4e-796e-4c65-b6df-48e6af1038c0 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:40.000131 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5af4e-796e-4c65-b6df-48e6af1038c0 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:40.000381 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5af4e-796e-4c65-b6df-48e6af1038c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:40.016206 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487d258-8198-4234-a467-6b02f4912b41 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:40.028277 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e43a71-31eb-4757-9c8e-acc72f2a4669 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:40.029044 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e43a71-31eb-4757-9c8e-acc72f2a4669 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:40.029424 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e43a71-31eb-4757-9c8e-acc72f2a4669 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:40.029955 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e43a71-31eb-4757-9c8e-acc72f2a4669 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:40.044112 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e43a71-31eb-4757-9c8e-acc72f2a4669 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:40.045979 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e43a71-31eb-4757-9c8e-acc72f2a4669 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:40.048467 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-41a5af4e-796e-4c65-b6df-48e6af1038c0 None None] MFA Rules not processed for user `719e4bf834d6490b96066e55a26fb159`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:40.049831 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-41a5af4e-796e-4c65-b6df-48e6af1038c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:40.067499 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:40.070328 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 654/1312] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:24:39 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:24:40.147432 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e43a71-31eb-4757-9c8e-acc72f2a4669 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:40.165068 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e43a71-31eb-4757-9c8e-acc72f2a4669 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:40.186975 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6243ca-08ee-47f1-93b0-dc535ad27f2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:40.187603 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6243ca-08ee-47f1-93b0-dc535ad27f2c service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:40.189709 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6243ca-08ee-47f1-93b0-dc535ad27f2c service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:40.192482 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6243ca-08ee-47f1-93b0-dc535ad27f2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:40.210336 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 659/1313] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Oct 27 13:24:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:24:40.227451 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6243ca-08ee-47f1-93b0-dc535ad27f2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:40.233111 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6243ca-08ee-47f1-93b0-dc535ad27f2c service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:40.262113 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 655/1314] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:24:40 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:24:40.364504 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5af4e-796e-4c65-b6df-48e6af1038c0 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:40.381787 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5af4e-796e-4c65-b6df-48e6af1038c0 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:40.392460 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd976104-ec8d-48e1-bd31-85d85db51de6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:40.393369 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd976104-ec8d-48e1-bd31-85d85db51de6 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:40.394241 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd976104-ec8d-48e1-bd31-85d85db51de6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:40.394519 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd976104-ec8d-48e1-bd31-85d85db51de6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:40.419210 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd976104-ec8d-48e1-bd31-85d85db51de6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:40.422229 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd976104-ec8d-48e1-bd31-85d85db51de6 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:40.465850 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 660/1315] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:24:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:24:40.499618 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6243ca-08ee-47f1-93b0-dc535ad27f2c service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:40.510047 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6243ca-08ee-47f1-93b0-dc535ad27f2c service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:40.515277 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a08783-87ee-42c8-909b-da980afd3982 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:40.516148 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a08783-87ee-42c8-909b-da980afd3982 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:40.516526 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a08783-87ee-42c8-909b-da980afd3982 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:40.516918 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a08783-87ee-42c8-909b-da980afd3982 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:40.569036 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:40.638828 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a08783-87ee-42c8-909b-da980afd3982 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:40.640584 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a08783-87ee-42c8-909b-da980afd3982 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:40.677552 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 656/1316] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:24:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:24:41.384489 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd976104-ec8d-48e1-bd31-85d85db51de6 service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:41.399713 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd976104-ec8d-48e1-bd31-85d85db51de6 service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:41.406260 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58aef14-64c8-45a4-9693-de61641a66e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:41.406892 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58aef14-64c8-45a4-9693-de61641a66e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:41.407332 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58aef14-64c8-45a4-9693-de61641a66e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:41.407784 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58aef14-64c8-45a4-9693-de61641a66e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:41.520383 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58aef14-64c8-45a4-9693-de61641a66e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:41.521496 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58aef14-64c8-45a4-9693-de61641a66e4 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:41.542566 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 661/1317] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:24:41 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:24:41.791058 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ff972-2b98-4ca2-9045-ee4e4e9ab7e2 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:41.791650 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ff972-2b98-4ca2-9045-ee4e4e9ab7e2 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:41.791650 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ff972-2b98-4ca2-9045-ee4e4e9ab7e2 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:41.793142 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 657/1318] 10.222.0.52 () {54 vars in 961 bytes} [Thu Oct 27 13:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:24:41.803223 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54384aee-654d-4056-a9f5-01470a75f62e None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:41.803562 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54384aee-654d-4056-a9f5-01470a75f62e None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:41.803884 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54384aee-654d-4056-a9f5-01470a75f62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:41.845737 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-54384aee-654d-4056-a9f5-01470a75f62e None None] MFA Rules not processed for user `719e4bf834d6490b96066e55a26fb159`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:41.847484 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-54384aee-654d-4056-a9f5-01470a75f62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:41.877692 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 662/1319] 10.222.0.52 () {58 vars in 1058 bytes} [Thu Oct 27 13:24:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:24:41.885187 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adae4f0-49ba-4e79-8cd8-cea9a1354e9f None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:41.885657 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adae4f0-49ba-4e79-8cd8-cea9a1354e9f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:41.885951 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adae4f0-49ba-4e79-8cd8-cea9a1354e9f None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:41.887820 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 658/1320] 10.222.0.52 () {54 vars in 912 bytes} [Thu Oct 27 13:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:24:41.896678 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1bf68-976d-4d95-ba38-36fcf60eb55e None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:41.897258 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1bf68-976d-4d95-ba38-36fcf60eb55e None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:41.897705 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1bf68-976d-4d95-ba38-36fcf60eb55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:41.939765 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-88b1bf68-976d-4d95-ba38-36fcf60eb55e None None] MFA Rules not processed for user `719e4bf834d6490b96066e55a26fb159`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:41.941508 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-88b1bf68-976d-4d95-ba38-36fcf60eb55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:41.973998 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 663/1321] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Oct 27 13:24:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:24:42.064963 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adae4f0-49ba-4e79-8cd8-cea9a1354e9f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:42.080621 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adae4f0-49ba-4e79-8cd8-cea9a1354e9f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:42.090268 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb895e4-ff90-42f2-b073-898f152ab69f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:42.090972 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb895e4-ff90-42f2-b073-898f152ab69f service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:42.091260 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb895e4-ff90-42f2-b073-898f152ab69f service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:42.091597 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb895e4-ff90-42f2-b073-898f152ab69f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:42.117212 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb895e4-ff90-42f2-b073-898f152ab69f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:42.118760 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb895e4-ff90-42f2-b073-898f152ab69f service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:42.157757 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 659/1322] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:24:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:24:45.507132 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94c26d-8c58-4d83-bf86-a06ae65bd832 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:45.508727 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94c26d-8c58-4d83-bf86-a06ae65bd832 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:45.509226 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94c26d-8c58-4d83-bf86-a06ae65bd832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:45.556875 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-6f94c26d-8c58-4d83-bf86-a06ae65bd832 None None] MFA Rules not processed for user `beaa55c832594b9a873b802efe381e97`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:45.559572 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6f94c26d-8c58-4d83-bf86-a06ae65bd832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:45.777914 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 664/1323] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:24:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:24:45.791794 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f673325-a632-4d8c-81fa-50ca8065ad77 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:45.792318 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f673325-a632-4d8c-81fa-50ca8065ad77 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:45.792557 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f673325-a632-4d8c-81fa-50ca8065ad77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:45.898820 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-3f673325-a632-4d8c-81fa-50ca8065ad77 None None] MFA Rules not processed for user `beaa55c832594b9a873b802efe381e97`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:45.902060 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3f673325-a632-4d8c-81fa-50ca8065ad77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:45.945903 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 660/1324] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:24:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:24:46.059659 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94c26d-8c58-4d83-bf86-a06ae65bd832 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:46.084381 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:46.101368 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94c26d-8c58-4d83-bf86-a06ae65bd832 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:46.119719 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e552f5c-9769-4fed-9d74-fd1b4ded8236 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719e4bf834d6490b96066e55a26fb159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:46.121217 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e552f5c-9769-4fed-9d74-fd1b4ded8236 service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:46.121414 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e552f5c-9769-4fed-9d74-fd1b4ded8236 service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:46.121720 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e552f5c-9769-4fed-9d74-fd1b4ded8236 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:46.132501 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e552f5c-9769-4fed-9d74-fd1b4ded8236 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:46.134794 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e552f5c-9769-4fed-9d74-fd1b4ded8236 service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:46.150740 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 665/1325] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:24:46 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:24:47.110729 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f673325-a632-4d8c-81fa-50ca8065ad77 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:47.135390 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe234a9-46fa-4841-8b97-0aa77d3317c2 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:47.136437 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe234a9-46fa-4841-8b97-0aa77d3317c2 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:47.136949 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe234a9-46fa-4841-8b97-0aa77d3317c2 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:47.138889 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 666/1326] 10.222.0.52 () {54 vars in 912 bytes} [Thu Oct 27 13:24:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:24:47.154075 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051006b-5f9a-445f-ac28-4b8ca592e360 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:47.155079 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051006b-5f9a-445f-ac28-4b8ca592e360 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:47.155577 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051006b-5f9a-445f-ac28-4b8ca592e360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:47.262987 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-1051006b-5f9a-445f-ac28-4b8ca592e360 None None] MFA Rules not processed for user `d803f074332a4216aee8a38220faa10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:47.264427 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1051006b-5f9a-445f-ac28-4b8ca592e360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:47.275170 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f673325-a632-4d8c-81fa-50ca8065ad77 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:47.284484 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5c525-194d-4412-a43c-b91fe0846031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:47.285571 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5c525-194d-4412-a43c-b91fe0846031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:47.285997 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5c525-194d-4412-a43c-b91fe0846031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:47.286429 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5c525-194d-4412-a43c-b91fe0846031 admin admin] PATH_INFO: `/v3/users/0d1d5b6ec974472eb5d1f4ddbdc43c58` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:47.288737 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e5c525-194d-4412-a43c-b91fe0846031 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d1d5b6ec974472eb5d1f4ddbdc43c58)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:47.291102 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e5c525-194d-4412-a43c-b91fe0846031 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:47.394234 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 667/1327] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Oct 27 13:24:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:24:47.408905 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051006b-5f9a-445f-ac28-4b8ca592e360 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:47.462201 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051006b-5f9a-445f-ac28-4b8ca592e360 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:47.468317 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-56e5c525-194d-4412-a43c-b91fe0846031 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d1d5b6ec974472eb5d1f4ddbdc43c58'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:47.469348 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-56e5c525-194d-4412-a43c-b91fe0846031 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d1d5b6ec974472eb5d1f4ddbdc43c58'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:47.478019 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae87fa6-48a8-4a9d-8bb1-fbe69cdba511 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:47.478252 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-56e5c525-194d-4412-a43c-b91fe0846031 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d1d5b6ec974472eb5d1f4ddbdc43c58'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:47.484531 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae87fa6-48a8-4a9d-8bb1-fbe69cdba511 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:47.484988 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae87fa6-48a8-4a9d-8bb1-fbe69cdba511 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:47.485860 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae87fa6-48a8-4a9d-8bb1-fbe69cdba511 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:47.494421 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1ae87fa6-48a8-4a9d-8bb1-fbe69cdba511 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:47.495576 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-56e5c525-194d-4412-a43c-b91fe0846031 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d1d5b6ec974472eb5d1f4ddbdc43c58'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:47.496368 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-56e5c525-194d-4412-a43c-b91fe0846031 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d1d5b6ec974472eb5d1f4ddbdc43c58'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:47.510191 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae87fa6-48a8-4a9d-8bb1-fbe69cdba511 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:47.512378 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae87fa6-48a8-4a9d-8bb1-fbe69cdba511 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:47.523265 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 668/1328] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:24:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:24:47.542276 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 661/1329] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:24:47 2022] DELETE /identity/v3/users/0d1d5b6ec974472eb5d1f4ddbdc43c58 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:24:47.547945 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcc493-751e-4e06-88ba-d7f1a1b3823f None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:47.548488 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcc493-751e-4e06-88ba-d7f1a1b3823f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:47.548914 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcc493-751e-4e06-88ba-d7f1a1b3823f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:47.621075 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-5abcc493-751e-4e06-88ba-d7f1a1b3823f None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:47.625619 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5abcc493-751e-4e06-88ba-d7f1a1b3823f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:47.802306 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 669/1330] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:24:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:24:47.861276 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5c525-194d-4412-a43c-b91fe0846031 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:47.868062 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-56e5c525-194d-4412-a43c-b91fe0846031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:47.949906 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:48.006843 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5c525-194d-4412-a43c-b91fe0846031 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:48.027112 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a42ee7b-0215-4d5d-ba11-12ef72961396 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:48.027749 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42ee7b-0215-4d5d-ba11-12ef72961396 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:48.028032 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42ee7b-0215-4d5d-ba11-12ef72961396 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:48.028932 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42ee7b-0215-4d5d-ba11-12ef72961396 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:48.050470 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a42ee7b-0215-4d5d-ba11-12ef72961396 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:48.051829 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a42ee7b-0215-4d5d-ba11-12ef72961396 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:48.073305 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 662/1331] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:24:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:24:48.715151 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abcc493-751e-4e06-88ba-d7f1a1b3823f None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:48.716673 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5abcc493-751e-4e06-88ba-d7f1a1b3823f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:48.862595 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173b675-c121-44e0-9afe-da9eeb4226fe None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:48.863407 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173b675-c121-44e0-9afe-da9eeb4226fe None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:48.864267 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173b675-c121-44e0-9afe-da9eeb4226fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:48.905173 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-7173b675-c121-44e0-9afe-da9eeb4226fe None None] MFA Rules not processed for user `beaa55c832594b9a873b802efe381e97`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:48.909996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7173b675-c121-44e0-9afe-da9eeb4226fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:48.911667 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abcc493-751e-4e06-88ba-d7f1a1b3823f None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:48.927671 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70b700-3036-423c-8689-fa4cabeb4820 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbcd6da4e42248a3b38101104fbc03cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:48.928252 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70b700-3036-423c-8689-fa4cabeb4820 service placement] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:48.928798 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70b700-3036-423c-8689-fa4cabeb4820 service placement] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:48.931446 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70b700-3036-423c-8689-fa4cabeb4820 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:48.939001 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8c70b700-3036-423c-8689-fa4cabeb4820 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:48.986742 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c70b700-3036-423c-8689-fa4cabeb4820 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:48.994182 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c70b700-3036-423c-8689-fa4cabeb4820 service placement] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:49.039059 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 670/1332] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:24:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:24:49.050730 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70b700-3036-423c-8689-fa4cabeb4820 service placement] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:49.052297 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8c70b700-3036-423c-8689-fa4cabeb4820 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:49.062475 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 663/1333] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:24:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:24:49.076688 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:49.081888 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70b700-3036-423c-8689-fa4cabeb4820 service placement] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:49.089097 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41abac-ebff-435e-9675-9d87d7cb5caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:49.089999 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41abac-ebff-435e-9675-9d87d7cb5caf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:49.090284 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41abac-ebff-435e-9675-9d87d7cb5caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:49.090561 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41abac-ebff-435e-9675-9d87d7cb5caf admin admin] PATH_INFO: `/v3/projects/6f96dcaa57f644b79627548f5cfee85b` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:49.091799 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e41abac-ebff-435e-9675-9d87d7cb5caf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f96dcaa57f644b79627548f5cfee85b)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:49.095056 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e41abac-ebff-435e-9675-9d87d7cb5caf admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:49.193045 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6e41abac-ebff-435e-9675-9d87d7cb5caf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f96dcaa57f644b79627548f5cfee85b', 'request_id': 'req-6e41abac-ebff-435e-9675-9d87d7cb5caf'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:49.201313 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173b675-c121-44e0-9afe-da9eeb4226fe None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:49.203243 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7173b675-c121-44e0-9afe-da9eeb4226fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:49.218273 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6e41abac-ebff-435e-9675-9d87d7cb5caf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f96dcaa57f644b79627548f5cfee85b', 'request_id': 'req-6e41abac-ebff-435e-9675-9d87d7cb5caf'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:49.230712 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173b675-c121-44e0-9afe-da9eeb4226fe None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:49.233058 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6e41abac-ebff-435e-9675-9d87d7cb5caf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f96dcaa57f644b79627548f5cfee85b', 'request_id': 'req-6e41abac-ebff-435e-9675-9d87d7cb5caf'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:49.266744 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6e41abac-ebff-435e-9675-9d87d7cb5caf admin admin] The token cache is being invalidate because project 6f96dcaa57f644b79627548f5cfee85b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:24:49.267039 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6e41abac-ebff-435e-9675-9d87d7cb5caf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:49.268979 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6e41abac-ebff-435e-9675-9d87d7cb5caf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:49.271972 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 671/1334] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:24:49 2022] DELETE /identity/v3/projects/6f96dcaa57f644b79627548f5cfee85b => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:24:49.276188 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51da463-b0b2-4eb7-9099-ef998719589e None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:49.277836 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51da463-b0b2-4eb7-9099-ef998719589e None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:49.278186 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51da463-b0b2-4eb7-9099-ef998719589e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:49.320179 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-d51da463-b0b2-4eb7-9099-ef998719589e None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:49.321911 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d51da463-b0b2-4eb7-9099-ef998719589e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:49.374350 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c6ab7-1cb6-42b0-afd7-8b33b6cfd2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:49.375322 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c6ab7-1cb6-42b0-afd7-8b33b6cfd2c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:49.375765 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c6ab7-1cb6-42b0-afd7-8b33b6cfd2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:49.376241 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c6ab7-1cb6-42b0-afd7-8b33b6cfd2c0 admin admin] PATH_INFO: `/v3/users/31983041c98f4df495e7aa4a38a568db` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:49.378915 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c6ab7-1cb6-42b0-afd7-8b33b6cfd2c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31983041c98f4df495e7aa4a38a568db)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:49.381698 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c6ab7-1cb6-42b0-afd7-8b33b6cfd2c0 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:49.490948 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 672/1335] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:24:49.500087 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579155c-7660-40ea-bb85-2cc901527c34 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:49.501053 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579155c-7660-40ea-bb85-2cc901527c34 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:49.501556 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579155c-7660-40ea-bb85-2cc901527c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:49.503239 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-578c6ab7-1cb6-42b0-afd7-8b33b6cfd2c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31983041c98f4df495e7aa4a38a568db'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:49.504816 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-578c6ab7-1cb6-42b0-afd7-8b33b6cfd2c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31983041c98f4df495e7aa4a38a568db'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:49.542749 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-578c6ab7-1cb6-42b0-afd7-8b33b6cfd2c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31983041c98f4df495e7aa4a38a568db'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:49.573860 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-578c6ab7-1cb6-42b0-afd7-8b33b6cfd2c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31983041c98f4df495e7aa4a38a568db'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:49.580458 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-578c6ab7-1cb6-42b0-afd7-8b33b6cfd2c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31983041c98f4df495e7aa4a38a568db'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:49.583205 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-5579155c-7660-40ea-bb85-2cc901527c34 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:49.585991 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:49.588940 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5579155c-7660-40ea-bb85-2cc901527c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:49.616396 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 664/1336] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:24:49 2022] DELETE /identity/v3/users/31983041c98f4df495e7aa4a38a568db => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:24:49.620060 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea20978-de90-4aeb-897a-03942c9d53d6 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:49.620060 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea20978-de90-4aeb-897a-03942c9d53d6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:49.620060 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea20978-de90-4aeb-897a-03942c9d53d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:49.628814 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 673/1337] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:24:49.633696 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579155c-7660-40ea-bb85-2cc901527c34 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:49.672925 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579155c-7660-40ea-bb85-2cc901527c34 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:49.692781 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-fea20978-de90-4aeb-897a-03942c9d53d6 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:49.695951 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-fea20978-de90-4aeb-897a-03942c9d53d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:49.768660 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 665/1338] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:24:49.883596 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea20978-de90-4aeb-897a-03942c9d53d6 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:49.886160 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-fea20978-de90-4aeb-897a-03942c9d53d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:49.991078 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32318f-5dbf-47a7-b3b1-d6acf6630923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:49.992520 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32318f-5dbf-47a7-b3b1-d6acf6630923 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:49.992668 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32318f-5dbf-47a7-b3b1-d6acf6630923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:49.995652 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32318f-5dbf-47a7-b3b1-d6acf6630923 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:49.996509 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32318f-5dbf-47a7-b3b1-d6acf6630923 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:24:49.996834 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32318f-5dbf-47a7-b3b1-d6acf6630923 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:50.002286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32318f-5dbf-47a7-b3b1-d6acf6630923 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:50.048954 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 674/1339] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:24:50.051197 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32318f-5dbf-47a7-b3b1-d6acf6630923 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:50.054968 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-db32318f-5dbf-47a7-b3b1-d6acf6630923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:50.076499 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea20978-de90-4aeb-897a-03942c9d53d6 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:50.091208 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c2046-8b16-4f5b-ba25-79715d007c68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:50.091836 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c2046-8b16-4f5b-ba25-79715d007c68 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:50.092110 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c2046-8b16-4f5b-ba25-79715d007c68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:50.092379 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c2046-8b16-4f5b-ba25-79715d007c68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:50.094857 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32318f-5dbf-47a7-b3b1-d6acf6630923 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:50.109287 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af96f5-b7a2-4e5d-bc14-be4aa1fe5b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:50.110522 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af96f5-b7a2-4e5d-bc14-be4aa1fe5b63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:50.110807 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af96f5-b7a2-4e5d-bc14-be4aa1fe5b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:50.112100 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c2046-8b16-4f5b-ba25-79715d007c68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:50.112670 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af96f5-b7a2-4e5d-bc14-be4aa1fe5b63 admin admin] PATH_INFO: `/v3/users/f3bdef77b4c14ad895f797c303c09671` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:50.114356 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c2046-8b16-4f5b-ba25-79715d007c68 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:50.117035 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af96f5-b7a2-4e5d-bc14-be4aa1fe5b63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3bdef77b4c14ad895f797c303c09671)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:50.120369 dv-cinder-862432-3-smb devstack@keystone.service[81482]: WARNING py.warnings [None req-d1af96f5-b7a2-4e5d-bc14-be4aa1fe5b63 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:24:50.120369 dv-cinder-862432-3-smb devstack@keystone.service[81482]: warnings.warn(msg) Oct 27 13:24:50.120369 dv-cinder-862432-3-smb devstack@keystone.service[81482]: Oct 27 13:24:50.124101 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af96f5-b7a2-4e5d-bc14-be4aa1fe5b63 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:50.145629 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 666/1340] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:24:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:24:50.146642 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c2046-8b16-4f5b-ba25-79715d007c68 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:50.150564 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:50.164970 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c2046-8b16-4f5b-ba25-79715d007c68 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:50.176406 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdcb812-e86a-48ff-bc2e-c119c034c806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:50.176963 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcb812-e86a-48ff-bc2e-c119c034c806 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:50.177244 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcb812-e86a-48ff-bc2e-c119c034c806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:50.177514 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcb812-e86a-48ff-bc2e-c119c034c806 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:50.178213 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdcb812-e86a-48ff-bc2e-c119c034c806 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:50.180178 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdcb812-e86a-48ff-bc2e-c119c034c806 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:50.257099 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 667/1341] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:24:50 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:24:50.262644 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdcb812-e86a-48ff-bc2e-c119c034c806 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:50.281799 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d1af96f5-b7a2-4e5d-bc14-be4aa1fe5b63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3bdef77b4c14ad895f797c303c09671'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:50.283935 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d1af96f5-b7a2-4e5d-bc14-be4aa1fe5b63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3bdef77b4c14ad895f797c303c09671'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:50.317580 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d1af96f5-b7a2-4e5d-bc14-be4aa1fe5b63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3bdef77b4c14ad895f797c303c09671'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:50.377013 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d1af96f5-b7a2-4e5d-bc14-be4aa1fe5b63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3bdef77b4c14ad895f797c303c09671'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:50.378767 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d1af96f5-b7a2-4e5d-bc14-be4aa1fe5b63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3bdef77b4c14ad895f797c303c09671'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:50.404457 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdcb812-e86a-48ff-bc2e-c119c034c806 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:50.410128 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716624c-4429-4537-ae61-9316ce6a1f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:50.411943 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716624c-4429-4537-ae61-9316ce6a1f37 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:50.412405 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716624c-4429-4537-ae61-9316ce6a1f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:50.412754 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716624c-4429-4537-ae61-9316ce6a1f37 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:50.413545 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5716624c-4429-4537-ae61-9316ce6a1f37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:50.420049 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5716624c-4429-4537-ae61-9316ce6a1f37 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:50.420652 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 675/1342] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:24:50 2022] DELETE /identity/v3/users/f3bdef77b4c14ad895f797c303c09671 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:24:50.430543 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca956a-dabe-422a-891b-ae33cfbd6969 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:50.430886 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca956a-dabe-422a-891b-ae33cfbd6969 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:50.431253 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca956a-dabe-422a-891b-ae33cfbd6969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:50.457179 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 668/1343] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:24:50 2022] POST /identity/v3/users => generated 287 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:24:50.458517 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716624c-4429-4537-ae61-9316ce6a1f37 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:50.460360 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5716624c-4429-4537-ae61-9316ce6a1f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:50.469750 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:50.477909 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716624c-4429-4537-ae61-9316ce6a1f37 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:50.497518 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-e6ca956a-dabe-422a-891b-ae33cfbd6969 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:50.499037 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e6ca956a-dabe-422a-891b-ae33cfbd6969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:50.641697 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239643e-e17a-4c80-bbb0-5a8ee6c8ed5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:50.642541 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239643e-e17a-4c80-bbb0-5a8ee6c8ed5c admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:50.642911 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239643e-e17a-4c80-bbb0-5a8ee6c8ed5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:50.643275 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239643e-e17a-4c80-bbb0-5a8ee6c8ed5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:50.644466 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7239643e-e17a-4c80-bbb0-5a8ee6c8ed5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:50.646218 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7239643e-e17a-4c80-bbb0-5a8ee6c8ed5c admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:50.661291 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 669/1344] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:24:50.666371 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239643e-e17a-4c80-bbb0-5a8ee6c8ed5c admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:50.678656 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239643e-e17a-4c80-bbb0-5a8ee6c8ed5c admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:50.683953 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d254cc54-5a15-4904-93b5-1e3940f74d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:50.684700 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254cc54-5a15-4904-93b5-1e3940f74d0f admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:50.685407 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254cc54-5a15-4904-93b5-1e3940f74d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:50.685929 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254cc54-5a15-4904-93b5-1e3940f74d0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:50.686768 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d254cc54-5a15-4904-93b5-1e3940f74d0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:50.689077 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d254cc54-5a15-4904-93b5-1e3940f74d0f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:50.711537 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 670/1345] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:24:50.712743 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d254cc54-5a15-4904-93b5-1e3940f74d0f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:50.726754 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d254cc54-5a15-4904-93b5-1e3940f74d0f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:50.728330 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 676/1346] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:24:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:24:50.733413 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5081711-3835-46de-b08b-a16e148c4421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:50.734236 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5081711-3835-46de-b08b-a16e148c4421 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:50.734780 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5081711-3835-46de-b08b-a16e148c4421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:50.735145 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5081711-3835-46de-b08b-a16e148c4421 admin admin] PATH_INFO: `/v3/projects/82efd2ad21ba497190ce8f4fb1dbd7c4/users/f9cd92a46e7547afa794460cfd6658c7/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:50.761347 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5081711-3835-46de-b08b-a16e148c4421 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82efd2ad21ba497190ce8f4fb1dbd7c4, user_id=f9cd92a46e7547afa794460cfd6658c7, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:50.766169 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5081711-3835-46de-b08b-a16e148c4421 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:50.795688 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 671/1347] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:24:50 2022] PUT /identity/v3/projects/82efd2ad21ba497190ce8f4fb1dbd7c4/users/f9cd92a46e7547afa794460cfd6658c7/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:24:50.800754 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca956a-dabe-422a-891b-ae33cfbd6969 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:50.807612 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67156ca-55d9-4612-af90-01c8c27cf908 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:50.808112 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67156ca-55d9-4612-af90-01c8c27cf908 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:50.808526 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67156ca-55d9-4612-af90-01c8c27cf908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:50.812132 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e6ca956a-dabe-422a-891b-ae33cfbd6969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:50.894874 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d67156ca-55d9-4612-af90-01c8c27cf908 None None] MFA Rules not processed for user `f9cd92a46e7547afa794460cfd6658c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:50.898281 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d67156ca-55d9-4612-af90-01c8c27cf908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:50.990314 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca956a-dabe-422a-891b-ae33cfbd6969 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:51.137063 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 672/1348] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:24:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:24:51.149937 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67156ca-55d9-4612-af90-01c8c27cf908 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:51.157049 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d67156ca-55d9-4612-af90-01c8c27cf908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:51.171434 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:51.199634 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017fbd6-99ff-4af6-89e7-05b2b6818c4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:51.201464 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017fbd6-99ff-4af6-89e7-05b2b6818c4a service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:51.201775 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017fbd6-99ff-4af6-89e7-05b2b6818c4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:51.202051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017fbd6-99ff-4af6-89e7-05b2b6818c4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:51.341451 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:51.385915 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67156ca-55d9-4612-af90-01c8c27cf908 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:51.400825 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036392e9-bc31-408d-8d24-cfba7da5d39b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719e4bf834d6490b96066e55a26fb159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:51.401548 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036392e9-bc31-408d-8d24-cfba7da5d39b service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:51.401837 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036392e9-bc31-408d-8d24-cfba7da5d39b service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:51.402105 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036392e9-bc31-408d-8d24-cfba7da5d39b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:51.430068 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036392e9-bc31-408d-8d24-cfba7da5d39b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:51.434117 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036392e9-bc31-408d-8d24-cfba7da5d39b service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:51.456084 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7017fbd6-99ff-4af6-89e7-05b2b6818c4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:51.458154 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7017fbd6-99ff-4af6-89e7-05b2b6818c4a service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:51.471782 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 673/1349] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:24:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:24:51.482526 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 677/1350] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:24:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 682 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:24:52.370762 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036392e9-bc31-408d-8d24-cfba7da5d39b service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:52.376804 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-036392e9-bc31-408d-8d24-cfba7da5d39b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:52.395989 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036392e9-bc31-408d-8d24-cfba7da5d39b service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:52.401618 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bdcaf2-e19f-48f1-bf89-9ca9e50809e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:52.402782 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdcaf2-e19f-48f1-bf89-9ca9e50809e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:52.403219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdcaf2-e19f-48f1-bf89-9ca9e50809e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:52.403773 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdcaf2-e19f-48f1-bf89-9ca9e50809e6 admin admin] PATH_INFO: `/v3/users/d87859ab4c704711aa80e31803697faa` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:52.405588 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bdcaf2-e19f-48f1-bf89-9ca9e50809e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d87859ab4c704711aa80e31803697faa)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:52.408586 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bdcaf2-e19f-48f1-bf89-9ca9e50809e6 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:52.482611 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-23bdcaf2-e19f-48f1-bf89-9ca9e50809e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd87859ab4c704711aa80e31803697faa'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:52.483916 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-23bdcaf2-e19f-48f1-bf89-9ca9e50809e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd87859ab4c704711aa80e31803697faa'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:52.495963 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-23bdcaf2-e19f-48f1-bf89-9ca9e50809e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd87859ab4c704711aa80e31803697faa'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:52.497380 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017fbd6-99ff-4af6-89e7-05b2b6818c4a service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:52.504579 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7017fbd6-99ff-4af6-89e7-05b2b6818c4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:52.512682 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-23bdcaf2-e19f-48f1-bf89-9ca9e50809e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd87859ab4c704711aa80e31803697faa'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:52.513822 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-23bdcaf2-e19f-48f1-bf89-9ca9e50809e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd87859ab4c704711aa80e31803697faa'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:52.542908 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017fbd6-99ff-4af6-89e7-05b2b6818c4a service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:52.543222 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 674/1351] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:24:52 2022] DELETE /identity/v3/users/d87859ab4c704711aa80e31803697faa => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:24:52.552067 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8331936-4c4f-47f6-bdd9-eeb08b5eff7b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:52.553143 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8331936-4c4f-47f6-bdd9-eeb08b5eff7b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:52.553143 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8331936-4c4f-47f6-bdd9-eeb08b5eff7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:52.602828 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-c8331936-4c4f-47f6-bdd9-eeb08b5eff7b None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:52.604297 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c8331936-4c4f-47f6-bdd9-eeb08b5eff7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:52.718819 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f229ada-dad7-4768-b4e5-d046e6add9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:52.719478 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f229ada-dad7-4768-b4e5-d046e6add9fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:52.719754 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f229ada-dad7-4768-b4e5-d046e6add9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:52.720027 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f229ada-dad7-4768-b4e5-d046e6add9fd admin admin] PATH_INFO: `/v3/projects/09838d6914f447ed9ef0c61f04a47eee` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:52.727929 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f229ada-dad7-4768-b4e5-d046e6add9fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=09838d6914f447ed9ef0c61f04a47eee)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:52.732297 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f229ada-dad7-4768-b4e5-d046e6add9fd admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:52.824571 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 675/1352] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:24:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:24:52.826520 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446fa6b-a6ea-441f-9299-4f47691ea23b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:52.828086 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446fa6b-a6ea-441f-9299-4f47691ea23b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:52.830696 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446fa6b-a6ea-441f-9299-4f47691ea23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:52.858657 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-7f229ada-dad7-4768-b4e5-d046e6add9fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09838d6914f447ed9ef0c61f04a47eee', 'request_id': 'req-7f229ada-dad7-4768-b4e5-d046e6add9fd'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:52.871729 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-7f229ada-dad7-4768-b4e5-d046e6add9fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09838d6914f447ed9ef0c61f04a47eee', 'request_id': 'req-7f229ada-dad7-4768-b4e5-d046e6add9fd'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:52.883868 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-7f229ada-dad7-4768-b4e5-d046e6add9fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09838d6914f447ed9ef0c61f04a47eee', 'request_id': 'req-7f229ada-dad7-4768-b4e5-d046e6add9fd'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:52.918012 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-7f229ada-dad7-4768-b4e5-d046e6add9fd admin admin] The token cache is being invalidate because project 09838d6914f447ed9ef0c61f04a47eee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:24:52.918313 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-7f229ada-dad7-4768-b4e5-d046e6add9fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:52.920257 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-7f229ada-dad7-4768-b4e5-d046e6add9fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:52.930408 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 678/1353] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:24:52 2022] DELETE /identity/v3/projects/09838d6914f447ed9ef0c61f04a47eee => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:24:52.931451 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f229ada-dad7-4768-b4e5-d046e6add9fd admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:52.937027 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7f229ada-dad7-4768-b4e5-d046e6add9fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:52.938932 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-2446fa6b-a6ea-441f-9299-4f47691ea23b None None] MFA Rules not processed for user `cffe930429614615adc2e63e165b9c45`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:52.940559 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2446fa6b-a6ea-441f-9299-4f47691ea23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:52.989490 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:53.045780 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:53.111517 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 676/1354] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Oct 27 13:24:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:24:53.113003 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446fa6b-a6ea-441f-9299-4f47691ea23b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:53.117308 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2446fa6b-a6ea-441f-9299-4f47691ea23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:53.161320 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f229ada-dad7-4768-b4e5-d046e6add9fd admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:53.180182 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db0aaf-9606-4d62-bf73-73a2715afd2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:53.188127 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db0aaf-9606-4d62-bf73-73a2715afd2a service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:53.188437 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db0aaf-9606-4d62-bf73-73a2715afd2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:53.188717 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db0aaf-9606-4d62-bf73-73a2715afd2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:53.197104 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-06db0aaf-9606-4d62-bf73-73a2715afd2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:53.306372 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446fa6b-a6ea-441f-9299-4f47691ea23b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:53.319391 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f4aa6-71d3-4763-a577-99b50d70dffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:53.320175 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f4aa6-71d3-4763-a577-99b50d70dffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:53.320553 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f4aa6-71d3-4763-a577-99b50d70dffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:53.320921 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f4aa6-71d3-4763-a577-99b50d70dffa admin admin] PATH_INFO: `/v3/projects/8417ceda73534d50b053c9652d752612` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:53.324104 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f4aa6-71d3-4763-a577-99b50d70dffa admin admin] RBAC: Authorizing `identity:delete_project(project_id=8417ceda73534d50b053c9652d752612)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:53.325320 dv-cinder-862432-3-smb devstack@keystone.service[81481]: WARNING py.warnings [None req-597f4aa6-71d3-4763-a577-99b50d70dffa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:24:53.325320 dv-cinder-862432-3-smb devstack@keystone.service[81481]: warnings.warn(msg) Oct 27 13:24:53.325320 dv-cinder-862432-3-smb devstack@keystone.service[81481]: Oct 27 13:24:53.333443 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f4aa6-71d3-4763-a577-99b50d70dffa admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:53.398230 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db0aaf-9606-4d62-bf73-73a2715afd2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:53.404355 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db0aaf-9606-4d62-bf73-73a2715afd2a service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:53.438414 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 679/1355] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:24:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:24:53.442193 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db0aaf-9606-4d62-bf73-73a2715afd2a service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:53.447768 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-06db0aaf-9606-4d62-bf73-73a2715afd2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:53.513427 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db0aaf-9606-4d62-bf73-73a2715afd2a service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:53.526946 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-597f4aa6-71d3-4763-a577-99b50d70dffa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8417ceda73534d50b053c9652d752612', 'request_id': 'req-597f4aa6-71d3-4763-a577-99b50d70dffa'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:53.565279 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-597f4aa6-71d3-4763-a577-99b50d70dffa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8417ceda73534d50b053c9652d752612', 'request_id': 'req-597f4aa6-71d3-4763-a577-99b50d70dffa'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:53.615571 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-597f4aa6-71d3-4763-a577-99b50d70dffa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8417ceda73534d50b053c9652d752612', 'request_id': 'req-597f4aa6-71d3-4763-a577-99b50d70dffa'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:53.662729 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-597f4aa6-71d3-4763-a577-99b50d70dffa admin admin] The token cache is being invalidate because project 8417ceda73534d50b053c9652d752612 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:24:53.663229 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-597f4aa6-71d3-4763-a577-99b50d70dffa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:53.669744 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-597f4aa6-71d3-4763-a577-99b50d70dffa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:53.679014 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 677/1356] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:24:53 2022] DELETE /identity/v3/projects/8417ceda73534d50b053c9652d752612 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:24:53.680851 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f4aa6-71d3-4763-a577-99b50d70dffa admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:53.690481 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-597f4aa6-71d3-4763-a577-99b50d70dffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:53.710219 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d897f-902e-4654-b87a-18ead02b9a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:53.711334 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d897f-902e-4654-b87a-18ead02b9a5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:53.711768 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d897f-902e-4654-b87a-18ead02b9a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:53.712301 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d897f-902e-4654-b87a-18ead02b9a5e admin admin] PATH_INFO: `/v3/users/06e0663a47df4f49b47673b2119b59b2` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:53.714041 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308d897f-902e-4654-b87a-18ead02b9a5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=06e0663a47df4f49b47673b2119b59b2)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:53.716694 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308d897f-902e-4654-b87a-18ead02b9a5e admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:53.796076 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-308d897f-902e-4654-b87a-18ead02b9a5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06e0663a47df4f49b47673b2119b59b2'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:53.797197 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-308d897f-902e-4654-b87a-18ead02b9a5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06e0663a47df4f49b47673b2119b59b2'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:53.817311 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-308d897f-902e-4654-b87a-18ead02b9a5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06e0663a47df4f49b47673b2119b59b2'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:53.837070 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-308d897f-902e-4654-b87a-18ead02b9a5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06e0663a47df4f49b47673b2119b59b2'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:53.838786 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-308d897f-902e-4654-b87a-18ead02b9a5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06e0663a47df4f49b47673b2119b59b2'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:53.850633 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:53.890410 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 680/1357] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:24:53 2022] DELETE /identity/v3/users/06e0663a47df4f49b47673b2119b59b2 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:24:53.894308 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d897f-902e-4654-b87a-18ead02b9a5e admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:53.896211 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-308d897f-902e-4654-b87a-18ead02b9a5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:53.907513 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:54.054181 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d897f-902e-4654-b87a-18ead02b9a5e admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:54.062643 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbeb485-0bb7-439c-918c-180d1063eb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:54.063300 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbeb485-0bb7-439c-918c-180d1063eb97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:54.063574 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbeb485-0bb7-439c-918c-180d1063eb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:54.063967 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbeb485-0bb7-439c-918c-180d1063eb97 admin admin] PATH_INFO: `/v3/users/aa0d26b61e1b43d899c4c781fc221b5c` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:54.066998 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbeb485-0bb7-439c-918c-180d1063eb97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa0d26b61e1b43d899c4c781fc221b5c)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:54.070599 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f4aa6-71d3-4763-a577-99b50d70dffa admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:54.085903 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbeb485-0bb7-439c-918c-180d1063eb97 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:54.190713 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ddbeb485-0bb7-439c-918c-180d1063eb97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa0d26b61e1b43d899c4c781fc221b5c'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:54.192266 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ddbeb485-0bb7-439c-918c-180d1063eb97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa0d26b61e1b43d899c4c781fc221b5c'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:54.213385 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ddbeb485-0bb7-439c-918c-180d1063eb97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa0d26b61e1b43d899c4c781fc221b5c'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:54.240522 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d2b147-a779-4410-bb6d-911cafb23e39 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62769acbfca242d6a0b0fe5a6b8bc108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:54.241731 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2b147-a779-4410-bb6d-911cafb23e39 service swift] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:54.242260 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2b147-a779-4410-bb6d-911cafb23e39 service swift] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:54.243632 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2b147-a779-4410-bb6d-911cafb23e39 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:54.253944 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-06d2b147-a779-4410-bb6d-911cafb23e39 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:54.261311 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ddbeb485-0bb7-439c-918c-180d1063eb97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa0d26b61e1b43d899c4c781fc221b5c'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:54.297928 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ddbeb485-0bb7-439c-918c-180d1063eb97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa0d26b61e1b43d899c4c781fc221b5c'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:54.374586 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 681/1358] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:24:53 2022] DELETE /identity/v3/users/aa0d26b61e1b43d899c4c781fc221b5c => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:24:54.486583 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d2b147-a779-4410-bb6d-911cafb23e39 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:54.488308 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d2b147-a779-4410-bb6d-911cafb23e39 service swift] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:54.512984 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 678/1359] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Oct 27 13:24:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 832 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 13:24:55.139878 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbeb485-0bb7-439c-918c-180d1063eb97 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:55.142794 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ddbeb485-0bb7-439c-918c-180d1063eb97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:55.524202 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbeb485-0bb7-439c-918c-180d1063eb97 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:55.537964 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa708d-d4be-4ed8-a6d9-9424cc1ad0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:55.539073 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa708d-d4be-4ed8-a6d9-9424cc1ad0dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:55.539648 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa708d-d4be-4ed8-a6d9-9424cc1ad0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:55.540299 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa708d-d4be-4ed8-a6d9-9424cc1ad0dd admin admin] PATH_INFO: `/v3/users/f9cd92a46e7547afa794460cfd6658c7` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:55.543421 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa708d-d4be-4ed8-a6d9-9424cc1ad0dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9cd92a46e7547afa794460cfd6658c7)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:55.551419 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa708d-d4be-4ed8-a6d9-9424cc1ad0dd admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:55.596239 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:55.689340 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-7caa708d-d4be-4ed8-a6d9-9424cc1ad0dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9cd92a46e7547afa794460cfd6658c7'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:55.691815 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-7caa708d-d4be-4ed8-a6d9-9424cc1ad0dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9cd92a46e7547afa794460cfd6658c7'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:55.729779 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-7caa708d-d4be-4ed8-a6d9-9424cc1ad0dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9cd92a46e7547afa794460cfd6658c7'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:55.761097 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-7caa708d-d4be-4ed8-a6d9-9424cc1ad0dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9cd92a46e7547afa794460cfd6658c7'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:55.762733 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-7caa708d-d4be-4ed8-a6d9-9424cc1ad0dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9cd92a46e7547afa794460cfd6658c7'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:55.801742 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 682/1360] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:24:55 2022] DELETE /identity/v3/users/f9cd92a46e7547afa794460cfd6658c7 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:24:55.804165 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c934c95-af36-446a-900b-6ff90f387ee6 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:55.805069 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c934c95-af36-446a-900b-6ff90f387ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:55.805689 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c934c95-af36-446a-900b-6ff90f387ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:55.865245 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-0c934c95-af36-446a-900b-6ff90f387ee6 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:55.866865 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0c934c95-af36-446a-900b-6ff90f387ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:56.085634 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 679/1361] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:24:56.368954 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa708d-d4be-4ed8-a6d9-9424cc1ad0dd admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:56.372375 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7caa708d-d4be-4ed8-a6d9-9424cc1ad0dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:56.514981 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa708d-d4be-4ed8-a6d9-9424cc1ad0dd admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:56.522870 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889fcc35-a4d8-4a2d-a6ff-a07c1daf6c78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:56.523538 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fcc35-a4d8-4a2d-a6ff-a07c1daf6c78 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:56.523821 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fcc35-a4d8-4a2d-a6ff-a07c1daf6c78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:56.524095 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fcc35-a4d8-4a2d-a6ff-a07c1daf6c78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:56.547884 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889fcc35-a4d8-4a2d-a6ff-a07c1daf6c78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:56.549822 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889fcc35-a4d8-4a2d-a6ff-a07c1daf6c78 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:56.565501 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 683/1362] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:24:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:24:56.949484 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c934c95-af36-446a-900b-6ff90f387ee6 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:56.956061 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0c934c95-af36-446a-900b-6ff90f387ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:57.025651 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c934c95-af36-446a-900b-6ff90f387ee6 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:57.066844 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba815823-0739-4d53-a72a-e2c1d795bff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:57.069925 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba815823-0739-4d53-a72a-e2c1d795bff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:57.070250 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba815823-0739-4d53-a72a-e2c1d795bff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:57.071400 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba815823-0739-4d53-a72a-e2c1d795bff2 admin admin] PATH_INFO: `/v3/projects/492e683b83ab4a6f8dd0c16a98ae3d0a` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:57.075810 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba815823-0739-4d53-a72a-e2c1d795bff2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=492e683b83ab4a6f8dd0c16a98ae3d0a)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:57.082445 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba815823-0739-4d53-a72a-e2c1d795bff2 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:57.116031 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889fcc35-a4d8-4a2d-a6ff-a07c1daf6c78 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:57.117619 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-889fcc35-a4d8-4a2d-a6ff-a07c1daf6c78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:57.138272 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:57.142630 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889fcc35-a4d8-4a2d-a6ff-a07c1daf6c78 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:57.161706 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd50c63-2bc1-49d5-9f09-fbdef100107e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:57.163336 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd50c63-2bc1-49d5-9f09-fbdef100107e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:57.163701 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd50c63-2bc1-49d5-9f09-fbdef100107e admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:57.164053 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd50c63-2bc1-49d5-9f09-fbdef100107e admin admin] PATH_INFO: `/v3/projects/fe5ce2a92dce41d5a920026e336b1f25` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:57.167187 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd50c63-2bc1-49d5-9f09-fbdef100107e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe5ce2a92dce41d5a920026e336b1f25)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:57.169958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd50c63-2bc1-49d5-9f09-fbdef100107e admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:57.344447 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5bd50c63-2bc1-49d5-9f09-fbdef100107e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe5ce2a92dce41d5a920026e336b1f25', 'request_id': 'req-5bd50c63-2bc1-49d5-9f09-fbdef100107e'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:57.366884 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5bd50c63-2bc1-49d5-9f09-fbdef100107e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe5ce2a92dce41d5a920026e336b1f25', 'request_id': 'req-5bd50c63-2bc1-49d5-9f09-fbdef100107e'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:57.382343 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5bd50c63-2bc1-49d5-9f09-fbdef100107e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe5ce2a92dce41d5a920026e336b1f25', 'request_id': 'req-5bd50c63-2bc1-49d5-9f09-fbdef100107e'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:57.393350 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ba815823-0739-4d53-a72a-e2c1d795bff2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '492e683b83ab4a6f8dd0c16a98ae3d0a', 'request_id': 'req-ba815823-0739-4d53-a72a-e2c1d795bff2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:57.416497 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ba815823-0739-4d53-a72a-e2c1d795bff2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '492e683b83ab4a6f8dd0c16a98ae3d0a', 'request_id': 'req-ba815823-0739-4d53-a72a-e2c1d795bff2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:57.428295 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5bd50c63-2bc1-49d5-9f09-fbdef100107e admin admin] The token cache is being invalidate because project fe5ce2a92dce41d5a920026e336b1f25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:24:57.428849 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5bd50c63-2bc1-49d5-9f09-fbdef100107e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:57.429883 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5bd50c63-2bc1-49d5-9f09-fbdef100107e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:57.430980 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ba815823-0739-4d53-a72a-e2c1d795bff2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '492e683b83ab4a6f8dd0c16a98ae3d0a', 'request_id': 'req-ba815823-0739-4d53-a72a-e2c1d795bff2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:57.434072 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 684/1363] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:24:57 2022] DELETE /identity/v3/projects/fe5ce2a92dce41d5a920026e336b1f25 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:24:57.439692 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec255b-0b35-465b-aa42-7c3636e98eb4 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:57.440180 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec255b-0b35-465b-aa42-7c3636e98eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:57.440601 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec255b-0b35-465b-aa42-7c3636e98eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:57.466020 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ba815823-0739-4d53-a72a-e2c1d795bff2 admin admin] The token cache is being invalidate because project 492e683b83ab4a6f8dd0c16a98ae3d0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:24:57.466588 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ba815823-0739-4d53-a72a-e2c1d795bff2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:57.467850 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ba815823-0739-4d53-a72a-e2c1d795bff2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:57.478109 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 680/1364] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:24:56 2022] DELETE /identity/v3/projects/492e683b83ab4a6f8dd0c16a98ae3d0a => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:24:57.483205 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e386035-3ab4-4be8-8427-e2895ba848c9 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:57.483676 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e386035-3ab4-4be8-8427-e2895ba848c9 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:57.484089 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e386035-3ab4-4be8-8427-e2895ba848c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:57.499699 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-2fec255b-0b35-465b-aa42-7c3636e98eb4 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:57.501197 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2fec255b-0b35-465b-aa42-7c3636e98eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:57.542804 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:57.567585 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-7e386035-3ab4-4be8-8427-e2895ba848c9 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:57.573622 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7e386035-3ab4-4be8-8427-e2895ba848c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:57.751868 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 685/1365] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:24:57.761853 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6447c3-79ec-4a0d-be31-f27e42d972f5 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:57.767753 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6447c3-79ec-4a0d-be31-f27e42d972f5 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:57.768964 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6447c3-79ec-4a0d-be31-f27e42d972f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:57.844241 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 681/1366] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:24:57.855957 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e386035-3ab4-4be8-8427-e2895ba848c9 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:57.862854 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7e386035-3ab4-4be8-8427-e2895ba848c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:57.873003 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-eb6447c3-79ec-4a0d-be31-f27e42d972f5 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:57.878975 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-eb6447c3-79ec-4a0d-be31-f27e42d972f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:57.923075 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e386035-3ab4-4be8-8427-e2895ba848c9 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:57.927642 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 686/1367] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:24:57.931637 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5a3e3-c05b-48d6-a6ef-d913e99d2e6a None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:57.931637 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5a3e3-c05b-48d6-a6ef-d913e99d2e6a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:57.937690 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5a3e3-c05b-48d6-a6ef-d913e99d2e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:57.943389 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d9a5f-96f0-43c6-ba2d-72d274d7b86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:57.944065 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d9a5f-96f0-43c6-ba2d-72d274d7b86f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:57.944403 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d9a5f-96f0-43c6-ba2d-72d274d7b86f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:57.944947 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d9a5f-96f0-43c6-ba2d-72d274d7b86f admin admin] PATH_INFO: `/v3/projects/69bcfdbd0d764ebf984b7a3802a6861b` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:57.947058 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d9a5f-96f0-43c6-ba2d-72d274d7b86f admin admin] RBAC: Authorizing `identity:delete_project(project_id=69bcfdbd0d764ebf984b7a3802a6861b)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:57.952461 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d9a5f-96f0-43c6-ba2d-72d274d7b86f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:58.003287 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-d0a5a3e3-c05b-48d6-a6ef-d913e99d2e6a None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:58.006968 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d0a5a3e3-c05b-48d6-a6ef-d913e99d2e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:58.035025 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 687/1368] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:24:58.035025 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5a3e3-c05b-48d6-a6ef-d913e99d2e6a None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:58.060987 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5a3e3-c05b-48d6-a6ef-d913e99d2e6a None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:58.075389 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275beba2-8bf6-4e23-8902-02bcdc884300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:58.076120 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275beba2-8bf6-4e23-8902-02bcdc884300 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:58.076498 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275beba2-8bf6-4e23-8902-02bcdc884300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:58.076872 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275beba2-8bf6-4e23-8902-02bcdc884300 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:58.077660 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275beba2-8bf6-4e23-8902-02bcdc884300 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:24:58.078069 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275beba2-8bf6-4e23-8902-02bcdc884300 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:58.079818 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275beba2-8bf6-4e23-8902-02bcdc884300 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:58.128781 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 688/1369] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:24:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:24:58.128781 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275beba2-8bf6-4e23-8902-02bcdc884300 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:58.158092 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275beba2-8bf6-4e23-8902-02bcdc884300 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:58.164290 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-da4d9a5f-96f0-43c6-ba2d-72d274d7b86f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69bcfdbd0d764ebf984b7a3802a6861b', 'request_id': 'req-da4d9a5f-96f0-43c6-ba2d-72d274d7b86f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:58.181086 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-da4d9a5f-96f0-43c6-ba2d-72d274d7b86f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69bcfdbd0d764ebf984b7a3802a6861b', 'request_id': 'req-da4d9a5f-96f0-43c6-ba2d-72d274d7b86f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:58.195399 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-da4d9a5f-96f0-43c6-ba2d-72d274d7b86f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69bcfdbd0d764ebf984b7a3802a6861b', 'request_id': 'req-da4d9a5f-96f0-43c6-ba2d-72d274d7b86f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:58.242467 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-da4d9a5f-96f0-43c6-ba2d-72d274d7b86f admin admin] The token cache is being invalidate because project 69bcfdbd0d764ebf984b7a3802a6861b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:24:58.242771 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-da4d9a5f-96f0-43c6-ba2d-72d274d7b86f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:58.243900 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-da4d9a5f-96f0-43c6-ba2d-72d274d7b86f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:24:58.252029 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 682/1370] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:24:57 2022] DELETE /identity/v3/projects/69bcfdbd0d764ebf984b7a3802a6861b => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:24:58.253008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d9a5f-96f0-43c6-ba2d-72d274d7b86f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:58.254450 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-da4d9a5f-96f0-43c6-ba2d-72d274d7b86f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:58.358011 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:58.381496 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b62b29-db38-4765-ac1e-f8f1b25f3deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:58.384953 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b62b29-db38-4765-ac1e-f8f1b25f3deb admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:58.387401 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b62b29-db38-4765-ac1e-f8f1b25f3deb admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:58.388031 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b62b29-db38-4765-ac1e-f8f1b25f3deb admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:58.389333 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b62b29-db38-4765-ac1e-f8f1b25f3deb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:24:58.389823 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b62b29-db38-4765-ac1e-f8f1b25f3deb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:58.412354 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b62b29-db38-4765-ac1e-f8f1b25f3deb admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:58.468279 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 689/1371] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:24:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:24:58.471783 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5e216-0a2f-43f5-87a1-5e35f84f6fed None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:58.472074 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5e216-0a2f-43f5-87a1-5e35f84f6fed None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:58.472340 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d9a5f-96f0-43c6-ba2d-72d274d7b86f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:58.472445 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5e216-0a2f-43f5-87a1-5e35f84f6fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:58.489743 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fbe759-bc13-46d7-88a9-7d962d103df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:58.490391 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbe759-bc13-46d7-88a9-7d962d103df8 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:58.490676 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbe759-bc13-46d7-88a9-7d962d103df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:58.490954 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbe759-bc13-46d7-88a9-7d962d103df8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:58.494506 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fbe759-bc13-46d7-88a9-7d962d103df8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:58.499579 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fbe759-bc13-46d7-88a9-7d962d103df8 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:58.570726 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-c6a5e216-0a2f-43f5-87a1-5e35f84f6fed None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:58.577706 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c6a5e216-0a2f-43f5-87a1-5e35f84f6fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:58.591330 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 683/1372] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:24:58 2022] POST /identity/v3/projects => generated 379 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:24:58.596260 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fbe759-bc13-46d7-88a9-7d962d103df8 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:58.615233 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 690/1373] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:24:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:24:58.617645 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5e216-0a2f-43f5-87a1-5e35f84f6fed None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:58.627419 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-77fbe759-bc13-46d7-88a9-7d962d103df8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:58.651323 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5e216-0a2f-43f5-87a1-5e35f84f6fed None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:58.979780 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1f513-d8aa-4d00-b0f4-7607e6aa8a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:58.982748 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1f513-d8aa-4d00-b0f4-7607e6aa8a37 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:58.983257 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1f513-d8aa-4d00-b0f4-7607e6aa8a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:58.983635 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1f513-d8aa-4d00-b0f4-7607e6aa8a37 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:58.984760 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed1f513-d8aa-4d00-b0f4-7607e6aa8a37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:58.985895 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fbe759-bc13-46d7-88a9-7d962d103df8 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:58.995014 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed1f513-d8aa-4d00-b0f4-7607e6aa8a37 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:59.005304 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e0c3f-6179-4648-9438-0251b7279ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:59.010433 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e0c3f-6179-4648-9438-0251b7279ed0 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:59.012966 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e0c3f-6179-4648-9438-0251b7279ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:59.013590 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e0c3f-6179-4648-9438-0251b7279ed0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:59.015047 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e0c3f-6179-4648-9438-0251b7279ed0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:59.018313 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e0c3f-6179-4648-9438-0251b7279ed0 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:59.073493 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 691/1374] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:24:58 2022] POST /identity/v3/users => generated 290 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:24:59.079100 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079280a1-3e13-459e-ad2d-63d18e6d61a8 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:59.087076 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079280a1-3e13-459e-ad2d-63d18e6d61a8 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:59.087649 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079280a1-3e13-459e-ad2d-63d18e6d61a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:59.127056 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-079280a1-3e13-459e-ad2d-63d18e6d61a8 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:59.132267 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-079280a1-3e13-459e-ad2d-63d18e6d61a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:59.142294 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 684/1375] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:24:58 2022] POST /identity/v3/projects => generated 357 bytes in 550 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:24:59.143724 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26eadc2-6023-4a75-9e40-f48d2679ac8d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:59.144006 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26eadc2-6023-4a75-9e40-f48d2679ac8d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:59.144276 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26eadc2-6023-4a75-9e40-f48d2679ac8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:59.156580 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:59.220469 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-f26eadc2-6023-4a75-9e40-f48d2679ac8d None None] MFA Rules not processed for user `d803f074332a4216aee8a38220faa10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:24:59.221763 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f26eadc2-6023-4a75-9e40-f48d2679ac8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:59.410314 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 692/1376] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:24:59.414394 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079280a1-3e13-459e-ad2d-63d18e6d61a8 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:59.439994 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 685/1377] 10.222.0.49 () {58 vars in 1015 bytes} [Thu Oct 27 13:24:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:24:59.440972 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26eadc2-6023-4a75-9e40-f48d2679ac8d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:59.459875 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079280a1-3e13-459e-ad2d-63d18e6d61a8 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:59.485061 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d99db4-91cb-4104-b964-e6f345fdd6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:59.485723 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d99db4-91cb-4104-b964-e6f345fdd6a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:59.486003 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d99db4-91cb-4104-b964-e6f345fdd6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:59.486344 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d99db4-91cb-4104-b964-e6f345fdd6a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:59.486925 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d99db4-91cb-4104-b964-e6f345fdd6a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:59.488584 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d99db4-91cb-4104-b964-e6f345fdd6a4 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:59.503142 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26eadc2-6023-4a75-9e40-f48d2679ac8d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:59.521790 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 693/1378] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:24:59.522057 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa25965-c9a0-484b-b2b1-f0940cee9040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:59.522716 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa25965-c9a0-484b-b2b1-f0940cee9040 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:59.522995 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa25965-c9a0-484b-b2b1-f0940cee9040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:59.523264 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa25965-c9a0-484b-b2b1-f0940cee9040 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:59.524333 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa25965-c9a0-484b-b2b1-f0940cee9040 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:59.526282 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa25965-c9a0-484b-b2b1-f0940cee9040 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:59.531741 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d99db4-91cb-4104-b964-e6f345fdd6a4 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:59.582067 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d99db4-91cb-4104-b964-e6f345fdd6a4 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:59.587323 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 686/1379] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:24:59 2022] POST /identity/v3/users => generated 279 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:24:59.588620 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa25965-c9a0-484b-b2b1-f0940cee9040 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:59.613740 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e8c790-6d8c-4283-9b35-3b100725021c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:59.614678 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8c790-6d8c-4283-9b35-3b100725021c admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:59.615099 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8c790-6d8c-4283-9b35-3b100725021c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:59.617388 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8c790-6d8c-4283-9b35-3b100725021c admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:59.618689 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa25965-c9a0-484b-b2b1-f0940cee9040 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:59.619567 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e8c790-6d8c-4283-9b35-3b100725021c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:24:59.620100 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e8c790-6d8c-4283-9b35-3b100725021c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:59.624840 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e8c790-6d8c-4283-9b35-3b100725021c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:59.630414 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a26eb2-5c2c-4ffc-b818-62e76d2e4654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:59.631628 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a26eb2-5c2c-4ffc-b818-62e76d2e4654 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:59.640825 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a26eb2-5c2c-4ffc-b818-62e76d2e4654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:59.642046 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a26eb2-5c2c-4ffc-b818-62e76d2e4654 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:59.642867 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a26eb2-5c2c-4ffc-b818-62e76d2e4654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:59.647690 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a26eb2-5c2c-4ffc-b818-62e76d2e4654 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:59.663488 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 694/1380] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:24:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:24:59.664817 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e8c790-6d8c-4283-9b35-3b100725021c admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:59.677935 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-88e8c790-6d8c-4283-9b35-3b100725021c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:24:59.698250 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 687/1381] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:24:59.699343 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a26eb2-5c2c-4ffc-b818-62e76d2e4654 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:59.721913 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e8c790-6d8c-4283-9b35-3b100725021c admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:59.726177 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a26eb2-5c2c-4ffc-b818-62e76d2e4654 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:59.739616 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e904d-48c3-4d93-9866-3aaa5bd2bf3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:59.742023 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e904d-48c3-4d93-9866-3aaa5bd2bf3d service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:59.742279 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d00cec-82e1-4984-8d2a-ff2c2609244e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:59.742749 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e904d-48c3-4d93-9866-3aaa5bd2bf3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:59.742949 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d00cec-82e1-4984-8d2a-ff2c2609244e admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:59.743246 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d00cec-82e1-4984-8d2a-ff2c2609244e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:59.743775 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e904d-48c3-4d93-9866-3aaa5bd2bf3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:59.743947 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d00cec-82e1-4984-8d2a-ff2c2609244e admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:59.744609 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d00cec-82e1-4984-8d2a-ff2c2609244e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:59.746344 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d00cec-82e1-4984-8d2a-ff2c2609244e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:59.763227 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e904d-48c3-4d93-9866-3aaa5bd2bf3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:59.767275 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e904d-48c3-4d93-9866-3aaa5bd2bf3d service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:59.781488 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 688/1382] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:24:59.782837 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d00cec-82e1-4984-8d2a-ff2c2609244e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:59.802176 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 695/1383] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:24:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:24:59.804392 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e904d-48c3-4d93-9866-3aaa5bd2bf3d service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:59.808425 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:59.817736 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d00cec-82e1-4984-8d2a-ff2c2609244e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:59.835104 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a99ef-f4d1-47b4-8026-ec1185c9a9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:59.835710 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a99ef-f4d1-47b4-8026-ec1185c9a9ec admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:59.836051 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a99ef-f4d1-47b4-8026-ec1185c9a9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:59.836300 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a99ef-f4d1-47b4-8026-ec1185c9a9ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:59.836993 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a99ef-f4d1-47b4-8026-ec1185c9a9ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:59.839150 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a99ef-f4d1-47b4-8026-ec1185c9a9ec admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:59.841241 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e904d-48c3-4d93-9866-3aaa5bd2bf3d service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:24:59.852604 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb08c9-08ef-4fd8-be07-d28f139b649b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:24:59.853557 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb08c9-08ef-4fd8-be07-d28f139b649b admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:24:59.855141 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb08c9-08ef-4fd8-be07-d28f139b649b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:24:59.855520 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb08c9-08ef-4fd8-be07-d28f139b649b admin admin] PATH_INFO: `/v3/projects/ddf73f02ae744aabb8eadedb8d91b9d5/users/761816892f8a452fafe07e7aba965913/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:24:59.898463 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb08c9-08ef-4fd8-be07-d28f139b649b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddf73f02ae744aabb8eadedb8d91b9d5, user_id=761816892f8a452fafe07e7aba965913, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:24:59.901822 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb08c9-08ef-4fd8-be07-d28f139b649b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:24:59.915284 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 689/1384] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:24:59 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:24:59.915284 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a99ef-f4d1-47b4-8026-ec1185c9a9ec admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:59.946558 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 696/1385] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:24:59 2022] PUT /identity/v3/projects/ddf73f02ae744aabb8eadedb8d91b9d5/users/761816892f8a452fafe07e7aba965913/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:24:59.947599 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb08c9-08ef-4fd8-be07-d28f139b649b admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:24:59.952618 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6ceb08c9-08ef-4fd8-be07-d28f139b649b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:00.105379 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a99ef-f4d1-47b4-8026-ec1185c9a9ec admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:00.112199 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb08c9-08ef-4fd8-be07-d28f139b649b admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:00.122407 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563c804-fbb6-4807-b2fe-79790b7993c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:00.123491 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563c804-fbb6-4807-b2fe-79790b7993c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:00.124001 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563c804-fbb6-4807-b2fe-79790b7993c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:00.124486 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563c804-fbb6-4807-b2fe-79790b7993c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:00.130360 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4bc885-d0db-4737-b217-189277af7b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:00.131145 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bc885-d0db-4737-b217-189277af7b78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:00.131857 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bc885-d0db-4737-b217-189277af7b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:00.132123 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563c804-fbb6-4807-b2fe-79790b7993c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:00.132295 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bc885-d0db-4737-b217-189277af7b78 admin admin] PATH_INFO: `/v3/projects/82efd2ad21ba497190ce8f4fb1dbd7c4` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:00.133750 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4bc885-d0db-4737-b217-189277af7b78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82efd2ad21ba497190ce8f4fb1dbd7c4)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:00.135970 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4bc885-d0db-4737-b217-189277af7b78 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:00.143171 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563c804-fbb6-4807-b2fe-79790b7993c4 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:00.182291 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 690/1386] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:00.183430 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563c804-fbb6-4807-b2fe-79790b7993c4 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:00.207253 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563c804-fbb6-4807-b2fe-79790b7993c4 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:00.225073 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df9559-0279-49b7-bca5-17f2910c0fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:00.225802 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df9559-0279-49b7-bca5-17f2910c0fba admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:00.226184 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df9559-0279-49b7-bca5-17f2910c0fba admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:00.226563 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df9559-0279-49b7-bca5-17f2910c0fba admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:00.227392 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df9559-0279-49b7-bca5-17f2910c0fba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:00.229722 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df9559-0279-49b7-bca5-17f2910c0fba admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:00.278221 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 691/1387] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:25:00 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:00.279679 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348351d2-57a3-488a-9243-e79f687bcf67 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:00.282410 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348351d2-57a3-488a-9243-e79f687bcf67 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:00.282815 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348351d2-57a3-488a-9243-e79f687bcf67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:00.283605 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-bb4bc885-d0db-4737-b217-189277af7b78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82efd2ad21ba497190ce8f4fb1dbd7c4', 'request_id': 'req-bb4bc885-d0db-4737-b217-189277af7b78'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:00.295281 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:00.315965 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-bb4bc885-d0db-4737-b217-189277af7b78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82efd2ad21ba497190ce8f4fb1dbd7c4', 'request_id': 'req-bb4bc885-d0db-4737-b217-189277af7b78'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:00.332764 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-bb4bc885-d0db-4737-b217-189277af7b78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82efd2ad21ba497190ce8f4fb1dbd7c4', 'request_id': 'req-bb4bc885-d0db-4737-b217-189277af7b78'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:00.390607 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-bb4bc885-d0db-4737-b217-189277af7b78 admin admin] The token cache is being invalidate because project 82efd2ad21ba497190ce8f4fb1dbd7c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:25:00.391387 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-bb4bc885-d0db-4737-b217-189277af7b78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:00.397876 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-348351d2-57a3-488a-9243-e79f687bcf67 None None] MFA Rules not processed for user `761816892f8a452fafe07e7aba965913`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:00.399412 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-348351d2-57a3-488a-9243-e79f687bcf67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:00.403532 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-bb4bc885-d0db-4737-b217-189277af7b78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:00.415533 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 697/1388] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:24:59 2022] DELETE /identity/v3/projects/82efd2ad21ba497190ce8f4fb1dbd7c4 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:00.416776 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4bc885-d0db-4737-b217-189277af7b78 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:00.424326 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-bb4bc885-d0db-4737-b217-189277af7b78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:00.742816 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4bc885-d0db-4737-b217-189277af7b78 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:00.779160 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 692/1389] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 500 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:00.786231 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515a92e-0ed9-4c29-826f-653f9182908a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:00.787111 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348351d2-57a3-488a-9243-e79f687bcf67 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:00.787237 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515a92e-0ed9-4c29-826f-653f9182908a admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:00.787439 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515a92e-0ed9-4c29-826f-653f9182908a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:00.787686 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515a92e-0ed9-4c29-826f-653f9182908a admin admin] PATH_INFO: `/v3/projects/1468af9337a44adb9ac2637833e95c8a/users/3fc912f00741464287202a6b4fbbe78f/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:00.806102 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-348351d2-57a3-488a-9243-e79f687bcf67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:00.855805 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515a92e-0ed9-4c29-826f-653f9182908a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1468af9337a44adb9ac2637833e95c8a, user_id=3fc912f00741464287202a6b4fbbe78f, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:00.858916 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515a92e-0ed9-4c29-826f-653f9182908a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:00.888528 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348351d2-57a3-488a-9243-e79f687bcf67 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:00.922716 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd21c4-3272-4b28-b086-55f1eec16912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:00.923650 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 698/1390] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:00 2022] PUT /identity/v3/projects/1468af9337a44adb9ac2637833e95c8a/users/3fc912f00741464287202a6b4fbbe78f/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:00.927083 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd21c4-3272-4b28-b086-55f1eec16912 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:00.927083 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd21c4-3272-4b28-b086-55f1eec16912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:00.935438 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28b21b-6bf1-401a-b2f3-70edada24909 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:00.935899 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd21c4-3272-4b28-b086-55f1eec16912 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:00.937406 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dd21c4-3272-4b28-b086-55f1eec16912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:00.938235 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28b21b-6bf1-401a-b2f3-70edada24909 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:00.938515 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28b21b-6bf1-401a-b2f3-70edada24909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:00.943849 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dd21c4-3272-4b28-b086-55f1eec16912 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:00.995477 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 693/1391] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:00 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:00.999481 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd21c4-3272-4b28-b086-55f1eec16912 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:01.008460 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c9dd21c4-3272-4b28-b086-55f1eec16912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:01.032394 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-0d28b21b-6bf1-401a-b2f3-70edada24909 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:01.033731 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0d28b21b-6bf1-401a-b2f3-70edada24909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:01.067021 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd21c4-3272-4b28-b086-55f1eec16912 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:01.197165 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:01.287401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c2c2c-a5b2-4548-a3f7-56ae17692600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:01.288535 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c2c2c-a5b2-4548-a3f7-56ae17692600 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:01.289125 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c2c2c-a5b2-4548-a3f7-56ae17692600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:01.290066 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c2c2c-a5b2-4548-a3f7-56ae17692600 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:01.291169 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c2c2c-a5b2-4548-a3f7-56ae17692600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:01.293704 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c2c2c-a5b2-4548-a3f7-56ae17692600 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:01.343188 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 699/1392] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:01.353297 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32b688-15c2-475d-80a0-2d21d2b1d4b9 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:01.354144 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32b688-15c2-475d-80a0-2d21d2b1d4b9 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:01.354436 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32b688-15c2-475d-80a0-2d21d2b1d4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:01.423963 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 694/1393] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:25:00 2022] POST /identity/v3/projects => generated 377 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:01.435431 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c2c2c-a5b2-4548-a3f7-56ae17692600 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:01.451849 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-3b32b688-15c2-475d-80a0-2d21d2b1d4b9 None None] MFA Rules not processed for user `3fc912f00741464287202a6b4fbbe78f`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:01.454335 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3b32b688-15c2-475d-80a0-2d21d2b1d4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:01.589442 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:01.657746 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 700/1394] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:01 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:01.662303 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf6a80-40e1-4694-b83a-8221ccb408d2 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:01.663436 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf6a80-40e1-4694-b83a-8221ccb408d2 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:01.664185 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf6a80-40e1-4694-b83a-8221ccb408d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:01.670313 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c2c2c-a5b2-4548-a3f7-56ae17692600 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:01.697393 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808a226-ef89-4b90-9a5d-f1030180c277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:01.698094 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808a226-ef89-4b90-9a5d-f1030180c277 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:01.706981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808a226-ef89-4b90-9a5d-f1030180c277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:01.707301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808a226-ef89-4b90-9a5d-f1030180c277 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:01.708027 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1808a226-ef89-4b90-9a5d-f1030180c277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:01.715084 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1808a226-ef89-4b90-9a5d-f1030180c277 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:01.730836 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-5bcf6a80-40e1-4694-b83a-8221ccb408d2 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:01.734296 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5bcf6a80-40e1-4694-b83a-8221ccb408d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:01.754184 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 695/1395] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:01 2022] GET /identity/v3/roles => generated 1420 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:01.760693 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 701/1396] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:01.762145 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf6a80-40e1-4694-b83a-8221ccb408d2 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:01.763732 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808a226-ef89-4b90-9a5d-f1030180c277 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:01.795156 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf6a80-40e1-4694-b83a-8221ccb408d2 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:01.800403 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808a226-ef89-4b90-9a5d-f1030180c277 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:01.809109 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52785a35-7941-474c-a244-1181a919f1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:01.812208 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52785a35-7941-474c-a244-1181a919f1fb admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:01.812595 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52785a35-7941-474c-a244-1181a919f1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:01.812906 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52785a35-7941-474c-a244-1181a919f1fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:01.814061 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52785a35-7941-474c-a244-1181a919f1fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:01.816153 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52785a35-7941-474c-a244-1181a919f1fb admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:01.819849 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3419a-c968-46e3-9884-c0779a9582cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:01.820869 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3419a-c968-46e3-9884-c0779a9582cc admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:01.821158 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3419a-c968-46e3-9884-c0779a9582cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:01.821464 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3419a-c968-46e3-9884-c0779a9582cc admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:01.824585 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc3419a-c968-46e3-9884-c0779a9582cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:01.826547 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc3419a-c968-46e3-9884-c0779a9582cc admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:01.891724 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 696/1397] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:25:01 2022] POST /identity/v3/users => generated 295 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:01.891724 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3419a-c968-46e3-9884-c0779a9582cc admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:01.898657 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 702/1398] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:25:01 2022] POST /identity/v3/projects => generated 355 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:01.902036 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52785a35-7941-474c-a244-1181a919f1fb admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:01.926468 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3419a-c968-46e3-9884-c0779a9582cc admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:02.077820 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52785a35-7941-474c-a244-1181a919f1fb admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:02.095086 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ffca8-fd42-4a3a-a417-204410a863cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:02.095311 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607513ea-78cf-4e77-a3c2-0887e6e02003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:02.095771 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ffca8-fd42-4a3a-a417-204410a863cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:02.096106 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ffca8-fd42-4a3a-a417-204410a863cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:02.096428 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ffca8-fd42-4a3a-a417-204410a863cc admin admin] PATH_INFO: `/v3/projects/2e1239ed426f417f8388ab76879dd4f6/users/7d71ada5c250432aac178a0575aea608/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:02.099344 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607513ea-78cf-4e77-a3c2-0887e6e02003 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:02.100989 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607513ea-78cf-4e77-a3c2-0887e6e02003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:02.101292 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607513ea-78cf-4e77-a3c2-0887e6e02003 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:02.104312 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607513ea-78cf-4e77-a3c2-0887e6e02003 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:25:02.105985 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607513ea-78cf-4e77-a3c2-0887e6e02003 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:02.107850 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607513ea-78cf-4e77-a3c2-0887e6e02003 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:02.132171 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224ffca8-fd42-4a3a-a417-204410a863cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e1239ed426f417f8388ab76879dd4f6, user_id=7d71ada5c250432aac178a0575aea608, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:02.135295 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224ffca8-fd42-4a3a-a417-204410a863cc admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:02.146427 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 703/1399] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:25:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:25:02.149915 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607513ea-78cf-4e77-a3c2-0887e6e02003 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:02.165369 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 697/1400] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:01 2022] PUT /identity/v3/projects/2e1239ed426f417f8388ab76879dd4f6/users/7d71ada5c250432aac178a0575aea608/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:02.166670 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ffca8-fd42-4a3a-a417-204410a863cc admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:02.183956 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607513ea-78cf-4e77-a3c2-0887e6e02003 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:02.316216 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:02.399773 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd02ddc-b4e5-444a-a25f-d595fab6b309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:02.399773 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd02ddc-b4e5-444a-a25f-d595fab6b309 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:02.399773 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd02ddc-b4e5-444a-a25f-d595fab6b309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:02.399773 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd02ddc-b4e5-444a-a25f-d595fab6b309 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:02.400161 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd02ddc-b4e5-444a-a25f-d595fab6b309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:02.413544 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd02ddc-b4e5-444a-a25f-d595fab6b309 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:02.458592 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 704/1401] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:02.459595 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd02ddc-b4e5-444a-a25f-d595fab6b309 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:02.501464 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ffca8-fd42-4a3a-a417-204410a863cc admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:02.518592 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd02ddc-b4e5-444a-a25f-d595fab6b309 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:02.520977 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f596b7-ca9f-46ed-a6f2-f5882088ef73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:02.522090 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f596b7-ca9f-46ed-a6f2-f5882088ef73 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:02.522381 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f596b7-ca9f-46ed-a6f2-f5882088ef73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:02.522904 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f596b7-ca9f-46ed-a6f2-f5882088ef73 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:02.523573 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f596b7-ca9f-46ed-a6f2-f5882088ef73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:02.525776 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f596b7-ca9f-46ed-a6f2-f5882088ef73 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:02.536562 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc897f-e405-4578-861d-dc2a4712f2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:02.541130 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc897f-e405-4578-861d-dc2a4712f2ac admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:02.541975 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc897f-e405-4578-861d-dc2a4712f2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:02.544032 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc897f-e405-4578-861d-dc2a4712f2ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:02.548921 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc897f-e405-4578-861d-dc2a4712f2ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:02.569613 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc897f-e405-4578-861d-dc2a4712f2ac admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:02.589286 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 698/1402] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:25:02 2022] POST /identity/v3/users => generated 284 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:02.590841 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a06d7-f588-4481-9ac6-e29fd174ebbd None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:02.591123 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a06d7-f588-4481-9ac6-e29fd174ebbd None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:02.591404 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a06d7-f588-4481-9ac6-e29fd174ebbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:02.627511 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 705/1403] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:25:02 2022] POST /identity/v3/projects => generated 405 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:02.634040 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc897f-e405-4578-861d-dc2a4712f2ac admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:02.711955 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-831a06d7-f588-4481-9ac6-e29fd174ebbd None None] MFA Rules not processed for user `7d71ada5c250432aac178a0575aea608`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:02.713524 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-831a06d7-f588-4481-9ac6-e29fd174ebbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:02.752582 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:02.871217 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc897f-e405-4578-861d-dc2a4712f2ac admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:02.882738 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9540693-d7c1-40f7-90d8-6363fa3c122b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:02.883991 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9540693-d7c1-40f7-90d8-6363fa3c122b admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:02.884883 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9540693-d7c1-40f7-90d8-6363fa3c122b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:02.885732 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9540693-d7c1-40f7-90d8-6363fa3c122b admin admin] PATH_INFO: `/v3/projects/ed6b28b5fc414d79b0c8d70111f3a170/users/6d410da838a7449b96b6dc3de76da2e9/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:02.981156 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9540693-d7c1-40f7-90d8-6363fa3c122b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed6b28b5fc414d79b0c8d70111f3a170, user_id=6d410da838a7449b96b6dc3de76da2e9, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:02.993705 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9540693-d7c1-40f7-90d8-6363fa3c122b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:03.023241 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 699/1404] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 433 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:03.024980 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff099d-384d-4e99-b86c-9f26cac8b365 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:03.027282 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff099d-384d-4e99-b86c-9f26cac8b365 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:03.027796 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff099d-384d-4e99-b86c-9f26cac8b365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:03.044085 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 706/1405] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:02 2022] PUT /identity/v3/projects/ed6b28b5fc414d79b0c8d70111f3a170/users/6d410da838a7449b96b6dc3de76da2e9/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:03.047401 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f083296-861d-4f75-81d2-0e20d25dcce3 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:03.048311 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f083296-861d-4f75-81d2-0e20d25dcce3 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:03.049496 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f083296-861d-4f75-81d2-0e20d25dcce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:03.113973 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-8f083296-861d-4f75-81d2-0e20d25dcce3 None None] MFA Rules not processed for user `041ffe6cdf2d42008f41858ebe015be8`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:03.116738 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8f083296-861d-4f75-81d2-0e20d25dcce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:03.118047 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-09ff099d-384d-4e99-b86c-9f26cac8b365 None None] MFA Rules not processed for user `946833c2a74f46528ec7c12cfef4e1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:03.120197 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-09ff099d-384d-4e99-b86c-9f26cac8b365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:03.358499 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 707/1406] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:03.360037 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f083296-861d-4f75-81d2-0e20d25dcce3 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:03.414319 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 700/1407] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:03.415243 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff099d-384d-4e99-b86c-9f26cac8b365 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:03.543373 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:03.597459 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f083296-861d-4f75-81d2-0e20d25dcce3 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:03.608122 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5232298-9da7-48f1-8fdb-2ca31bd21aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:03.627011 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5232298-9da7-48f1-8fdb-2ca31bd21aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:03.627345 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5232298-9da7-48f1-8fdb-2ca31bd21aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:03.627873 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5232298-9da7-48f1-8fdb-2ca31bd21aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:03.630527 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff099d-384d-4e99-b86c-9f26cac8b365 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:03.632808 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5232298-9da7-48f1-8fdb-2ca31bd21aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:03.637978 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab80f6-d803-4820-afb1-0ac7de874d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:03.638958 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab80f6-d803-4820-afb1-0ac7de874d23 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:03.639264 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab80f6-d803-4820-afb1-0ac7de874d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:03.639718 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab80f6-d803-4820-afb1-0ac7de874d23 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:03.640390 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab80f6-d803-4820-afb1-0ac7de874d23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:03.641515 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5232298-9da7-48f1-8fdb-2ca31bd21aa2 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:03.643193 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab80f6-d803-4820-afb1-0ac7de874d23 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:03.690074 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 708/1408] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:03.691380 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5232298-9da7-48f1-8fdb-2ca31bd21aa2 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:03.704679 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 701/1409] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:25:03 2022] POST /identity/v3/users => generated 303 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:03.708068 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab80f6-d803-4820-afb1-0ac7de874d23 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:03.717253 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5232298-9da7-48f1-8fdb-2ca31bd21aa2 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:03.746072 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab80f6-d803-4820-afb1-0ac7de874d23 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:03.757199 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f04324-a3f7-42c4-900f-77422be3611d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:03.760216 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcdd8d4-a6e8-4ca8-8307-1b0138731d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:03.761641 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f04324-a3f7-42c4-900f-77422be3611d admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:03.761935 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f04324-a3f7-42c4-900f-77422be3611d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:03.762699 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdd8d4-a6e8-4ca8-8307-1b0138731d30 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:03.762986 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdd8d4-a6e8-4ca8-8307-1b0138731d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:03.764179 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdd8d4-a6e8-4ca8-8307-1b0138731d30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:03.765599 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f04324-a3f7-42c4-900f-77422be3611d admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:03.766423 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcdd8d4-a6e8-4ca8-8307-1b0138731d30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:03.766536 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f04324-a3f7-42c4-900f-77422be3611d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:03.768119 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcdd8d4-a6e8-4ca8-8307-1b0138731d30 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:03.774795 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f04324-a3f7-42c4-900f-77422be3611d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:03.827706 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 702/1410] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:03.827706 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bff504-0fad-4003-a695-430aeb68ce2b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:03.827706 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bff504-0fad-4003-a695-430aeb68ce2b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:03.827706 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bff504-0fad-4003-a695-430aeb68ce2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:03.843979 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 709/1411] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:25:03 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:03.845072 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f04324-a3f7-42c4-900f-77422be3611d admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:03.850516 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-89f04324-a3f7-42c4-900f-77422be3611d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:03.888525 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-39bff504-0fad-4003-a695-430aeb68ce2b None None] MFA Rules not processed for user `041ffe6cdf2d42008f41858ebe015be8`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:03.890077 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-39bff504-0fad-4003-a695-430aeb68ce2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:03.894929 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:04.017205 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 703/1412] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:04.024772 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bff504-0fad-4003-a695-430aeb68ce2b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:04.071093 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f04324-a3f7-42c4-900f-77422be3611d admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:04.096506 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049fbcab-bf56-4e7e-a086-1a3b9d31e727 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719e4bf834d6490b96066e55a26fb159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:04.099023 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fbcab-bf56-4e7e-a086-1a3b9d31e727 service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:04.100006 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fbcab-bf56-4e7e-a086-1a3b9d31e727 service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:04.100531 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fbcab-bf56-4e7e-a086-1a3b9d31e727 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:04.173733 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bff504-0fad-4003-a695-430aeb68ce2b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:04.181160 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f94b910-d329-49ce-9ba0-6e9b80194316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:04.182295 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94b910-d329-49ce-9ba0-6e9b80194316 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:04.182754 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94b910-d329-49ce-9ba0-6e9b80194316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:04.183200 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94b910-d329-49ce-9ba0-6e9b80194316 admin admin] PATH_INFO: `/v3/projects/2cd4d437accb49188cf6667526dcbe84/users/10402c04b94843c099ba662402f2373e/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:04.204573 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f94b910-d329-49ce-9ba0-6e9b80194316 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cd4d437accb49188cf6667526dcbe84, user_id=10402c04b94843c099ba662402f2373e, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:04.209400 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f94b910-d329-49ce-9ba0-6e9b80194316 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:04.244416 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 704/1413] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:04 2022] PUT /identity/v3/projects/2cd4d437accb49188cf6667526dcbe84/users/10402c04b94843c099ba662402f2373e/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:04.246396 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f94b910-d329-49ce-9ba0-6e9b80194316 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:04.282886 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049fbcab-bf56-4e7e-a086-1a3b9d31e727 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:04.286039 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049fbcab-bf56-4e7e-a086-1a3b9d31e727 service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:04.309277 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 710/1414] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:25:04.315251 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049fbcab-bf56-4e7e-a086-1a3b9d31e727 service nova] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:04.326050 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:04.346129 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049fbcab-bf56-4e7e-a086-1a3b9d31e727 service nova] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:04.358472 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f94b910-d329-49ce-9ba0-6e9b80194316 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:04.370462 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d80539-3314-4b5c-860a-50b3ac95a535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:04.371407 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d80539-3314-4b5c-860a-50b3ac95a535 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:04.371864 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d80539-3314-4b5c-860a-50b3ac95a535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:04.372046 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949be60d-bb45-4e6f-a955-0fc5ab24f227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:04.372771 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949be60d-bb45-4e6f-a955-0fc5ab24f227 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:04.372992 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d80539-3314-4b5c-860a-50b3ac95a535 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:04.373075 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949be60d-bb45-4e6f-a955-0fc5ab24f227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:04.373323 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949be60d-bb45-4e6f-a955-0fc5ab24f227 admin admin] PATH_INFO: `/v3/projects/ed6b28b5fc414d79b0c8d70111f3a170/users/6d410da838a7449b96b6dc3de76da2e9/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:04.374752 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d80539-3314-4b5c-860a-50b3ac95a535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:04.377848 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d80539-3314-4b5c-860a-50b3ac95a535 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:04.383099 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949be60d-bb45-4e6f-a955-0fc5ab24f227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed6b28b5fc414d79b0c8d70111f3a170, user_id=6d410da838a7449b96b6dc3de76da2e9, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:04.397589 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949be60d-bb45-4e6f-a955-0fc5ab24f227 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:04.418665 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 705/1415] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:04.421622 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d80539-3314-4b5c-860a-50b3ac95a535 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:04.450606 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d80539-3314-4b5c-860a-50b3ac95a535 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:04.470504 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 711/1416] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:04 2022] PUT /identity/v3/projects/ed6b28b5fc414d79b0c8d70111f3a170/users/6d410da838a7449b96b6dc3de76da2e9/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:04.470504 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949be60d-bb45-4e6f-a955-0fc5ab24f227 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:04.475559 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-949be60d-bb45-4e6f-a955-0fc5ab24f227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:04.623835 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df0406-76a5-4525-89b2-cadb55060934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:04.624595 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df0406-76a5-4525-89b2-cadb55060934 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:04.624883 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df0406-76a5-4525-89b2-cadb55060934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:04.625176 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df0406-76a5-4525-89b2-cadb55060934 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:04.625919 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df0406-76a5-4525-89b2-cadb55060934 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:04.627897 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df0406-76a5-4525-89b2-cadb55060934 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:04.709346 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 706/1417] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:25:04 2022] POST /identity/v3/users => generated 299 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:04.711261 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df0406-76a5-4525-89b2-cadb55060934 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:04.729275 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949be60d-bb45-4e6f-a955-0fc5ab24f227 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:04.736198 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df0406-76a5-4525-89b2-cadb55060934 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:04.772412 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d5416-331c-4895-9471-340ca5b24782 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719e4bf834d6490b96066e55a26fb159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:04.773156 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d5416-331c-4895-9471-340ca5b24782 service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:04.773507 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d5416-331c-4895-9471-340ca5b24782 service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:04.778058 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d5416-331c-4895-9471-340ca5b24782 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:04.783083 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc1ece-b3cd-460d-87df-63c694dd4ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:04.783734 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc1ece-b3cd-460d-87df-63c694dd4ddd admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:04.784019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc1ece-b3cd-460d-87df-63c694dd4ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:04.784301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc1ece-b3cd-460d-87df-63c694dd4ddd admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:04.784982 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc1ece-b3cd-460d-87df-63c694dd4ddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:04.786867 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc1ece-b3cd-460d-87df-63c694dd4ddd admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:04.816106 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 707/1418] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:04.817182 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc1ece-b3cd-460d-87df-63c694dd4ddd admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:04.832180 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc1ece-b3cd-460d-87df-63c694dd4ddd admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:04.849484 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a16dff-5293-4e62-a9b5-8f06ecccd066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:04.850139 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a16dff-5293-4e62-a9b5-8f06ecccd066 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:04.850421 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a16dff-5293-4e62-a9b5-8f06ecccd066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:04.850706 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a16dff-5293-4e62-a9b5-8f06ecccd066 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:04.851449 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a16dff-5293-4e62-a9b5-8f06ecccd066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:04.864720 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a16dff-5293-4e62-a9b5-8f06ecccd066 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:04.865159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:04.900931 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 708/1419] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:04.904641 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6e7f9-7fc6-4814-84a5-7e628b72f907 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:04.904929 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6e7f9-7fc6-4814-84a5-7e628b72f907 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:04.906776 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6e7f9-7fc6-4814-84a5-7e628b72f907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:04.963251 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692d5416-331c-4895-9471-340ca5b24782 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:04.968138 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692d5416-331c-4895-9471-340ca5b24782 service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:04.978705 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-82a6e7f9-7fc6-4814-84a5-7e628b72f907 None None] MFA Rules not processed for user `6d410da838a7449b96b6dc3de76da2e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:04.981444 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-82a6e7f9-7fc6-4814-84a5-7e628b72f907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:04.992643 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 712/1420] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:25:04.993428 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d5416-331c-4895-9471-340ca5b24782 service nova] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:05.043156 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d5416-331c-4895-9471-340ca5b24782 service nova] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:05.064678 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f02031-f2c6-4443-9440-09af3273a337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:05.065318 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f02031-f2c6-4443-9440-09af3273a337 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:05.065620 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f02031-f2c6-4443-9440-09af3273a337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:05.072392 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f02031-f2c6-4443-9440-09af3273a337 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:05.080077 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f02031-f2c6-4443-9440-09af3273a337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:05.085765 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f02031-f2c6-4443-9440-09af3273a337 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:05.149158 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 713/1421] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:05.150241 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f02031-f2c6-4443-9440-09af3273a337 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:05.192746 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f02031-f2c6-4443-9440-09af3273a337 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:05.217246 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd89e1ec-2f6f-40e3-a976-2b39c78100ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:05.220049 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89e1ec-2f6f-40e3-a976-2b39c78100ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:05.220333 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89e1ec-2f6f-40e3-a976-2b39c78100ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:05.223352 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89e1ec-2f6f-40e3-a976-2b39c78100ae admin admin] PATH_INFO: `/v3/projects/2cd4d437accb49188cf6667526dcbe84/users/10402c04b94843c099ba662402f2373e/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:05.231979 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd89e1ec-2f6f-40e3-a976-2b39c78100ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cd4d437accb49188cf6667526dcbe84, user_id=10402c04b94843c099ba662402f2373e, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:05.238097 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd89e1ec-2f6f-40e3-a976-2b39c78100ae admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:05.257845 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 709/1422] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:04 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:05.259698 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6e7f9-7fc6-4814-84a5-7e628b72f907 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:05.272925 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6e7f9-7fc6-4814-84a5-7e628b72f907 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:05.291682 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 714/1423] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:05 2022] PUT /identity/v3/projects/2cd4d437accb49188cf6667526dcbe84/users/10402c04b94843c099ba662402f2373e/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:05.293343 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401db850-e5ea-4914-bcf6-33c636ff423d None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:05.294611 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401db850-e5ea-4914-bcf6-33c636ff423d None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:05.297771 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401db850-e5ea-4914-bcf6-33c636ff423d None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:05.301215 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 715/1424] 10.222.0.52 () {54 vars in 921 bytes} [Thu Oct 27 13:25:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:25:05.303960 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401db850-e5ea-4914-bcf6-33c636ff423d None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:05.362541 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:05.456514 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91f3a2-87f8-411a-a999-71bc3fc6b272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:05.457405 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91f3a2-87f8-411a-a999-71bc3fc6b272 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:05.457805 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91f3a2-87f8-411a-a999-71bc3fc6b272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:05.458185 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91f3a2-87f8-411a-a999-71bc3fc6b272 admin admin] PATH_INFO: `/v3/projects/fec7b27e94f845e4993f373f16685fb0/users/faded9f309524dd18620c73fce1b6e1e/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:05.475091 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401db850-e5ea-4914-bcf6-33c636ff423d None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:05.494645 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de91f3a2-87f8-411a-a999-71bc3fc6b272 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fec7b27e94f845e4993f373f16685fb0, user_id=faded9f309524dd18620c73fce1b6e1e, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:05.499990 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de91f3a2-87f8-411a-a999-71bc3fc6b272 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:05.501386 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c577a9-a84e-4f02-bb47-a59ef76fa533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:05.503724 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c577a9-a84e-4f02-bb47-a59ef76fa533 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:05.504844 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c577a9-a84e-4f02-bb47-a59ef76fa533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:05.506225 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c577a9-a84e-4f02-bb47-a59ef76fa533 admin admin] PATH_INFO: `/v3/projects/d4d84c3433a445998b8892b9e816efb4/users/fc794c7de88c48aeb3366bb0e0a47b6e/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:05.528440 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 710/1425] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:05 2022] PUT /identity/v3/projects/fec7b27e94f845e4993f373f16685fb0/users/faded9f309524dd18620c73fce1b6e1e/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:05.529005 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91f3a2-87f8-411a-a999-71bc3fc6b272 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:05.531257 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c577a9-a84e-4f02-bb47-a59ef76fa533 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4d84c3433a445998b8892b9e816efb4, user_id=fc794c7de88c48aeb3366bb0e0a47b6e, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:05.534990 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c577a9-a84e-4f02-bb47-a59ef76fa533 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:05.535142 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-de91f3a2-87f8-411a-a999-71bc3fc6b272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:05.576795 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 716/1426] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:05 2022] PUT /identity/v3/projects/d4d84c3433a445998b8892b9e816efb4/users/fc794c7de88c48aeb3366bb0e0a47b6e/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:05.577648 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66044d40-2102-4976-9ca0-d48e2dc8db24 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:05.578756 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66044d40-2102-4976-9ca0-d48e2dc8db24 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:05.579030 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66044d40-2102-4976-9ca0-d48e2dc8db24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:05.656506 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-66044d40-2102-4976-9ca0-d48e2dc8db24 None None] MFA Rules not processed for user `10402c04b94843c099ba662402f2373e`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:05.658579 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-66044d40-2102-4976-9ca0-d48e2dc8db24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:05.702011 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91f3a2-87f8-411a-a999-71bc3fc6b272 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:05.842377 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed2f62-25f0-403c-a598-2a3ebb19f508 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:05.843399 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed2f62-25f0-403c-a598-2a3ebb19f508 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:05.844064 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed2f62-25f0-403c-a598-2a3ebb19f508 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:05.844739 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed2f62-25f0-403c-a598-2a3ebb19f508 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:05.933577 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 717/1427] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:05 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:05.935435 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf2ef9-bc90-48b1-bcdb-8416b8f8e61c None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:05.935820 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf2ef9-bc90-48b1-bcdb-8416b8f8e61c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:05.936335 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf2ef9-bc90-48b1-bcdb-8416b8f8e61c None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:05.937810 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 718/1428] 10.222.0.52 () {54 vars in 921 bytes} [Thu Oct 27 13:25:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:25:05.941389 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8223bc8-ba2b-4bfa-a5d5-ba356d5e81cb None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:05.941802 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8223bc8-ba2b-4bfa-a5d5-ba356d5e81cb None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:05.942177 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8223bc8-ba2b-4bfa-a5d5-ba356d5e81cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:05.999231 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-b8223bc8-ba2b-4bfa-a5d5-ba356d5e81cb None None] MFA Rules not processed for user `719e4bf834d6490b96066e55a26fb159`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:06.003146 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b8223bc8-ba2b-4bfa-a5d5-ba356d5e81cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:06.042935 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:06.054675 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed2f62-25f0-403c-a598-2a3ebb19f508 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:06.066320 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed2f62-25f0-403c-a598-2a3ebb19f508 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:06.089231 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 711/1429] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:05 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:25:06.091314 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e121e-60e3-436e-8dc6-9eee25b7c525 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:06.092646 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e121e-60e3-436e-8dc6-9eee25b7c525 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:06.094873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e121e-60e3-436e-8dc6-9eee25b7c525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:06.198518 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-264e121e-60e3-436e-8dc6-9eee25b7c525 None None] MFA Rules not processed for user `faded9f309524dd18620c73fce1b6e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:06.199823 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-264e121e-60e3-436e-8dc6-9eee25b7c525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:06.208888 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 719/1430] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Oct 27 13:25:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:06.210211 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8223bc8-ba2b-4bfa-a5d5-ba356d5e81cb None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:06.222144 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:06.383824 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 712/1431] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:06 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:06.384714 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e121e-60e3-436e-8dc6-9eee25b7c525 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:06.394502 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-264e121e-60e3-436e-8dc6-9eee25b7c525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:06.438196 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8223bc8-ba2b-4bfa-a5d5-ba356d5e81cb None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:06.454432 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ef252-8355-44a9-bf10-42c522ed9829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:06.455217 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ef252-8355-44a9-bf10-42c522ed9829 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:06.455567 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ef252-8355-44a9-bf10-42c522ed9829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:06.455917 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ef252-8355-44a9-bf10-42c522ed9829 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:06.456662 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ef252-8355-44a9-bf10-42c522ed9829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:06.458732 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ef252-8355-44a9-bf10-42c522ed9829 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:06.461740 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e121e-60e3-436e-8dc6-9eee25b7c525 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:06.478427 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276af4cd-7771-474f-aae8-95ac46114647 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:06.479451 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276af4cd-7771-474f-aae8-95ac46114647 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:06.482453 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276af4cd-7771-474f-aae8-95ac46114647 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:06.483107 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276af4cd-7771-474f-aae8-95ac46114647 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:06.489496 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 720/1432] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:06.489637 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522338e-d2f9-4163-9121-4645658edef8 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:06.490033 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522338e-d2f9-4163-9121-4645658edef8 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:06.490457 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522338e-d2f9-4163-9121-4645658edef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:06.538186 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276af4cd-7771-474f-aae8-95ac46114647 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:06.546695 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276af4cd-7771-474f-aae8-95ac46114647 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:06.558278 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-7522338e-d2f9-4163-9121-4645658edef8 None None] MFA Rules not processed for user `719e4bf834d6490b96066e55a26fb159`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:06.563750 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7522338e-d2f9-4163-9121-4645658edef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:06.591543 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 713/1433] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:06 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:25:06.592670 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276af4cd-7771-474f-aae8-95ac46114647 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:06.607977 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 721/1434] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Oct 27 13:25:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:06.608891 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7522338e-d2f9-4163-9121-4645658edef8 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:06.638541 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276af4cd-7771-474f-aae8-95ac46114647 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:06.645945 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7522338e-d2f9-4163-9121-4645658edef8 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:06.656238 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4511ad5-2ec8-49b7-8810-4812d375f250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:06.659197 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4511ad5-2ec8-49b7-8810-4812d375f250 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:06.661300 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4511ad5-2ec8-49b7-8810-4812d375f250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:06.663764 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4511ad5-2ec8-49b7-8810-4812d375f250 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:06.664482 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4511ad5-2ec8-49b7-8810-4812d375f250 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:06.669245 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4511ad5-2ec8-49b7-8810-4812d375f250 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:06.676323 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801174ae-7794-4e19-84e3-6ca5799390cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:06.677227 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801174ae-7794-4e19-84e3-6ca5799390cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:06.677560 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801174ae-7794-4e19-84e3-6ca5799390cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:06.678040 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801174ae-7794-4e19-84e3-6ca5799390cb admin admin] PATH_INFO: `/v3/projects/d4d84c3433a445998b8892b9e816efb4/users/fc794c7de88c48aeb3366bb0e0a47b6e/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:06.686950 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801174ae-7794-4e19-84e3-6ca5799390cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4d84c3433a445998b8892b9e816efb4, user_id=fc794c7de88c48aeb3366bb0e0a47b6e, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:06.695651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801174ae-7794-4e19-84e3-6ca5799390cb admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:06.750043 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 722/1435] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:06 2022] PUT /identity/v3/projects/d4d84c3433a445998b8892b9e816efb4/users/fc794c7de88c48aeb3366bb0e0a47b6e/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:06.757633 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e452e-199c-4283-aa2c-380f9c53ea6f None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:06.757937 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e452e-199c-4283-aa2c-380f9c53ea6f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:06.764478 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e452e-199c-4283-aa2c-380f9c53ea6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:06.780904 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 714/1436] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:25:06 2022] POST /identity/v3/projects => generated 405 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:06.785368 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4511ad5-2ec8-49b7-8810-4812d375f250 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:06.895968 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-788e452e-199c-4283-aa2c-380f9c53ea6f None None] MFA Rules not processed for user `fc794c7de88c48aeb3366bb0e0a47b6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:06.897689 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-788e452e-199c-4283-aa2c-380f9c53ea6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:06.963651 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4511ad5-2ec8-49b7-8810-4812d375f250 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:06.992503 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca5411-6e35-403c-ba68-222819e44ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:06.993591 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca5411-6e35-403c-ba68-222819e44ab3 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:06.993932 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca5411-6e35-403c-ba68-222819e44ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:06.994364 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca5411-6e35-403c-ba68-222819e44ab3 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:06.995158 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca5411-6e35-403c-ba68-222819e44ab3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:06.997513 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca5411-6e35-403c-ba68-222819e44ab3 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:07.069988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 715/1437] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:25:06 2022] POST /identity/v3/users => generated 309 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:25:07.078133 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca5411-6e35-403c-ba68-222819e44ab3 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:07.233555 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca5411-6e35-403c-ba68-222819e44ab3 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:07.248146 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e96c0-7612-4215-90e0-89f7193a1b9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:07.248146 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e96c0-7612-4215-90e0-89f7193a1b9f service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:07.248146 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e96c0-7612-4215-90e0-89f7193a1b9f service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:07.248146 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e96c0-7612-4215-90e0-89f7193a1b9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:07.248711 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 723/1438] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:06 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 491 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:07.248711 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e452e-199c-4283-aa2c-380f9c53ea6f None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:07.283153 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:07.294761 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:07.397232 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6e96c0-7612-4215-90e0-89f7193a1b9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:07.399023 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6e96c0-7612-4215-90e0-89f7193a1b9f service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:07.414691 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e452e-199c-4283-aa2c-380f9c53ea6f None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:07.427591 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 716/1439] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:07 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:25:07.428749 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e96c0-7612-4215-90e0-89f7193a1b9f service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:07.440768 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24872ef7-ce45-4752-947d-ea49452b0f02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719e4bf834d6490b96066e55a26fb159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:07.442646 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24872ef7-ce45-4752-947d-ea49452b0f02 service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:07.443041 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24872ef7-ce45-4752-947d-ea49452b0f02 service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:07.445208 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24872ef7-ce45-4752-947d-ea49452b0f02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:07.459419 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e96c0-7612-4215-90e0-89f7193a1b9f service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:07.470838 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5186af-a3bf-48bf-aa6e-40e76929dfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:07.472195 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5186af-a3bf-48bf-aa6e-40e76929dfc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:07.472676 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5186af-a3bf-48bf-aa6e-40e76929dfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:07.473135 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5186af-a3bf-48bf-aa6e-40e76929dfc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:07.474054 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5186af-a3bf-48bf-aa6e-40e76929dfc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:07.475902 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5186af-a3bf-48bf-aa6e-40e76929dfc2 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:07.479970 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24872ef7-ce45-4752-947d-ea49452b0f02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:07.481643 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24872ef7-ce45-4752-947d-ea49452b0f02 service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:07.509680 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 717/1440] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:07.511023 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5186af-a3bf-48bf-aa6e-40e76929dfc2 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:07.525406 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 724/1441] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:25:07.527381 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24872ef7-ce45-4752-947d-ea49452b0f02 service nova] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:07.539943 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5186af-a3bf-48bf-aa6e-40e76929dfc2 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:07.553664 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e122239-f9d7-4300-a2c1-bf11b1cb351c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:07.554500 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e122239-f9d7-4300-a2c1-bf11b1cb351c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:07.554978 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e122239-f9d7-4300-a2c1-bf11b1cb351c admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:07.555184 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e122239-f9d7-4300-a2c1-bf11b1cb351c admin admin] PATH_INFO: `/v3/users/761816892f8a452fafe07e7aba965913` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:07.556492 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e122239-f9d7-4300-a2c1-bf11b1cb351c admin admin] RBAC: Authorizing `identity:delete_user(user_id=761816892f8a452fafe07e7aba965913)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:07.558570 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e122239-f9d7-4300-a2c1-bf11b1cb351c admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:07.572130 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24872ef7-ce45-4752-947d-ea49452b0f02 service nova] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:07.581479 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101f8f7-4a28-4daf-99a7-0b7f300a4cb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:07.582902 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101f8f7-4a28-4daf-99a7-0b7f300a4cb0 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:07.583896 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101f8f7-4a28-4daf-99a7-0b7f300a4cb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:07.583896 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101f8f7-4a28-4daf-99a7-0b7f300a4cb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:07.607111 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1101f8f7-4a28-4daf-99a7-0b7f300a4cb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:07.608859 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1101f8f7-4a28-4daf-99a7-0b7f300a4cb0 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:07.635823 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 725/1442] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:07 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:25:07.653193 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101f8f7-4a28-4daf-99a7-0b7f300a4cb0 service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:07.698788 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101f8f7-4a28-4daf-99a7-0b7f300a4cb0 service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:07.716193 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216b4e4-159c-4a14-9fd5-8ad22571f94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:07.719066 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216b4e4-159c-4a14-9fd5-8ad22571f94a admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:07.719403 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216b4e4-159c-4a14-9fd5-8ad22571f94a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:07.719690 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216b4e4-159c-4a14-9fd5-8ad22571f94a admin admin] PATH_INFO: `/v3/projects/efb436b94c464c4dbaae96b03a977f42/users/63966b45186c47879d9ef665e57cdf5d/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:07.751046 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3e122239-f9d7-4300-a2c1-bf11b1cb351c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '761816892f8a452fafe07e7aba965913'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:07.758086 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3e122239-f9d7-4300-a2c1-bf11b1cb351c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '761816892f8a452fafe07e7aba965913'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:07.763664 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216b4e4-159c-4a14-9fd5-8ad22571f94a admin admin] RBAC: Authorizing `identity:create_grant(project_id=efb436b94c464c4dbaae96b03a977f42, user_id=63966b45186c47879d9ef665e57cdf5d, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:07.770216 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216b4e4-159c-4a14-9fd5-8ad22571f94a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:07.786118 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3e122239-f9d7-4300-a2c1-bf11b1cb351c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '761816892f8a452fafe07e7aba965913'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:07.838508 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3e122239-f9d7-4300-a2c1-bf11b1cb351c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '761816892f8a452fafe07e7aba965913'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:07.841720 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3e122239-f9d7-4300-a2c1-bf11b1cb351c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '761816892f8a452fafe07e7aba965913'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:07.842347 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 726/1443] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:07 2022] PUT /identity/v3/projects/efb436b94c464c4dbaae96b03a977f42/users/63966b45186c47879d9ef665e57cdf5d/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:07.843302 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216b4e4-159c-4a14-9fd5-8ad22571f94a admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:07.853284 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-9216b4e4-159c-4a14-9fd5-8ad22571f94a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:07.888567 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 718/1444] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:25:07 2022] DELETE /identity/v3/users/761816892f8a452fafe07e7aba965913 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:07.891480 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc4d4d-c29a-4b8a-b820-a85ea1c2f472 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:07.894004 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc4d4d-c29a-4b8a-b820-a85ea1c2f472 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:07.898641 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc4d4d-c29a-4b8a-b820-a85ea1c2f472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:07.983871 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e6bc4d4d-c29a-4b8a-b820-a85ea1c2f472 None None] MFA Rules not processed for user `6b715ce1b1b2441c968102cadb1dea50`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:07.985511 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e6bc4d4d-c29a-4b8a-b820-a85ea1c2f472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:08.106133 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216b4e4-159c-4a14-9fd5-8ad22571f94a admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:08.202513 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 719/1445] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:08.209921 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3eb187-fe76-4dfb-8cc5-22e73168b95b None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:08.215040 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3eb187-fe76-4dfb-8cc5-22e73168b95b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:08.218692 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3eb187-fe76-4dfb-8cc5-22e73168b95b None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:08.230469 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 720/1446] 10.222.0.52 () {54 vars in 912 bytes} [Thu Oct 27 13:25:08 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:25:08.231535 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3eb187-fe76-4dfb-8cc5-22e73168b95b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:08.238082 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1c3eb187-fe76-4dfb-8cc5-22e73168b95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:08.263496 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:08.326620 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192c816-efd6-4240-bcef-9b6da635bd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:08.328099 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192c816-efd6-4240-bcef-9b6da635bd3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:08.328522 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192c816-efd6-4240-bcef-9b6da635bd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:08.328982 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192c816-efd6-4240-bcef-9b6da635bd3c admin admin] PATH_INFO: `/v3/users/7d71ada5c250432aac178a0575aea608` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:08.332583 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7192c816-efd6-4240-bcef-9b6da635bd3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d71ada5c250432aac178a0575aea608)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:08.339151 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7192c816-efd6-4240-bcef-9b6da635bd3c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:08.404348 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:08.432177 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3eb187-fe76-4dfb-8cc5-22e73168b95b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:08.443620 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ccde56-d202-486f-ab9a-79d85285234b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:08.446735 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ccde56-d202-486f-ab9a-79d85285234b admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:08.447729 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ccde56-d202-486f-ab9a-79d85285234b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:08.448153 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ccde56-d202-486f-ab9a-79d85285234b admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:08.450912 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ccde56-d202-486f-ab9a-79d85285234b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:08.456706 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ccde56-d202-486f-ab9a-79d85285234b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:08.493575 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-7192c816-efd6-4240-bcef-9b6da635bd3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d71ada5c250432aac178a0575aea608'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:08.494247 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-7192c816-efd6-4240-bcef-9b6da635bd3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d71ada5c250432aac178a0575aea608'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:08.508310 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 721/1447] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:08.511516 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ccde56-d202-486f-ab9a-79d85285234b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:08.518624 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e6ccde56-d202-486f-ab9a-79d85285234b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:08.521744 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-7192c816-efd6-4240-bcef-9b6da635bd3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d71ada5c250432aac178a0575aea608'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:08.563487 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-7192c816-efd6-4240-bcef-9b6da635bd3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d71ada5c250432aac178a0575aea608'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:08.565035 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-7192c816-efd6-4240-bcef-9b6da635bd3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d71ada5c250432aac178a0575aea608'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:08.600714 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 727/1448] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:25:07 2022] DELETE /identity/v3/users/7d71ada5c250432aac178a0575aea608 => generated 0 bytes in 758 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:08.602419 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ec823-6c4d-4bb6-9087-2a63b15c0d5b None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:08.602817 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ec823-6c4d-4bb6-9087-2a63b15c0d5b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:08.603785 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ec823-6c4d-4bb6-9087-2a63b15c0d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:08.641972 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-a95ec823-6c4d-4bb6-9087-2a63b15c0d5b None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:08.646697 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a95ec823-6c4d-4bb6-9087-2a63b15c0d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:08.735141 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ccde56-d202-486f-ab9a-79d85285234b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:08.873855 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 728/1449] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:08.875432 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039f45a-6d4c-41c5-be4b-2d05d56d9ba7 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:08.877913 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039f45a-6d4c-41c5-be4b-2d05d56d9ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:08.879206 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039f45a-6d4c-41c5-be4b-2d05d56d9ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:08.906622 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-8039f45a-6d4c-41c5-be4b-2d05d56d9ba7 None None] MFA Rules not processed for user `d803f074332a4216aee8a38220faa10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:08.907990 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8039f45a-6d4c-41c5-be4b-2d05d56d9ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:08.937281 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a281e-4686-4c00-b989-b93f1d24362e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719e4bf834d6490b96066e55a26fb159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:08.938110 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a281e-4686-4c00-b989-b93f1d24362e service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:08.938483 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a281e-4686-4c00-b989-b93f1d24362e service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:08.938848 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a281e-4686-4c00-b989-b93f1d24362e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:08.940940 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ea7a281e-4686-4c00-b989-b93f1d24362e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:08.964180 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7a281e-4686-4c00-b989-b93f1d24362e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:08.967981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7a281e-4686-4c00-b989-b93f1d24362e service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:08.993659 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 722/1450] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:25:08.994195 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a281e-4686-4c00-b989-b93f1d24362e service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:08.998483 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ea7a281e-4686-4c00-b989-b93f1d24362e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:09.015339 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 729/1451] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Oct 27 13:25:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:09.016546 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0fec8-4818-4433-a80d-28a92678c6e6 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:09.016931 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0fec8-4818-4433-a80d-28a92678c6e6 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:09.017305 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0fec8-4818-4433-a80d-28a92678c6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:09.027812 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a281e-4686-4c00-b989-b93f1d24362e service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:09.041954 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9565726-ce5b-446c-b939-897525a19e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:09.043019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9565726-ce5b-446c-b939-897525a19e2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:09.043510 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9565726-ce5b-446c-b939-897525a19e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:09.043963 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9565726-ce5b-446c-b939-897525a19e2c admin admin] PATH_INFO: `/v3/projects/efb436b94c464c4dbaae96b03a977f42/users/63966b45186c47879d9ef665e57cdf5d/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:09.047823 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9565726-ce5b-446c-b939-897525a19e2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=efb436b94c464c4dbaae96b03a977f42, user_id=63966b45186c47879d9ef665e57cdf5d, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:09.050736 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9565726-ce5b-446c-b939-897525a19e2c admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:09.059335 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-d8e0fec8-4818-4433-a80d-28a92678c6e6 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:09.061052 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d8e0fec8-4818-4433-a80d-28a92678c6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:09.087795 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 723/1452] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:08 2022] PUT /identity/v3/projects/efb436b94c464c4dbaae96b03a977f42/users/63966b45186c47879d9ef665e57cdf5d/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:09.089084 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9565726-ce5b-446c-b939-897525a19e2c admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:09.094266 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c9565726-ce5b-446c-b939-897525a19e2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:09.133574 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:09.150193 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:09.207326 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 730/1453] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:09.207326 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6973d-2e86-4d59-a94c-bc186b4f9abe None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:09.207326 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6973d-2e86-4d59-a94c-bc186b4f9abe None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:09.207326 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6973d-2e86-4d59-a94c-bc186b4f9abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:09.255743 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9565726-ce5b-446c-b939-897525a19e2c admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:09.258311 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-52f6973d-2e86-4d59-a94c-bc186b4f9abe None None] MFA Rules not processed for user `63966b45186c47879d9ef665e57cdf5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:09.260355 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-52f6973d-2e86-4d59-a94c-bc186b4f9abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:09.265831 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d4cd2-b6b2-4bcd-b0c2-9605703d6909 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:09.268137 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d4cd2-b6b2-4bcd-b0c2-9605703d6909 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:09.268523 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d4cd2-b6b2-4bcd-b0c2-9605703d6909 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:09.269061 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d4cd2-b6b2-4bcd-b0c2-9605703d6909 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:09.293066 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d4cd2-b6b2-4bcd-b0c2-9605703d6909 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:09.296673 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d4cd2-b6b2-4bcd-b0c2-9605703d6909 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:09.323885 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 724/1454] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:25:09.326623 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d4cd2-b6b2-4bcd-b0c2-9605703d6909 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:09.344189 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d4cd2-b6b2-4bcd-b0c2-9605703d6909 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:09.355135 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c36a2-812b-4d30-b5f9-2a7dbf058533 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:09.356817 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c36a2-812b-4d30-b5f9-2a7dbf058533 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:09.357100 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c36a2-812b-4d30-b5f9-2a7dbf058533 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:09.357373 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c36a2-812b-4d30-b5f9-2a7dbf058533 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:09.381471 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c36a2-812b-4d30-b5f9-2a7dbf058533 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:09.384770 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c36a2-812b-4d30-b5f9-2a7dbf058533 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:09.411530 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 725/1455] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:25:09.413674 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c36a2-812b-4d30-b5f9-2a7dbf058533 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:09.417933 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ae3c36a2-812b-4d30-b5f9-2a7dbf058533 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:09.444864 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 731/1456] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:09 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:09.446025 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6973d-2e86-4d59-a94c-bc186b4f9abe None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:09.448970 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-52f6973d-2e86-4d59-a94c-bc186b4f9abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:09.454771 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c36a2-812b-4d30-b5f9-2a7dbf058533 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:09.464918 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ed682-11c6-4fb8-8b92-90f421cad303 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:09.466566 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ed682-11c6-4fb8-8b92-90f421cad303 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:09.466899 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ed682-11c6-4fb8-8b92-90f421cad303 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:09.467213 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ed682-11c6-4fb8-8b92-90f421cad303 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:09.484558 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ed682-11c6-4fb8-8b92-90f421cad303 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:09.489023 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ed682-11c6-4fb8-8b92-90f421cad303 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:09.510984 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 726/1457] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:25:09.552518 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6973d-2e86-4d59-a94c-bc186b4f9abe None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:09.557652 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768c7bd-7a97-4d9a-8976-c46da080d2fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:09.558294 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768c7bd-7a97-4d9a-8976-c46da080d2fe service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:09.558568 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768c7bd-7a97-4d9a-8976-c46da080d2fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:09.558835 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768c7bd-7a97-4d9a-8976-c46da080d2fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:09.573886 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768c7bd-7a97-4d9a-8976-c46da080d2fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:09.575668 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768c7bd-7a97-4d9a-8976-c46da080d2fe service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:09.602808 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 732/1458] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:09 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:25:09.873633 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ed682-11c6-4fb8-8b92-90f421cad303 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:09.879616 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768c7bd-7a97-4d9a-8976-c46da080d2fe service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:09.902759 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768c7bd-7a97-4d9a-8976-c46da080d2fe service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:09.911425 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de349dc-7268-46d2-b461-a9b03852fb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:09.912082 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de349dc-7268-46d2-b461-a9b03852fb75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:09.912366 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de349dc-7268-46d2-b461-a9b03852fb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:09.912642 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de349dc-7268-46d2-b461-a9b03852fb75 admin admin] PATH_INFO: `/v3/users/faded9f309524dd18620c73fce1b6e1e` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:09.914071 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de349dc-7268-46d2-b461-a9b03852fb75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faded9f309524dd18620c73fce1b6e1e)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:09.918927 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de349dc-7268-46d2-b461-a9b03852fb75 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:10.031256 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2de349dc-7268-46d2-b461-a9b03852fb75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faded9f309524dd18620c73fce1b6e1e'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:10.032490 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2de349dc-7268-46d2-b461-a9b03852fb75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faded9f309524dd18620c73fce1b6e1e'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:10.041006 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ed682-11c6-4fb8-8b92-90f421cad303 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:10.043290 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2de349dc-7268-46d2-b461-a9b03852fb75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faded9f309524dd18620c73fce1b6e1e'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:10.053585 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:10.067498 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c206ff-9ed1-4173-8d71-c30b77194144 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719e4bf834d6490b96066e55a26fb159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:10.069050 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c206ff-9ed1-4173-8d71-c30b77194144 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:10.071069 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c206ff-9ed1-4173-8d71-c30b77194144 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:10.071519 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c206ff-9ed1-4173-8d71-c30b77194144 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:10.072536 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2de349dc-7268-46d2-b461-a9b03852fb75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faded9f309524dd18620c73fce1b6e1e'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:10.073405 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2de349dc-7268-46d2-b461-a9b03852fb75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faded9f309524dd18620c73fce1b6e1e'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:10.074903 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-92c206ff-9ed1-4173-8d71-c30b77194144 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:10.126987 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 733/1459] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:25:09 2022] DELETE /identity/v3/users/faded9f309524dd18620c73fce1b6e1e => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:25:10.137897 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc43f0-1c33-4902-883b-c89c861d67f2 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:10.138182 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc43f0-1c33-4902-883b-c89c861d67f2 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:10.138911 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc43f0-1c33-4902-883b-c89c861d67f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:10.188725 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-48bc43f0-1c33-4902-883b-c89c861d67f2 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:10.191548 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-48bc43f0-1c33-4902-883b-c89c861d67f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:10.232405 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c206ff-9ed1-4173-8d71-c30b77194144 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:10.234080 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c206ff-9ed1-4173-8d71-c30b77194144 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:10.258166 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 727/1460] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:09 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:25:10.351643 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 734/1461] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:10.601945 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c206ff-9ed1-4173-8d71-c30b77194144 service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:10.603843 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-92c206ff-9ed1-4173-8d71-c30b77194144 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:10.626051 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c206ff-9ed1-4173-8d71-c30b77194144 service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:10.707595 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:10.780887 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8261e49-a152-4a3a-b3e2-dc9361caf5c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:10.782205 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8261e49-a152-4a3a-b3e2-dc9361caf5c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:10.789568 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8261e49-a152-4a3a-b3e2-dc9361caf5c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:10.789901 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8261e49-a152-4a3a-b3e2-dc9361caf5c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:10.839885 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8261e49-a152-4a3a-b3e2-dc9361caf5c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:10.842002 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8261e49-a152-4a3a-b3e2-dc9361caf5c6 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:10.856936 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 728/1462] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:25:11.222947 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc43f0-1c33-4902-883b-c89c861d67f2 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:11.227151 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-48bc43f0-1c33-4902-883b-c89c861d67f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:11.271681 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc43f0-1c33-4902-883b-c89c861d67f2 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:11.305907 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0c634-eed6-453e-847e-820f20fe695a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:11.321028 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0c634-eed6-453e-847e-820f20fe695a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:11.321028 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0c634-eed6-453e-847e-820f20fe695a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:11.321028 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0c634-eed6-453e-847e-820f20fe695a admin admin] PATH_INFO: `/v3/projects/2e1239ed426f417f8388ab76879dd4f6` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:11.321028 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b0c634-eed6-453e-847e-820f20fe695a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e1239ed426f417f8388ab76879dd4f6)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:11.333841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b0c634-eed6-453e-847e-820f20fe695a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:11.373411 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8261e49-a152-4a3a-b3e2-dc9361caf5c6 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:11.376347 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e8261e49-a152-4a3a-b3e2-dc9361caf5c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:11.411025 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8261e49-a152-4a3a-b3e2-dc9361caf5c6 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:11.438675 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-60b0c634-eed6-453e-847e-820f20fe695a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e1239ed426f417f8388ab76879dd4f6', 'request_id': 'req-60b0c634-eed6-453e-847e-820f20fe695a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:11.456142 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-60b0c634-eed6-453e-847e-820f20fe695a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e1239ed426f417f8388ab76879dd4f6', 'request_id': 'req-60b0c634-eed6-453e-847e-820f20fe695a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:11.481942 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-60b0c634-eed6-453e-847e-820f20fe695a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e1239ed426f417f8388ab76879dd4f6', 'request_id': 'req-60b0c634-eed6-453e-847e-820f20fe695a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:11.515263 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-60b0c634-eed6-453e-847e-820f20fe695a admin admin] The token cache is being invalidate because project 2e1239ed426f417f8388ab76879dd4f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:25:11.515752 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-60b0c634-eed6-453e-847e-820f20fe695a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:11.516721 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-60b0c634-eed6-453e-847e-820f20fe695a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:11.522374 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 735/1463] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:25:11 2022] DELETE /identity/v3/projects/2e1239ed426f417f8388ab76879dd4f6 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:11.527761 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0c634-eed6-453e-847e-820f20fe695a admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:11.531657 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-60b0c634-eed6-453e-847e-820f20fe695a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:11.682629 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0c634-eed6-453e-847e-820f20fe695a admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:11.694234 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2f54a-d474-448c-9727-87ad797902c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:11.694888 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2f54a-d474-448c-9727-87ad797902c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:11.695163 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2f54a-d474-448c-9727-87ad797902c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:11.695427 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2f54a-d474-448c-9727-87ad797902c4 admin admin] PATH_INFO: `/v3/projects/ddf73f02ae744aabb8eadedb8d91b9d5` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:11.696056 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e2303-d1e0-4452-9cf3-82762ac77a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:11.697550 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e2303-d1e0-4452-9cf3-82762ac77a57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:11.698559 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e2303-d1e0-4452-9cf3-82762ac77a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:11.699044 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e2303-d1e0-4452-9cf3-82762ac77a57 admin admin] PATH_INFO: `/v3/users/fc794c7de88c48aeb3366bb0e0a47b6e` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:11.700217 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec2f54a-d474-448c-9727-87ad797902c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddf73f02ae744aabb8eadedb8d91b9d5)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:11.700685 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1e2303-d1e0-4452-9cf3-82762ac77a57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc794c7de88c48aeb3366bb0e0a47b6e)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:11.702881 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec2f54a-d474-448c-9727-87ad797902c4 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:11.703247 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1e2303-d1e0-4452-9cf3-82762ac77a57 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:11.718627 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:11.844977 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ff1e2303-d1e0-4452-9cf3-82762ac77a57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc794c7de88c48aeb3366bb0e0a47b6e'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:11.847969 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ff1e2303-d1e0-4452-9cf3-82762ac77a57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc794c7de88c48aeb3366bb0e0a47b6e'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:11.866605 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ff1e2303-d1e0-4452-9cf3-82762ac77a57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc794c7de88c48aeb3366bb0e0a47b6e'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:11.878845 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5ec2f54a-d474-448c-9727-87ad797902c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddf73f02ae744aabb8eadedb8d91b9d5', 'request_id': 'req-5ec2f54a-d474-448c-9727-87ad797902c4'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:11.901564 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ff1e2303-d1e0-4452-9cf3-82762ac77a57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc794c7de88c48aeb3366bb0e0a47b6e'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:11.903632 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ff1e2303-d1e0-4452-9cf3-82762ac77a57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc794c7de88c48aeb3366bb0e0a47b6e'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:11.910659 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5ec2f54a-d474-448c-9727-87ad797902c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddf73f02ae744aabb8eadedb8d91b9d5', 'request_id': 'req-5ec2f54a-d474-448c-9727-87ad797902c4'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:11.923564 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5ec2f54a-d474-448c-9727-87ad797902c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddf73f02ae744aabb8eadedb8d91b9d5', 'request_id': 'req-5ec2f54a-d474-448c-9727-87ad797902c4'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:11.930526 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 736/1464] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:25:11 2022] DELETE /identity/v3/users/fc794c7de88c48aeb3366bb0e0a47b6e => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:11.948433 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5ec2f54a-d474-448c-9727-87ad797902c4 admin admin] The token cache is being invalidate because project ddf73f02ae744aabb8eadedb8d91b9d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:25:11.948777 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5ec2f54a-d474-448c-9727-87ad797902c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:11.949484 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5ec2f54a-d474-448c-9727-87ad797902c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:11.954163 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 729/1465] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:25:11 2022] DELETE /identity/v3/projects/ddf73f02ae744aabb8eadedb8d91b9d5 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:11.955479 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e2303-d1e0-4452-9cf3-82762ac77a57 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:11.957681 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ff1e2303-d1e0-4452-9cf3-82762ac77a57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:12.124238 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72544147-3d5d-4dc3-8fa0-fa90522332e1 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:12.124524 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72544147-3d5d-4dc3-8fa0-fa90522332e1 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:12.124870 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72544147-3d5d-4dc3-8fa0-fa90522332e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:12.135319 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e2303-d1e0-4452-9cf3-82762ac77a57 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:12.149459 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2d9f2-f125-4f3d-8fde-52991cc928f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:12.150407 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2d9f2-f125-4f3d-8fde-52991cc928f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:12.150754 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2d9f2-f125-4f3d-8fde-52991cc928f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:12.151097 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2d9f2-f125-4f3d-8fde-52991cc928f9 admin admin] PATH_INFO: `/v3/users/6d410da838a7449b96b6dc3de76da2e9` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:12.155343 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e2d9f2-f125-4f3d-8fde-52991cc928f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d410da838a7449b96b6dc3de76da2e9)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:12.158481 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e2d9f2-f125-4f3d-8fde-52991cc928f9 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:12.177088 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-72544147-3d5d-4dc3-8fa0-fa90522332e1 None None] MFA Rules not processed for user `946833c2a74f46528ec7c12cfef4e1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:12.178879 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-72544147-3d5d-4dc3-8fa0-fa90522332e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:12.282687 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-43e2d9f2-f125-4f3d-8fde-52991cc928f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d410da838a7449b96b6dc3de76da2e9'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:12.284020 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-43e2d9f2-f125-4f3d-8fde-52991cc928f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d410da838a7449b96b6dc3de76da2e9'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:12.296899 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-43e2d9f2-f125-4f3d-8fde-52991cc928f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d410da838a7449b96b6dc3de76da2e9'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:12.320322 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-43e2d9f2-f125-4f3d-8fde-52991cc928f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d410da838a7449b96b6dc3de76da2e9'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:12.321363 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-43e2d9f2-f125-4f3d-8fde-52991cc928f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d410da838a7449b96b6dc3de76da2e9'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:12.327706 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 730/1466] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:12.373088 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72544147-3d5d-4dc3-8fa0-fa90522332e1 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:12.374534 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-72544147-3d5d-4dc3-8fa0-fa90522332e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:12.388900 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 737/1467] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:25:11 2022] DELETE /identity/v3/users/6d410da838a7449b96b6dc3de76da2e9 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:12.398285 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72544147-3d5d-4dc3-8fa0-fa90522332e1 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:12.436586 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:12.562720 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931e11f-2c38-43d0-97d4-1ac4077829b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:12.563777 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931e11f-2c38-43d0-97d4-1ac4077829b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:12.564351 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931e11f-2c38-43d0-97d4-1ac4077829b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:12.564457 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931e11f-2c38-43d0-97d4-1ac4077829b5 admin admin] PATH_INFO: `/v3/projects/fec7b27e94f845e4993f373f16685fb0` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:12.565867 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a931e11f-2c38-43d0-97d4-1ac4077829b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fec7b27e94f845e4993f373f16685fb0)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:12.568204 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a931e11f-2c38-43d0-97d4-1ac4077829b5 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:12.688655 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-a931e11f-2c38-43d0-97d4-1ac4077829b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fec7b27e94f845e4993f373f16685fb0', 'request_id': 'req-a931e11f-2c38-43d0-97d4-1ac4077829b5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:12.708024 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-a931e11f-2c38-43d0-97d4-1ac4077829b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fec7b27e94f845e4993f373f16685fb0', 'request_id': 'req-a931e11f-2c38-43d0-97d4-1ac4077829b5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:12.736950 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-a931e11f-2c38-43d0-97d4-1ac4077829b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fec7b27e94f845e4993f373f16685fb0', 'request_id': 'req-a931e11f-2c38-43d0-97d4-1ac4077829b5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:12.768805 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-a931e11f-2c38-43d0-97d4-1ac4077829b5 admin admin] The token cache is being invalidate because project fec7b27e94f845e4993f373f16685fb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:25:12.769246 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-a931e11f-2c38-43d0-97d4-1ac4077829b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:12.772133 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-a931e11f-2c38-43d0-97d4-1ac4077829b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:12.775162 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 731/1468] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:25:12 2022] DELETE /identity/v3/projects/fec7b27e94f845e4993f373f16685fb0 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:12.779907 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2d9f2-f125-4f3d-8fde-52991cc928f9 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:12.785572 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:12.809070 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2d9f2-f125-4f3d-8fde-52991cc928f9 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:12.932339 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931e11f-2c38-43d0-97d4-1ac4077829b5 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:12.933943 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a931e11f-2c38-43d0-97d4-1ac4077829b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:12.969675 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195b90e-ab22-4be0-b651-293f028b6481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:12.970312 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195b90e-ab22-4be0-b651-293f028b6481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:12.970592 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195b90e-ab22-4be0-b651-293f028b6481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:12.974439 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195b90e-ab22-4be0-b651-293f028b6481 admin admin] PATH_INFO: `/v3/users/63966b45186c47879d9ef665e57cdf5d` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:12.975281 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2195b90e-ab22-4be0-b651-293f028b6481 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63966b45186c47879d9ef665e57cdf5d)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:12.983324 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2195b90e-ab22-4be0-b651-293f028b6481 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:13.117031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931e11f-2c38-43d0-97d4-1ac4077829b5 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:13.128276 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451b65a-ddb4-483d-92cd-26538f3d2c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:13.129081 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451b65a-ddb4-483d-92cd-26538f3d2c9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:13.129454 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451b65a-ddb4-483d-92cd-26538f3d2c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:13.129853 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451b65a-ddb4-483d-92cd-26538f3d2c9f admin admin] PATH_INFO: `/v3/projects/ed6b28b5fc414d79b0c8d70111f3a170` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:13.133843 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451b65a-ddb4-483d-92cd-26538f3d2c9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed6b28b5fc414d79b0c8d70111f3a170)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:13.141668 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451b65a-ddb4-483d-92cd-26538f3d2c9f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:13.211988 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2195b90e-ab22-4be0-b651-293f028b6481 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63966b45186c47879d9ef665e57cdf5d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:13.216875 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2195b90e-ab22-4be0-b651-293f028b6481 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63966b45186c47879d9ef665e57cdf5d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:13.243337 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:13.267400 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2195b90e-ab22-4be0-b651-293f028b6481 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63966b45186c47879d9ef665e57cdf5d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:13.268475 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5451b65a-ddb4-483d-92cd-26538f3d2c9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed6b28b5fc414d79b0c8d70111f3a170', 'request_id': 'req-5451b65a-ddb4-483d-92cd-26538f3d2c9f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:13.290927 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5451b65a-ddb4-483d-92cd-26538f3d2c9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed6b28b5fc414d79b0c8d70111f3a170', 'request_id': 'req-5451b65a-ddb4-483d-92cd-26538f3d2c9f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:13.306476 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5451b65a-ddb4-483d-92cd-26538f3d2c9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed6b28b5fc414d79b0c8d70111f3a170', 'request_id': 'req-5451b65a-ddb4-483d-92cd-26538f3d2c9f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:13.334187 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2195b90e-ab22-4be0-b651-293f028b6481 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63966b45186c47879d9ef665e57cdf5d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:13.339454 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5451b65a-ddb4-483d-92cd-26538f3d2c9f admin admin] The token cache is being invalidate because project ed6b28b5fc414d79b0c8d70111f3a170 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:25:13.339931 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5451b65a-ddb4-483d-92cd-26538f3d2c9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:13.340697 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2195b90e-ab22-4be0-b651-293f028b6481 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63966b45186c47879d9ef665e57cdf5d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:13.341150 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5451b65a-ddb4-483d-92cd-26538f3d2c9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:13.346564 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 732/1469] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:25:12 2022] DELETE /identity/v3/projects/ed6b28b5fc414d79b0c8d70111f3a170 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:25:13.354038 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf844244-57d2-4769-90ee-20b555cedc1b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:13.354674 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf844244-57d2-4769-90ee-20b555cedc1b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:13.355166 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf844244-57d2-4769-90ee-20b555cedc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:13.402596 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 738/1470] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:25:12 2022] DELETE /identity/v3/users/63966b45186c47879d9ef665e57cdf5d => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:13.403870 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195b90e-ab22-4be0-b651-293f028b6481 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:13.405169 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-bf844244-57d2-4769-90ee-20b555cedc1b None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:13.407289 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2195b90e-ab22-4be0-b651-293f028b6481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:13.409566 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-bf844244-57d2-4769-90ee-20b555cedc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:13.569826 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 733/1471] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:13.573628 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de87087-5e87-4ab6-bdde-ff7919417520 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:13.574436 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de87087-5e87-4ab6-bdde-ff7919417520 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:13.575072 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de87087-5e87-4ab6-bdde-ff7919417520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:13.594400 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195b90e-ab22-4be0-b651-293f028b6481 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:13.604724 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-0de87087-5e87-4ab6-bdde-ff7919417520 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:13.606166 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0de87087-5e87-4ab6-bdde-ff7919417520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:13.611057 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4fef6-9b26-454b-a5e4-62783df1cb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:13.611744 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4fef6-9b26-454b-a5e4-62783df1cb89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:13.612023 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4fef6-9b26-454b-a5e4-62783df1cb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:13.612299 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4fef6-9b26-454b-a5e4-62783df1cb89 admin admin] PATH_INFO: `/v3/projects/d4d84c3433a445998b8892b9e816efb4` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:13.618643 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4fef6-9b26-454b-a5e4-62783df1cb89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4d84c3433a445998b8892b9e816efb4)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:13.618815 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 734/1472] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:13.620361 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4fef6-9b26-454b-a5e4-62783df1cb89 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:13.623596 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de87087-5e87-4ab6-bdde-ff7919417520 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:13.634726 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de87087-5e87-4ab6-bdde-ff7919417520 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:13.641111 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638d64b-2e66-42bf-881a-dbb6222f5b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:13.641966 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638d64b-2e66-42bf-881a-dbb6222f5b8d admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:13.642485 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638d64b-2e66-42bf-881a-dbb6222f5b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:13.642657 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638d64b-2e66-42bf-881a-dbb6222f5b8d admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:13.643778 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8638d64b-2e66-42bf-881a-dbb6222f5b8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:25:13.644156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8638d64b-2e66-42bf-881a-dbb6222f5b8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:13.646269 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8638d64b-2e66-42bf-881a-dbb6222f5b8d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:13.667867 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 735/1473] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:25:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:25:13.668739 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638d64b-2e66-42bf-881a-dbb6222f5b8d admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:13.682438 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:13.684053 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638d64b-2e66-42bf-881a-dbb6222f5b8d admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:13.693666 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268aefb5-bdc0-4287-9b0b-09a905ea0ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:13.694145 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268aefb5-bdc0-4287-9b0b-09a905ea0ada admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:13.694552 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268aefb5-bdc0-4287-9b0b-09a905ea0ada admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:13.694887 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268aefb5-bdc0-4287-9b0b-09a905ea0ada admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:13.696494 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268aefb5-bdc0-4287-9b0b-09a905ea0ada admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:13.699987 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268aefb5-bdc0-4287-9b0b-09a905ea0ada admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:13.740557 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ada4fef6-9b26-454b-a5e4-62783df1cb89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4d84c3433a445998b8892b9e816efb4', 'request_id': 'req-ada4fef6-9b26-454b-a5e4-62783df1cb89'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:13.763921 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ada4fef6-9b26-454b-a5e4-62783df1cb89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4d84c3433a445998b8892b9e816efb4', 'request_id': 'req-ada4fef6-9b26-454b-a5e4-62783df1cb89'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:13.769274 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 736/1474] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:25:13 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:13.771873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268aefb5-bdc0-4287-9b0b-09a905ea0ada admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:13.778771 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ada4fef6-9b26-454b-a5e4-62783df1cb89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4d84c3433a445998b8892b9e816efb4', 'request_id': 'req-ada4fef6-9b26-454b-a5e4-62783df1cb89'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:13.851191 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ada4fef6-9b26-454b-a5e4-62783df1cb89 admin admin] The token cache is being invalidate because project d4d84c3433a445998b8892b9e816efb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:25:13.851191 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ada4fef6-9b26-454b-a5e4-62783df1cb89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:13.853415 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ada4fef6-9b26-454b-a5e4-62783df1cb89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:13.865891 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 739/1475] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:25:13 2022] DELETE /identity/v3/projects/d4d84c3433a445998b8892b9e816efb4 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:13.872459 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17f400-670e-4452-a03c-d6aa93890cf9 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:13.872459 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17f400-670e-4452-a03c-d6aa93890cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:13.872459 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17f400-670e-4452-a03c-d6aa93890cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:13.926784 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-2d17f400-670e-4452-a03c-d6aa93890cf9 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:13.930058 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2d17f400-670e-4452-a03c-d6aa93890cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:13.972614 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268aefb5-bdc0-4287-9b0b-09a905ea0ada admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:13.978158 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd851c-063a-4982-b303-fad68d6eb9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:13.978860 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd851c-063a-4982-b303-fad68d6eb9e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:13.979236 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd851c-063a-4982-b303-fad68d6eb9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:13.979725 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd851c-063a-4982-b303-fad68d6eb9e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:13.981156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfd851c-063a-4982-b303-fad68d6eb9e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:13.983387 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfd851c-063a-4982-b303-fad68d6eb9e8 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:14.015889 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 737/1476] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:25:13 2022] POST /identity/v3/users => generated 293 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:14.021150 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd851c-063a-4982-b303-fad68d6eb9e8 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:14.023226 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8dfd851c-063a-4982-b303-fad68d6eb9e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:14.041404 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd851c-063a-4982-b303-fad68d6eb9e8 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:14.053210 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33996d-8aa5-4f89-8ffe-14de9abf242f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:14.054307 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33996d-8aa5-4f89-8ffe-14de9abf242f admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:14.056804 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33996d-8aa5-4f89-8ffe-14de9abf242f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:14.057082 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33996d-8aa5-4f89-8ffe-14de9abf242f admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:14.058467 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d33996d-8aa5-4f89-8ffe-14de9abf242f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:14.060901 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d33996d-8aa5-4f89-8ffe-14de9abf242f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:14.076387 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 738/1477] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:14.077374 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33996d-8aa5-4f89-8ffe-14de9abf242f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:14.088528 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33996d-8aa5-4f89-8ffe-14de9abf242f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:14.089885 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 740/1478] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:25:14.090532 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:14.092836 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d78096-4b02-40e4-b06c-fff33534ce77 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:14.093312 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d78096-4b02-40e4-b06c-fff33534ce77 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:14.093759 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d78096-4b02-40e4-b06c-fff33534ce77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:14.105347 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd980d7-284b-4ebc-9a24-acb5ea5df58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:14.106024 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd980d7-284b-4ebc-9a24-acb5ea5df58e admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:14.106894 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd980d7-284b-4ebc-9a24-acb5ea5df58e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:14.107294 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd980d7-284b-4ebc-9a24-acb5ea5df58e admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:14.108211 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd980d7-284b-4ebc-9a24-acb5ea5df58e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:14.111020 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd980d7-284b-4ebc-9a24-acb5ea5df58e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:14.135350 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-b9d78096-4b02-40e4-b06c-fff33534ce77 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:14.137277 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b9d78096-4b02-40e4-b06c-fff33534ce77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:14.143402 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 739/1479] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:14.144870 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd980d7-284b-4ebc-9a24-acb5ea5df58e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:14.146137 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 741/1480] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:14.150954 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d78096-4b02-40e4-b06c-fff33534ce77 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:14.157574 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd980d7-284b-4ebc-9a24-acb5ea5df58e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:14.168292 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d5595-d96d-4b5a-a023-0eb00087ee49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:14.169085 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d5595-d96d-4b5a-a023-0eb00087ee49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:14.169241 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d5595-d96d-4b5a-a023-0eb00087ee49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:14.169510 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d5595-d96d-4b5a-a023-0eb00087ee49 admin admin] PATH_INFO: `/v3/projects/9a77c4372b0147ac9262c35cc9e26833/users/358ac5d42cb14545a8719e60c216e532/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:14.180793 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d78096-4b02-40e4-b06c-fff33534ce77 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:14.190587 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee29b1-f5ec-4915-81b5-d2c78e8e1e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:14.191217 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee29b1-f5ec-4915-81b5-d2c78e8e1e19 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:14.191499 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee29b1-f5ec-4915-81b5-d2c78e8e1e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:14.191766 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee29b1-f5ec-4915-81b5-d2c78e8e1e19 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:14.201991 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee29b1-f5ec-4915-81b5-d2c78e8e1e19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:25:14.202433 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee29b1-f5ec-4915-81b5-d2c78e8e1e19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:14.204154 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee29b1-f5ec-4915-81b5-d2c78e8e1e19 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:14.212650 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d5595-d96d-4b5a-a023-0eb00087ee49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a77c4372b0147ac9262c35cc9e26833, user_id=358ac5d42cb14545a8719e60c216e532, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:14.215852 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d5595-d96d-4b5a-a023-0eb00087ee49 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:14.241308 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 742/1481] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:25:14.242421 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee29b1-f5ec-4915-81b5-d2c78e8e1e19 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:14.252490 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 740/1482] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:14 2022] PUT /identity/v3/projects/9a77c4372b0147ac9262c35cc9e26833/users/358ac5d42cb14545a8719e60c216e532/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:14.252490 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d5595-d96d-4b5a-a023-0eb00087ee49 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:14.252982 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-37ee29b1-f5ec-4915-81b5-d2c78e8e1e19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:14.260945 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee29b1-f5ec-4915-81b5-d2c78e8e1e19 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:14.330156 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b47bcf-f2e8-4289-93fe-e792c1cf0acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:14.330992 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b47bcf-f2e8-4289-93fe-e792c1cf0acd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:14.331437 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b47bcf-f2e8-4289-93fe-e792c1cf0acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:14.332229 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b47bcf-f2e8-4289-93fe-e792c1cf0acd admin admin] PATH_INFO: `/v3/projects/efb436b94c464c4dbaae96b03a977f42` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:14.335043 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b47bcf-f2e8-4289-93fe-e792c1cf0acd admin admin] RBAC: Authorizing `identity:delete_project(project_id=efb436b94c464c4dbaae96b03a977f42)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:14.337362 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b47bcf-f2e8-4289-93fe-e792c1cf0acd admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:14.398000 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:14.419052 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-99b47bcf-f2e8-4289-93fe-e792c1cf0acd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efb436b94c464c4dbaae96b03a977f42', 'request_id': 'req-99b47bcf-f2e8-4289-93fe-e792c1cf0acd'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:14.423385 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d5595-d96d-4b5a-a023-0eb00087ee49 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:14.431149 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-99b47bcf-f2e8-4289-93fe-e792c1cf0acd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efb436b94c464c4dbaae96b03a977f42', 'request_id': 'req-99b47bcf-f2e8-4289-93fe-e792c1cf0acd'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:14.459341 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-99b47bcf-f2e8-4289-93fe-e792c1cf0acd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efb436b94c464c4dbaae96b03a977f42', 'request_id': 'req-99b47bcf-f2e8-4289-93fe-e792c1cf0acd'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:14.491419 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-99b47bcf-f2e8-4289-93fe-e792c1cf0acd admin admin] The token cache is being invalidate because project efb436b94c464c4dbaae96b03a977f42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:25:14.492465 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-99b47bcf-f2e8-4289-93fe-e792c1cf0acd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:14.493953 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-99b47bcf-f2e8-4289-93fe-e792c1cf0acd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:14.496533 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 743/1483] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:25:14 2022] DELETE /identity/v3/projects/efb436b94c464c4dbaae96b03a977f42 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:14.498752 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7201b-8f96-41bc-9d8d-bc684065b9ea None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:14.500154 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7201b-8f96-41bc-9d8d-bc684065b9ea None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:14.501429 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7201b-8f96-41bc-9d8d-bc684065b9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:14.548175 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-4cf7201b-8f96-41bc-9d8d-bc684065b9ea None None] MFA Rules not processed for user `358ac5d42cb14545a8719e60c216e532`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:14.551022 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-4cf7201b-8f96-41bc-9d8d-bc684065b9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:14.572686 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90861c4-cab6-49fd-bebb-d1a43f5b9ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:14.573316 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90861c4-cab6-49fd-bebb-d1a43f5b9ea0 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:14.573618 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90861c4-cab6-49fd-bebb-d1a43f5b9ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:14.573896 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90861c4-cab6-49fd-bebb-d1a43f5b9ea0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:14.574546 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90861c4-cab6-49fd-bebb-d1a43f5b9ea0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:14.581772 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90861c4-cab6-49fd-bebb-d1a43f5b9ea0 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:14.644081 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 744/1484] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:14.645667 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299edd40-65e3-4bf3-8f23-ef85f8c201cd None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:14.645955 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299edd40-65e3-4bf3-8f23-ef85f8c201cd None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:14.646226 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299edd40-65e3-4bf3-8f23-ef85f8c201cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:14.647609 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 741/1485] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:25:14 2022] POST /identity/v3/projects => generated 387 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:14.654052 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90861c4-cab6-49fd-bebb-d1a43f5b9ea0 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:14.659365 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c90861c4-cab6-49fd-bebb-d1a43f5b9ea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:14.711500 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-299edd40-65e3-4bf3-8f23-ef85f8c201cd None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:14.716994 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-299edd40-65e3-4bf3-8f23-ef85f8c201cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:14.901350 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 745/1486] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:14.908880 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299edd40-65e3-4bf3-8f23-ef85f8c201cd None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:14.911098 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-299edd40-65e3-4bf3-8f23-ef85f8c201cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:14.985921 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90861c4-cab6-49fd-bebb-d1a43f5b9ea0 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:14.993331 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dae819-53c2-4abd-adf0-2cbd74b60d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:14.994113 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dae819-53c2-4abd-adf0-2cbd74b60d96 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:14.994388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dae819-53c2-4abd-adf0-2cbd74b60d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:14.994654 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dae819-53c2-4abd-adf0-2cbd74b60d96 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:14.995822 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dae819-53c2-4abd-adf0-2cbd74b60d96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:14.997397 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dae819-53c2-4abd-adf0-2cbd74b60d96 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:15.013507 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:15.013740 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299edd40-65e3-4bf3-8f23-ef85f8c201cd None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:15.022636 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4997a20-64d8-41fa-bbd6-9bc475a7f9c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:15.023295 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4997a20-64d8-41fa-bbd6-9bc475a7f9c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:15.023579 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4997a20-64d8-41fa-bbd6-9bc475a7f9c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:15.023852 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4997a20-64d8-41fa-bbd6-9bc475a7f9c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:15.035967 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:15.042554 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 742/1487] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:25:14 2022] POST /identity/v3/users => generated 294 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:15.045691 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3cda6-331d-4c16-bb0c-8a3851d4e960 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:15.045974 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3cda6-331d-4c16-bb0c-8a3851d4e960 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:15.046261 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3cda6-331d-4c16-bb0c-8a3851d4e960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:15.070303 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-b6d3cda6-331d-4c16-bb0c-8a3851d4e960 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:15.073232 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b6d3cda6-331d-4c16-bb0c-8a3851d4e960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:15.093813 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 743/1488] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:15.095300 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3cda6-331d-4c16-bb0c-8a3851d4e960 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:15.107016 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3cda6-331d-4c16-bb0c-8a3851d4e960 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:15.113552 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693dc9ca-c6bc-4c23-9cdd-22a3dd57a881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:15.114329 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693dc9ca-c6bc-4c23-9cdd-22a3dd57a881 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:15.114592 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693dc9ca-c6bc-4c23-9cdd-22a3dd57a881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:15.114864 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693dc9ca-c6bc-4c23-9cdd-22a3dd57a881 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:15.116073 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693dc9ca-c6bc-4c23-9cdd-22a3dd57a881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:15.116831 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4997a20-64d8-41fa-bbd6-9bc475a7f9c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:15.117223 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693dc9ca-c6bc-4c23-9cdd-22a3dd57a881 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:15.118587 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4997a20-64d8-41fa-bbd6-9bc475a7f9c1 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:15.129333 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 746/1489] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:25:15.130590 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4997a20-64d8-41fa-bbd6-9bc475a7f9c1 service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:15.143655 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4997a20-64d8-41fa-bbd6-9bc475a7f9c1 service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:15.149652 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b21bb0-af4e-4107-ab66-c6a21e779985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:15.150547 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b21bb0-af4e-4107-ab66-c6a21e779985 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:15.150962 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b21bb0-af4e-4107-ab66-c6a21e779985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:15.151290 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b21bb0-af4e-4107-ab66-c6a21e779985 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:15.153366 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b21bb0-af4e-4107-ab66-c6a21e779985 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:25:15.153777 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b21bb0-af4e-4107-ab66-c6a21e779985 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:15.155875 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b21bb0-af4e-4107-ab66-c6a21e779985 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:15.160912 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 744/1490] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:15.166316 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693dc9ca-c6bc-4c23-9cdd-22a3dd57a881 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:15.179525 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 747/1491] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:25:15.181004 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b21bb0-af4e-4107-ab66-c6a21e779985 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:15.183416 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-00b21bb0-af4e-4107-ab66-c6a21e779985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:15.200681 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b21bb0-af4e-4107-ab66-c6a21e779985 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:15.202225 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693dc9ca-c6bc-4c23-9cdd-22a3dd57a881 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:15.211898 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95717b0e-c7af-450b-89ba-b5fc3b0444d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:15.212857 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95717b0e-c7af-450b-89ba-b5fc3b0444d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:15.213317 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95717b0e-c7af-450b-89ba-b5fc3b0444d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:15.213772 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95717b0e-c7af-450b-89ba-b5fc3b0444d1 admin admin] PATH_INFO: `/v3/users/358ac5d42cb14545a8719e60c216e532` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:15.215038 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb987a63-5392-4df3-8a03-6d7def8339d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:15.215421 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95717b0e-c7af-450b-89ba-b5fc3b0444d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=358ac5d42cb14545a8719e60c216e532)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:15.217888 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95717b0e-c7af-450b-89ba-b5fc3b0444d1 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:15.218003 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb987a63-5392-4df3-8a03-6d7def8339d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:15.218304 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb987a63-5392-4df3-8a03-6d7def8339d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:15.218588 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb987a63-5392-4df3-8a03-6d7def8339d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:15.219257 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb987a63-5392-4df3-8a03-6d7def8339d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:15.220863 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb987a63-5392-4df3-8a03-6d7def8339d6 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:15.240309 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 745/1492] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:15.241176 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb987a63-5392-4df3-8a03-6d7def8339d6 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:15.273934 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb987a63-5392-4df3-8a03-6d7def8339d6 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:15.299545 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d24c843-bfe5-473b-ad07-f2689b6105ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:15.300695 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24c843-bfe5-473b-ad07-f2689b6105ae admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:15.301046 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24c843-bfe5-473b-ad07-f2689b6105ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:15.301329 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24c843-bfe5-473b-ad07-f2689b6105ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:15.302158 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d24c843-bfe5-473b-ad07-f2689b6105ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:15.307551 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d24c843-bfe5-473b-ad07-f2689b6105ae admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:15.327289 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-95717b0e-c7af-450b-89ba-b5fc3b0444d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '358ac5d42cb14545a8719e60c216e532'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:15.328216 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-95717b0e-c7af-450b-89ba-b5fc3b0444d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '358ac5d42cb14545a8719e60c216e532'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:15.346969 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-95717b0e-c7af-450b-89ba-b5fc3b0444d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '358ac5d42cb14545a8719e60c216e532'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:15.374806 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 746/1493] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:25:15 2022] POST /identity/v3/projects => generated 361 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:15.374806 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d24c843-bfe5-473b-ad07-f2689b6105ae admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:15.378590 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2d24c843-bfe5-473b-ad07-f2689b6105ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:15.380474 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-95717b0e-c7af-450b-89ba-b5fc3b0444d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '358ac5d42cb14545a8719e60c216e532'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:15.381446 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-95717b0e-c7af-450b-89ba-b5fc3b0444d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '358ac5d42cb14545a8719e60c216e532'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:15.421994 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 748/1494] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:25:15 2022] DELETE /identity/v3/users/358ac5d42cb14545a8719e60c216e532 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:15.423896 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95717b0e-c7af-450b-89ba-b5fc3b0444d1 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:15.428173 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-95717b0e-c7af-450b-89ba-b5fc3b0444d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:15.566618 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d24c843-bfe5-473b-ad07-f2689b6105ae admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:15.619882 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95717b0e-c7af-450b-89ba-b5fc3b0444d1 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:15.625497 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e59183-14b0-47b9-94a0-43ebe00aef2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:15.626245 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e59183-14b0-47b9-94a0-43ebe00aef2c admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:15.628841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e59183-14b0-47b9-94a0-43ebe00aef2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:15.629225 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e59183-14b0-47b9-94a0-43ebe00aef2c admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:15.629887 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e59183-14b0-47b9-94a0-43ebe00aef2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:15.632232 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e59183-14b0-47b9-94a0-43ebe00aef2c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:15.649959 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:15.688113 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 749/1495] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:25:15 2022] POST /identity/v3/users => generated 281 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:15.688864 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2c870-a992-450d-aec7-8fa57420b1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:15.688864 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2c870-a992-450d-aec7-8fa57420b1cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:15.688864 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2c870-a992-450d-aec7-8fa57420b1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:15.689132 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2c870-a992-450d-aec7-8fa57420b1cb admin admin] PATH_INFO: `/v3/projects/1b94e4f6c31743f09ef70d321c245d00/users/5fda228367234d908e83c8d37c94fa73/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:15.692902 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f668d7-7378-4997-b92f-7d587f92ba80 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:15.699090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f668d7-7378-4997-b92f-7d587f92ba80 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:15.699374 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f668d7-7378-4997-b92f-7d587f92ba80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:15.754138 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-17f668d7-7378-4997-b92f-7d587f92ba80 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:15.755893 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-17f668d7-7378-4997-b92f-7d587f92ba80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:15.756457 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f2c870-a992-450d-aec7-8fa57420b1cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b94e4f6c31743f09ef70d321c245d00, user_id=5fda228367234d908e83c8d37c94fa73, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:15.762411 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f2c870-a992-450d-aec7-8fa57420b1cb admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:15.768665 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 750/1496] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:15.770037 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f668d7-7378-4997-b92f-7d587f92ba80 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:15.797381 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 747/1497] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:15 2022] PUT /identity/v3/projects/1b94e4f6c31743f09ef70d321c245d00/users/5fda228367234d908e83c8d37c94fa73/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:15.801494 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2c870-a992-450d-aec7-8fa57420b1cb admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:15.807661 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-93f2c870-a992-450d-aec7-8fa57420b1cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:15.811840 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f668d7-7378-4997-b92f-7d587f92ba80 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:15.892955 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:15.969595 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1d0a0-433c-4c8c-8bba-bcde8f2b0ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:15.970243 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1d0a0-433c-4c8c-8bba-bcde8f2b0ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:15.970524 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1d0a0-433c-4c8c-8bba-bcde8f2b0ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:15.970808 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1d0a0-433c-4c8c-8bba-bcde8f2b0ea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:15.971478 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa1d0a0-433c-4c8c-8bba-bcde8f2b0ea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:15.977314 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa1d0a0-433c-4c8c-8bba-bcde8f2b0ea1 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:15.981865 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2c870-a992-450d-aec7-8fa57420b1cb admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:16.006353 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dad9cc-5381-4c09-b6c6-c40b067cf06c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:16.007786 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dad9cc-5381-4c09-b6c6-c40b067cf06c service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:16.008251 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dad9cc-5381-4c09-b6c6-c40b067cf06c service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:16.008778 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dad9cc-5381-4c09-b6c6-c40b067cf06c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:16.020363 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 751/1498] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:16.029959 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7d3ce-340e-44d7-9ff3-49f3fe23a8f4 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:16.030158 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7d3ce-340e-44d7-9ff3-49f3fe23a8f4 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:16.030502 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7d3ce-340e-44d7-9ff3-49f3fe23a8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:16.038208 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dad9cc-5381-4c09-b6c6-c40b067cf06c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:16.048073 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dad9cc-5381-4c09-b6c6-c40b067cf06c service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:16.096421 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 748/1499] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:25:16.099745 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dad9cc-5381-4c09-b6c6-c40b067cf06c service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:16.145629 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dad9cc-5381-4c09-b6c6-c40b067cf06c service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:16.174261 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-c1a7d3ce-340e-44d7-9ff3-49f3fe23a8f4 None None] MFA Rules not processed for user `5fda228367234d908e83c8d37c94fa73`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:16.176133 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c1a7d3ce-340e-44d7-9ff3-49f3fe23a8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:16.180519 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed7049-fc30-4c73-b32b-d22ed5b6f335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:16.182357 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed7049-fc30-4c73-b32b-d22ed5b6f335 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:16.182778 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed7049-fc30-4c73-b32b-d22ed5b6f335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:16.183070 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed7049-fc30-4c73-b32b-d22ed5b6f335 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:16.183904 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed7049-fc30-4c73-b32b-d22ed5b6f335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:16.185867 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed7049-fc30-4c73-b32b-d22ed5b6f335 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:16.224411 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 749/1500] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:16.227979 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed7049-fc30-4c73-b32b-d22ed5b6f335 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:16.275303 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed7049-fc30-4c73-b32b-d22ed5b6f335 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:16.290755 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45aba8a-1e36-4be0-8e01-4c7d2434af34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:16.292776 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45aba8a-1e36-4be0-8e01-4c7d2434af34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:16.293063 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45aba8a-1e36-4be0-8e01-4c7d2434af34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:16.293334 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45aba8a-1e36-4be0-8e01-4c7d2434af34 admin admin] PATH_INFO: `/v3/projects/c7bcef4a1c5144848ce985de1f9b8018/users/c518619f83244221a6b56ce472563b02/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:16.335423 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45aba8a-1e36-4be0-8e01-4c7d2434af34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7bcef4a1c5144848ce985de1f9b8018, user_id=c518619f83244221a6b56ce472563b02, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:16.340051 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45aba8a-1e36-4be0-8e01-4c7d2434af34 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:16.382049 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 750/1501] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:16 2022] PUT /identity/v3/projects/c7bcef4a1c5144848ce985de1f9b8018/users/c518619f83244221a6b56ce472563b02/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:16.383959 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056dce3-d8e2-4913-a8bf-0ae10d64cd38 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:16.384260 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056dce3-d8e2-4913-a8bf-0ae10d64cd38 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:16.384549 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056dce3-d8e2-4913-a8bf-0ae10d64cd38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:16.385285 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 752/1502] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:16.389645 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a7d3ce-340e-44d7-9ff3-49f3fe23a8f4 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:16.409321 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a7d3ce-340e-44d7-9ff3-49f3fe23a8f4 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:16.452689 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-9056dce3-d8e2-4913-a8bf-0ae10d64cd38 None None] MFA Rules not processed for user `c518619f83244221a6b56ce472563b02`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:16.453966 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9056dce3-d8e2-4913-a8bf-0ae10d64cd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:16.611877 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e9785-e495-4eaa-a2f8-8c84d8abafb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:16.612599 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e9785-e495-4eaa-a2f8-8c84d8abafb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:16.613585 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e9785-e495-4eaa-a2f8-8c84d8abafb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:16.614210 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e9785-e495-4eaa-a2f8-8c84d8abafb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:16.615100 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e9785-e495-4eaa-a2f8-8c84d8abafb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:16.618438 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e9785-e495-4eaa-a2f8-8c84d8abafb0 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:16.649627 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 751/1503] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:25:16.665223 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9056dce3-d8e2-4913-a8bf-0ae10d64cd38 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:16.668149 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:16.688432 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 753/1504] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:25:16 2022] POST /identity/v3/projects => generated 389 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:25:16.692847 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9056dce3-d8e2-4913-a8bf-0ae10d64cd38 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:16.699722 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e9785-e495-4eaa-a2f8-8c84d8abafb0 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:16.794324 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4ca9d-9c34-498f-bfc5-1ac13320f4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:16.794941 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4ca9d-9c34-498f-bfc5-1ac13320f4d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:16.795216 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4ca9d-9c34-498f-bfc5-1ac13320f4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:16.795480 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4ca9d-9c34-498f-bfc5-1ac13320f4d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:16.796404 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4ca9d-9c34-498f-bfc5-1ac13320f4d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:16.804146 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4ca9d-9c34-498f-bfc5-1ac13320f4d1 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:16.842394 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 752/1505] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:25:16 2022] POST /identity/v3/projects => generated 365 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:16.846415 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4ca9d-9c34-498f-bfc5-1ac13320f4d1 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:16.880900 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e9785-e495-4eaa-a2f8-8c84d8abafb0 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:16.896698 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:16.984762 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4ca9d-9c34-498f-bfc5-1ac13320f4d1 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:16.990730 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed940e-0279-4f7c-98b6-a4529361386e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:16.991671 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed940e-0279-4f7c-98b6-a4529361386e admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:16.992157 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed940e-0279-4f7c-98b6-a4529361386e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:16.992634 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed940e-0279-4f7c-98b6-a4529361386e admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:16.993997 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed940e-0279-4f7c-98b6-a4529361386e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:16.996154 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed940e-0279-4f7c-98b6-a4529361386e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:17.004011 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330c543-1e6a-4c3c-a305-d331d058c713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:17.004617 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330c543-1e6a-4c3c-a305-d331d058c713 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:17.005481 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330c543-1e6a-4c3c-a305-d331d058c713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:17.005810 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330c543-1e6a-4c3c-a305-d331d058c713 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:17.006503 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e330c543-1e6a-4c3c-a305-d331d058c713 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:17.008841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e330c543-1e6a-4c3c-a305-d331d058c713 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:17.030133 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 753/1506] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:25:16 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:17.036193 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed940e-0279-4f7c-98b6-a4529361386e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:17.059804 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed940e-0279-4f7c-98b6-a4529361386e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:17.066029 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727c73c-7409-450a-b78f-2b052aac92cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:17.067062 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727c73c-7409-450a-b78f-2b052aac92cb admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:17.067478 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727c73c-7409-450a-b78f-2b052aac92cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:17.067852 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 754/1507] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:25:16 2022] POST /identity/v3/users => generated 301 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:17.068055 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727c73c-7409-450a-b78f-2b052aac92cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:17.068914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b727c73c-7409-450a-b78f-2b052aac92cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:17.070666 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b727c73c-7409-450a-b78f-2b052aac92cb admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:17.070875 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330c543-1e6a-4c3c-a305-d331d058c713 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:17.092254 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 754/1508] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:17.093748 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727c73c-7409-450a-b78f-2b052aac92cb admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:17.098907 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330c543-1e6a-4c3c-a305-d331d058c713 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:17.110323 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727c73c-7409-450a-b78f-2b052aac92cb admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:17.111265 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c4351-d65d-4ef9-9e60-84b54f4f7896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:17.111851 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c4351-d65d-4ef9-9e60-84b54f4f7896 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:17.114235 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c4351-d65d-4ef9-9e60-84b54f4f7896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:17.114540 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c4351-d65d-4ef9-9e60-84b54f4f7896 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:17.116680 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211265c9-2b21-43bb-a917-7013634cd8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:17.117383 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c4351-d65d-4ef9-9e60-84b54f4f7896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:17.117642 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211265c9-2b21-43bb-a917-7013634cd8d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:17.118138 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211265c9-2b21-43bb-a917-7013634cd8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:17.118657 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211265c9-2b21-43bb-a917-7013634cd8d5 admin admin] PATH_INFO: `/v3/projects/070b448957a04cab95aeb822ca109bec/users/a09c376b345149d99c92a00b6e9c4b23/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:17.123591 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c4351-d65d-4ef9-9e60-84b54f4f7896 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:17.148333 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211265c9-2b21-43bb-a917-7013634cd8d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=070b448957a04cab95aeb822ca109bec, user_id=a09c376b345149d99c92a00b6e9c4b23, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:17.149746 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 755/1509] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:17.153271 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c4351-d65d-4ef9-9e60-84b54f4f7896 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:17.161318 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-fb7c4351-d65d-4ef9-9e60-84b54f4f7896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:17.161895 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211265c9-2b21-43bb-a917-7013634cd8d5 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:17.190321 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 755/1510] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:17 2022] PUT /identity/v3/projects/070b448957a04cab95aeb822ca109bec/users/a09c376b345149d99c92a00b6e9c4b23/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:17.192022 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211265c9-2b21-43bb-a917-7013634cd8d5 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:17.194560 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c4351-d65d-4ef9-9e60-84b54f4f7896 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:17.268653 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c75578-4bd2-4756-a2d8-e82c80d6fe73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:17.269315 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c75578-4bd2-4756-a2d8-e82c80d6fe73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:17.269627 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c75578-4bd2-4756-a2d8-e82c80d6fe73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:17.269906 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c75578-4bd2-4756-a2d8-e82c80d6fe73 admin admin] PATH_INFO: `/v3/projects/9a77c4372b0147ac9262c35cc9e26833` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:17.272229 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c75578-4bd2-4756-a2d8-e82c80d6fe73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a77c4372b0147ac9262c35cc9e26833)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:17.272678 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211265c9-2b21-43bb-a917-7013634cd8d5 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:17.274637 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c75578-4bd2-4756-a2d8-e82c80d6fe73 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:17.278632 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e6125-d433-4cf0-9ec9-57528925a402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:17.279989 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e6125-d433-4cf0-9ec9-57528925a402 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:17.280497 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e6125-d433-4cf0-9ec9-57528925a402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:17.281635 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e6125-d433-4cf0-9ec9-57528925a402 admin admin] PATH_INFO: `/v3/projects/4bad739f929645e2b8d1679464d76b2c/users/ce68727ee5944d399aad70dece8aea07/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:17.300771 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e6125-d433-4cf0-9ec9-57528925a402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bad739f929645e2b8d1679464d76b2c, user_id=ce68727ee5944d399aad70dece8aea07, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:17.304305 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e6125-d433-4cf0-9ec9-57528925a402 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:17.323035 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:17.344873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 756/1511] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:17 2022] PUT /identity/v3/projects/4bad739f929645e2b8d1679464d76b2c/users/ce68727ee5944d399aad70dece8aea07/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:17.344873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a85645-4474-4246-b52b-ee8482ad43d9 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:17.344873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a85645-4474-4246-b52b-ee8482ad43d9 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:17.344873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a85645-4474-4246-b52b-ee8482ad43d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:17.354459 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d3c75578-4bd2-4756-a2d8-e82c80d6fe73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a77c4372b0147ac9262c35cc9e26833', 'request_id': 'req-d3c75578-4bd2-4756-a2d8-e82c80d6fe73'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:17.368047 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d3c75578-4bd2-4756-a2d8-e82c80d6fe73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a77c4372b0147ac9262c35cc9e26833', 'request_id': 'req-d3c75578-4bd2-4756-a2d8-e82c80d6fe73'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:17.371479 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-b9a85645-4474-4246-b52b-ee8482ad43d9 None None] MFA Rules not processed for user `6b715ce1b1b2441c968102cadb1dea50`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:17.372921 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b9a85645-4474-4246-b52b-ee8482ad43d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:17.380100 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d3c75578-4bd2-4756-a2d8-e82c80d6fe73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a77c4372b0147ac9262c35cc9e26833', 'request_id': 'req-d3c75578-4bd2-4756-a2d8-e82c80d6fe73'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:17.395374 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d3c75578-4bd2-4756-a2d8-e82c80d6fe73 admin admin] The token cache is being invalidate because project 9a77c4372b0147ac9262c35cc9e26833 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:25:17.397246 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d3c75578-4bd2-4756-a2d8-e82c80d6fe73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:17.398120 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d3c75578-4bd2-4756-a2d8-e82c80d6fe73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:17.400234 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 756/1512] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:25:17 2022] DELETE /identity/v3/projects/9a77c4372b0147ac9262c35cc9e26833 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:17.401503 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c75578-4bd2-4756-a2d8-e82c80d6fe73 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:17.404376 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d3c75578-4bd2-4756-a2d8-e82c80d6fe73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:17.430130 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:17.448747 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 757/1513] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:17.455275 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a85645-4474-4246-b52b-ee8482ad43d9 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:17.456761 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b9a85645-4474-4246-b52b-ee8482ad43d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:17.550551 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a85645-4474-4246-b52b-ee8482ad43d9 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:17.556702 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04521094-828b-45ba-982e-dd54aa251513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:17.557548 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04521094-828b-45ba-982e-dd54aa251513 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:17.558002 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04521094-828b-45ba-982e-dd54aa251513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:17.558487 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04521094-828b-45ba-982e-dd54aa251513 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:17.559439 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04521094-828b-45ba-982e-dd54aa251513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:17.573997 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04521094-828b-45ba-982e-dd54aa251513 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:17.589689 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c75578-4bd2-4756-a2d8-e82c80d6fe73 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:17.598601 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 758/1514] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:17.604214 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390653f-9c90-4809-aa11-1f01db15573d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:17.605045 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390653f-9c90-4809-aa11-1f01db15573d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:17.606888 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390653f-9c90-4809-aa11-1f01db15573d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:17.622817 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60a06b-e544-43da-bd04-41606efdd0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:17.628741 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60a06b-e544-43da-bd04-41606efdd0fa admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:17.630966 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60a06b-e544-43da-bd04-41606efdd0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:17.631462 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60a06b-e544-43da-bd04-41606efdd0fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:17.632517 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb60a06b-e544-43da-bd04-41606efdd0fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:17.636387 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb60a06b-e544-43da-bd04-41606efdd0fa admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:17.658111 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-b390653f-9c90-4809-aa11-1f01db15573d None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:17.659386 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b390653f-9c90-4809-aa11-1f01db15573d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:17.666639 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 757/1515] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:17.668061 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60a06b-e544-43da-bd04-41606efdd0fa admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:17.694262 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 759/1516] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:17.695234 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390653f-9c90-4809-aa11-1f01db15573d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:17.711616 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60a06b-e544-43da-bd04-41606efdd0fa admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:17.712804 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390653f-9c90-4809-aa11-1f01db15573d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:17.726262 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63097557-2516-4457-ae21-beb21c0708a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:17.732339 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63097557-2516-4457-ae21-beb21c0708a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:17.732628 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63097557-2516-4457-ae21-beb21c0708a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:17.733492 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292cedb-3159-408a-ba9f-12bfc7e4921f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:17.734099 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63097557-2516-4457-ae21-beb21c0708a4 admin admin] PATH_INFO: `/v3/projects/070b448957a04cab95aeb822ca109bec/users/a09c376b345149d99c92a00b6e9c4b23/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:17.736301 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292cedb-3159-408a-ba9f-12bfc7e4921f admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:17.736413 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63097557-2516-4457-ae21-beb21c0708a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=070b448957a04cab95aeb822ca109bec, user_id=a09c376b345149d99c92a00b6e9c4b23, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:17.737922 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292cedb-3159-408a-ba9f-12bfc7e4921f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:17.738401 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292cedb-3159-408a-ba9f-12bfc7e4921f admin admin] PATH_INFO: `/v3/projects/4bad739f929645e2b8d1679464d76b2c/users/ce68727ee5944d399aad70dece8aea07/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:17.742808 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63097557-2516-4457-ae21-beb21c0708a4 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:17.744346 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0292cedb-3159-408a-ba9f-12bfc7e4921f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bad739f929645e2b8d1679464d76b2c, user_id=ce68727ee5944d399aad70dece8aea07, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:17.752966 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0292cedb-3159-408a-ba9f-12bfc7e4921f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:17.785587 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 760/1517] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:17 2022] PUT /identity/v3/projects/070b448957a04cab95aeb822ca109bec/users/a09c376b345149d99c92a00b6e9c4b23/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:17.788584 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12267410-8ddc-4a74-b630-bc42865e5c2e None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:17.788690 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12267410-8ddc-4a74-b630-bc42865e5c2e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:17.789135 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12267410-8ddc-4a74-b630-bc42865e5c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:17.796204 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 758/1518] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:17 2022] PUT /identity/v3/projects/4bad739f929645e2b8d1679464d76b2c/users/ce68727ee5944d399aad70dece8aea07/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:17.797785 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935858b-b71a-4e73-b4f6-077068467d38 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:17.805681 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935858b-b71a-4e73-b4f6-077068467d38 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:17.808548 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935858b-b71a-4e73-b4f6-077068467d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:17.860949 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-2935858b-b71a-4e73-b4f6-077068467d38 None None] MFA Rules not processed for user `a09c376b345149d99c92a00b6e9c4b23`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:17.863122 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2935858b-b71a-4e73-b4f6-077068467d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:17.866441 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-12267410-8ddc-4a74-b630-bc42865e5c2e None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:17.868644 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-12267410-8ddc-4a74-b630-bc42865e5c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:18.040001 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 761/1519] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:18.043924 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568150f-b665-47dd-bbba-e65fb2afbe44 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:18.045613 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568150f-b665-47dd-bbba-e65fb2afbe44 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:18.045867 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568150f-b665-47dd-bbba-e65fb2afbe44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:18.071241 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 759/1520] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:17 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:18.073054 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935858b-b71a-4e73-b4f6-077068467d38 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:18.113132 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935858b-b71a-4e73-b4f6-077068467d38 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:18.123706 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b0c6f-dd28-47ee-9060-5a88c345e581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:18.124418 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b0c6f-dd28-47ee-9060-5a88c345e581 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:18.124887 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b0c6f-dd28-47ee-9060-5a88c345e581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:18.125174 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b0c6f-dd28-47ee-9060-5a88c345e581 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:18.125865 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61b0c6f-dd28-47ee-9060-5a88c345e581 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:25:18.126209 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61b0c6f-dd28-47ee-9060-5a88c345e581 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:18.128010 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61b0c6f-dd28-47ee-9060-5a88c345e581 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:18.130235 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-2568150f-b665-47dd-bbba-e65fb2afbe44 None None] MFA Rules not processed for user `ce68727ee5944d399aad70dece8aea07`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:18.131459 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2568150f-b665-47dd-bbba-e65fb2afbe44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:18.146374 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 760/1521] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:25:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:25:18.147852 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b0c6f-dd28-47ee-9060-5a88c345e581 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:18.150099 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a61b0c6f-dd28-47ee-9060-5a88c345e581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:18.170441 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:18.343958 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:18.352791 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b0c6f-dd28-47ee-9060-5a88c345e581 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:18.356598 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 762/1522] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:18 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:18.357453 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568150f-b665-47dd-bbba-e65fb2afbe44 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:18.366687 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d91884-8f02-44ba-8727-511d82f2071a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:18.367321 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d91884-8f02-44ba-8727-511d82f2071a service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:18.367597 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d91884-8f02-44ba-8727-511d82f2071a service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:18.367866 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d91884-8f02-44ba-8727-511d82f2071a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:18.383951 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568150f-b665-47dd-bbba-e65fb2afbe44 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:18.387497 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d91884-8f02-44ba-8727-511d82f2071a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:18.389323 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d91884-8f02-44ba-8727-511d82f2071a service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:18.412007 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba09c8-c00e-411f-96e7-ff914bd53474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:18.412607 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba09c8-c00e-411f-96e7-ff914bd53474 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:18.412928 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba09c8-c00e-411f-96e7-ff914bd53474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:18.413230 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba09c8-c00e-411f-96e7-ff914bd53474 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:18.413954 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba09c8-c00e-411f-96e7-ff914bd53474 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:18.421146 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba09c8-c00e-411f-96e7-ff914bd53474 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:18.433753 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 761/1523] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:18 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:25:18.449656 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d91884-8f02-44ba-8727-511d82f2071a service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:18.451101 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-18d91884-8f02-44ba-8727-511d82f2071a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:18.480366 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d91884-8f02-44ba-8727-511d82f2071a service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:18.492287 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435847f6-78dc-4a05-8766-68e4339b17e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:18.493553 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435847f6-78dc-4a05-8766-68e4339b17e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:18.494101 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435847f6-78dc-4a05-8766-68e4339b17e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:18.494525 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435847f6-78dc-4a05-8766-68e4339b17e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:18.498018 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 763/1524] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:25:18 2022] POST /identity/v3/projects => generated 375 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:18.505231 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba09c8-c00e-411f-96e7-ff914bd53474 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:18.522079 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435847f6-78dc-4a05-8766-68e4339b17e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:18.527563 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435847f6-78dc-4a05-8766-68e4339b17e1 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:18.579715 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 762/1525] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:18 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:25:18.592623 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba09c8-c00e-411f-96e7-ff914bd53474 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:18.599350 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa281e3-5f25-4968-8f75-9be6243d9797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:18.600166 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa281e3-5f25-4968-8f75-9be6243d9797 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:18.601825 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa281e3-5f25-4968-8f75-9be6243d9797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:18.602204 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa281e3-5f25-4968-8f75-9be6243d9797 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:18.603285 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa281e3-5f25-4968-8f75-9be6243d9797 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:18.606004 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa281e3-5f25-4968-8f75-9be6243d9797 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:18.648966 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 764/1526] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:25:18 2022] POST /identity/v3/users => generated 288 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:18.650704 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435847f6-78dc-4a05-8766-68e4339b17e1 service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:18.654954 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18360c23-820d-48a9-bd99-c1cfd7c28bf8 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:18.655294 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18360c23-820d-48a9-bd99-c1cfd7c28bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:18.656002 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18360c23-820d-48a9-bd99-c1cfd7c28bf8 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:18.657445 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 765/1527] 10.222.0.52 () {54 vars in 921 bytes} [Thu Oct 27 13:25:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:25:18.669557 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435847f6-78dc-4a05-8766-68e4339b17e1 service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:18.679310 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49907eb9-70f6-473d-8494-05e0bf8e6c53 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:18.679310 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49907eb9-70f6-473d-8494-05e0bf8e6c53 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:18.679310 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49907eb9-70f6-473d-8494-05e0bf8e6c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:18.684356 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1efb10-03c9-453d-9efa-ae001e8783a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:18.685496 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1efb10-03c9-453d-9efa-ae001e8783a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:18.693222 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1efb10-03c9-453d-9efa-ae001e8783a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:18.698139 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1efb10-03c9-453d-9efa-ae001e8783a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:18.698949 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1efb10-03c9-453d-9efa-ae001e8783a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:18.700679 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1efb10-03c9-453d-9efa-ae001e8783a7 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:18.714714 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-49907eb9-70f6-473d-8494-05e0bf8e6c53 None None] MFA Rules not processed for user `719e4bf834d6490b96066e55a26fb159`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:18.716140 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-49907eb9-70f6-473d-8494-05e0bf8e6c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:18.730908 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 763/1528] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:18.741764 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1efb10-03c9-453d-9efa-ae001e8783a7 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:18.753470 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1efb10-03c9-453d-9efa-ae001e8783a7 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:18.759188 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3edf3d-4f9f-4180-bc43-ccf3c9968b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:18.760108 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3edf3d-4f9f-4180-bc43-ccf3c9968b50 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:18.760225 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3edf3d-4f9f-4180-bc43-ccf3c9968b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:18.760698 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3edf3d-4f9f-4180-bc43-ccf3c9968b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:18.762399 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3edf3d-4f9f-4180-bc43-ccf3c9968b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:18.764253 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3edf3d-4f9f-4180-bc43-ccf3c9968b50 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:18.792556 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 764/1529] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:18.815852 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3edf3d-4f9f-4180-bc43-ccf3c9968b50 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:18.872050 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3edf3d-4f9f-4180-bc43-ccf3c9968b50 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:18.896620 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5217e-e39a-4090-9809-f6838090695e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:18.897313 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5217e-e39a-4090-9809-f6838090695e admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:18.898237 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5217e-e39a-4090-9809-f6838090695e admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:18.898515 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5217e-e39a-4090-9809-f6838090695e admin admin] PATH_INFO: `/v3/projects/1eaa45e3c2144058816e4866ed84c263/users/0c5b4232fcbe4c7ebb7e0ffc97ebe135/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:18.936549 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5217e-e39a-4090-9809-f6838090695e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eaa45e3c2144058816e4866ed84c263, user_id=0c5b4232fcbe4c7ebb7e0ffc97ebe135, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:18.940560 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 766/1530] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Oct 27 13:25:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:25:18.941317 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5217e-e39a-4090-9809-f6838090695e admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:18.941884 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49907eb9-70f6-473d-8494-05e0bf8e6c53 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:18.970914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49907eb9-70f6-473d-8494-05e0bf8e6c53 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:19.007111 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 765/1531] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:18 2022] PUT /identity/v3/projects/1eaa45e3c2144058816e4866ed84c263/users/0c5b4232fcbe4c7ebb7e0ffc97ebe135/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:19.017738 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf1775-45b9-436f-870a-0ad5b546d489 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:19.018332 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf1775-45b9-436f-870a-0ad5b546d489 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:19.018751 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf1775-45b9-436f-870a-0ad5b546d489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:19.063470 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:19.067574 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-cadf1775-45b9-436f-870a-0ad5b546d489 None None] MFA Rules not processed for user `0c5b4232fcbe4c7ebb7e0ffc97ebe135`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:19.069127 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-cadf1775-45b9-436f-870a-0ad5b546d489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:19.084163 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2461d-b43f-46f4-a765-12e838e82a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:19.084823 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2461d-b43f-46f4-a765-12e838e82a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:19.085181 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2461d-b43f-46f4-a765-12e838e82a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:19.085375 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2461d-b43f-46f4-a765-12e838e82a2a admin admin] PATH_INFO: `/v3/users/5fda228367234d908e83c8d37c94fa73` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:19.091655 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced2461d-b43f-46f4-a765-12e838e82a2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fda228367234d908e83c8d37c94fa73)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:19.093840 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced2461d-b43f-46f4-a765-12e838e82a2a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:19.180908 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ced2461d-b43f-46f4-a765-12e838e82a2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fda228367234d908e83c8d37c94fa73'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:19.181693 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ced2461d-b43f-46f4-a765-12e838e82a2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fda228367234d908e83c8d37c94fa73'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:19.191354 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ced2461d-b43f-46f4-a765-12e838e82a2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fda228367234d908e83c8d37c94fa73'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:19.207142 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ced2461d-b43f-46f4-a765-12e838e82a2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fda228367234d908e83c8d37c94fa73'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:19.207843 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ced2461d-b43f-46f4-a765-12e838e82a2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fda228367234d908e83c8d37c94fa73'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:19.218977 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 766/1532] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:19.230591 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf1775-45b9-436f-870a-0ad5b546d489 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:19.232028 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-cadf1775-45b9-436f-870a-0ad5b546d489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:19.252209 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 767/1533] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:25:18 2022] DELETE /identity/v3/users/5fda228367234d908e83c8d37c94fa73 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:19.254728 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda3593-64ea-4fc0-971e-b9c456d9ebda None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:19.255019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda3593-64ea-4fc0-971e-b9c456d9ebda None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:19.255301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda3593-64ea-4fc0-971e-b9c456d9ebda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:19.304263 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-9dda3593-64ea-4fc0-971e-b9c456d9ebda None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:19.306019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9dda3593-64ea-4fc0-971e-b9c456d9ebda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:19.322463 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:19.368350 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf1775-45b9-436f-870a-0ad5b546d489 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:19.406682 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 768/1534] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:19.407276 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda3593-64ea-4fc0-971e-b9c456d9ebda None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:19.409205 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9dda3593-64ea-4fc0-971e-b9c456d9ebda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:19.422767 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda3593-64ea-4fc0-971e-b9c456d9ebda None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:19.432003 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b72ac5-5b7c-4a43-8007-e77ca69d2c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:19.432662 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b72ac5-5b7c-4a43-8007-e77ca69d2c83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:19.432939 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b72ac5-5b7c-4a43-8007-e77ca69d2c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:19.433213 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b72ac5-5b7c-4a43-8007-e77ca69d2c83 admin admin] PATH_INFO: `/v3/users/c518619f83244221a6b56ce472563b02` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:19.435879 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b72ac5-5b7c-4a43-8007-e77ca69d2c83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c518619f83244221a6b56ce472563b02)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:19.442783 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b72ac5-5b7c-4a43-8007-e77ca69d2c83 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:19.504546 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d3e150-fec9-4f23-b597-5609346353b1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2298dbfcf7b74668902781401f77215e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:19.505282 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3e150-fec9-4f23-b597-5609346353b1 service glance] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:19.505685 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3e150-fec9-4f23-b597-5609346353b1 service glance] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:19.506094 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3e150-fec9-4f23-b597-5609346353b1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:19.539860 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-05b72ac5-5b7c-4a43-8007-e77ca69d2c83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c518619f83244221a6b56ce472563b02'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:19.541344 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-05b72ac5-5b7c-4a43-8007-e77ca69d2c83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c518619f83244221a6b56ce472563b02'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:19.550528 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-05b72ac5-5b7c-4a43-8007-e77ca69d2c83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c518619f83244221a6b56ce472563b02'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:19.566188 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:19.567739 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-05b72ac5-5b7c-4a43-8007-e77ca69d2c83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c518619f83244221a6b56ce472563b02'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:19.568806 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-05b72ac5-5b7c-4a43-8007-e77ca69d2c83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c518619f83244221a6b56ce472563b02'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:19.594786 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 769/1535] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:25:19 2022] DELETE /identity/v3/users/c518619f83244221a6b56ce472563b02 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:19.595888 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b72ac5-5b7c-4a43-8007-e77ca69d2c83 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:19.598640 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-05b72ac5-5b7c-4a43-8007-e77ca69d2c83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:19.642797 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d3e150-fec9-4f23-b597-5609346353b1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:19.644267 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d3e150-fec9-4f23-b597-5609346353b1 service glance] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:19.658290 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 767/1536] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:25:19.669680 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d3e150-fec9-4f23-b597-5609346353b1 service glance] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:19.679874 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-78d3e150-fec9-4f23-b597-5609346353b1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:19.725720 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b72ac5-5b7c-4a43-8007-e77ca69d2c83 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:19.744646 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537804d5-9722-4b36-81fc-d0e96608d28e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:19.751011 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537804d5-9722-4b36-81fc-d0e96608d28e service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:19.751312 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537804d5-9722-4b36-81fc-d0e96608d28e service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:19.754088 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537804d5-9722-4b36-81fc-d0e96608d28e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:19.759076 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-537804d5-9722-4b36-81fc-d0e96608d28e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:19.884628 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d3e150-fec9-4f23-b597-5609346353b1 service glance] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:19.962881 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537804d5-9722-4b36-81fc-d0e96608d28e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:19.964987 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537804d5-9722-4b36-81fc-d0e96608d28e service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:19.982046 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:19.998745 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 770/1537] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:25:20.002349 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18ca41-f806-4855-b9b6-e7f67faa1fca None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:20.002592 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18ca41-f806-4855-b9b6-e7f67faa1fca None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:20.002873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18ca41-f806-4855-b9b6-e7f67faa1fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:20.055706 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-8a18ca41-f806-4855-b9b6-e7f67faa1fca None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:20.056980 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8a18ca41-f806-4855-b9b6-e7f67faa1fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:20.061369 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e139b-577b-4d42-9a31-0c4739a2fee4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719e4bf834d6490b96066e55a26fb159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:20.062043 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e139b-577b-4d42-9a31-0c4739a2fee4 service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:20.062322 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e139b-577b-4d42-9a31-0c4739a2fee4 service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:20.062595 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e139b-577b-4d42-9a31-0c4739a2fee4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:20.076788 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-032e139b-577b-4d42-9a31-0c4739a2fee4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:20.103462 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 771/1538] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:20.118922 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18ca41-f806-4855-b9b6-e7f67faa1fca None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:20.121798 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8a18ca41-f806-4855-b9b6-e7f67faa1fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:20.126664 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032e139b-577b-4d42-9a31-0c4739a2fee4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:20.130959 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032e139b-577b-4d42-9a31-0c4739a2fee4 service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:20.145819 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 768/1539] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:25:20.149777 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18ca41-f806-4855-b9b6-e7f67faa1fca None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:20.163597 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49765038-88bb-465e-a0dc-c9a0a5c4ccf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:20.163597 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49765038-88bb-465e-a0dc-c9a0a5c4ccf4 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:20.163597 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49765038-88bb-465e-a0dc-c9a0a5c4ccf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:20.163597 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49765038-88bb-465e-a0dc-c9a0a5c4ccf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:20.188413 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49765038-88bb-465e-a0dc-c9a0a5c4ccf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:20.189689 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49765038-88bb-465e-a0dc-c9a0a5c4ccf4 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:20.215403 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 772/1540] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:25:20.752737 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e139b-577b-4d42-9a31-0c4739a2fee4 service nova] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:20.754404 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-032e139b-577b-4d42-9a31-0c4739a2fee4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:20.788419 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e139b-577b-4d42-9a31-0c4739a2fee4 service nova] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:20.797560 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd7f71-dc1a-48a5-8f98-9b3eb2dd0d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:20.798241 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd7f71-dc1a-48a5-8f98-9b3eb2dd0d98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:20.798529 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd7f71-dc1a-48a5-8f98-9b3eb2dd0d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:20.798800 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd7f71-dc1a-48a5-8f98-9b3eb2dd0d98 admin admin] PATH_INFO: `/v3/projects/c7bcef4a1c5144848ce985de1f9b8018` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:20.800258 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd7f71-dc1a-48a5-8f98-9b3eb2dd0d98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7bcef4a1c5144848ce985de1f9b8018)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:20.802233 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd7f71-dc1a-48a5-8f98-9b3eb2dd0d98 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:20.919225 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-49bd7f71-dc1a-48a5-8f98-9b3eb2dd0d98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7bcef4a1c5144848ce985de1f9b8018', 'request_id': 'req-49bd7f71-dc1a-48a5-8f98-9b3eb2dd0d98'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:20.931190 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-49bd7f71-dc1a-48a5-8f98-9b3eb2dd0d98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7bcef4a1c5144848ce985de1f9b8018', 'request_id': 'req-49bd7f71-dc1a-48a5-8f98-9b3eb2dd0d98'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:20.938625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-49bd7f71-dc1a-48a5-8f98-9b3eb2dd0d98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7bcef4a1c5144848ce985de1f9b8018', 'request_id': 'req-49bd7f71-dc1a-48a5-8f98-9b3eb2dd0d98'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:20.949866 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-49bd7f71-dc1a-48a5-8f98-9b3eb2dd0d98 admin admin] The token cache is being invalidate because project c7bcef4a1c5144848ce985de1f9b8018 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:25:20.950233 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-49bd7f71-dc1a-48a5-8f98-9b3eb2dd0d98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:20.951127 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-49bd7f71-dc1a-48a5-8f98-9b3eb2dd0d98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:20.956373 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 769/1541] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:25:20 2022] DELETE /identity/v3/projects/c7bcef4a1c5144848ce985de1f9b8018 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:20.956952 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49765038-88bb-465e-a0dc-c9a0a5c4ccf4 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:20.967653 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49765038-88bb-465e-a0dc-c9a0a5c4ccf4 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:21.091805 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a47f3a-9ed1-466f-a0bc-a7fa0656d375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:21.093561 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a47f3a-9ed1-466f-a0bc-a7fa0656d375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:21.094048 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a47f3a-9ed1-466f-a0bc-a7fa0656d375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:21.094917 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a47f3a-9ed1-466f-a0bc-a7fa0656d375 admin admin] PATH_INFO: `/v3/users/a09c376b345149d99c92a00b6e9c4b23` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:21.096624 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a47f3a-9ed1-466f-a0bc-a7fa0656d375 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a09c376b345149d99c92a00b6e9c4b23)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:21.103705 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a47f3a-9ed1-466f-a0bc-a7fa0656d375 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:21.133590 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:21.173814 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c4a47f3a-9ed1-466f-a0bc-a7fa0656d375 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a09c376b345149d99c92a00b6e9c4b23'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:21.174898 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c4a47f3a-9ed1-466f-a0bc-a7fa0656d375 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a09c376b345149d99c92a00b6e9c4b23'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:21.187104 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c4a47f3a-9ed1-466f-a0bc-a7fa0656d375 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a09c376b345149d99c92a00b6e9c4b23'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:21.210190 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c4a47f3a-9ed1-466f-a0bc-a7fa0656d375 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a09c376b345149d99c92a00b6e9c4b23'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:21.210190 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c4a47f3a-9ed1-466f-a0bc-a7fa0656d375 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a09c376b345149d99c92a00b6e9c4b23'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:21.216095 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd7f71-dc1a-48a5-8f98-9b3eb2dd0d98 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:21.218083 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-49bd7f71-dc1a-48a5-8f98-9b3eb2dd0d98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:21.233566 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd7f71-dc1a-48a5-8f98-9b3eb2dd0d98 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:21.234978 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 773/1542] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:25:20 2022] DELETE /identity/v3/users/a09c376b345149d99c92a00b6e9c4b23 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:21.315508 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a285bc-8f13-42f9-8b32-c8bae56f3f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:21.316266 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a285bc-8f13-42f9-8b32-c8bae56f3f47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:21.316666 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a285bc-8f13-42f9-8b32-c8bae56f3f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:21.317243 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a285bc-8f13-42f9-8b32-c8bae56f3f47 admin admin] PATH_INFO: `/v3/projects/1b94e4f6c31743f09ef70d321c245d00` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:21.318754 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a285bc-8f13-42f9-8b32-c8bae56f3f47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b94e4f6c31743f09ef70d321c245d00)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:21.321137 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a285bc-8f13-42f9-8b32-c8bae56f3f47 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:21.413606 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:21.422127 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-97a285bc-8f13-42f9-8b32-c8bae56f3f47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b94e4f6c31743f09ef70d321c245d00', 'request_id': 'req-97a285bc-8f13-42f9-8b32-c8bae56f3f47'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:21.438449 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-97a285bc-8f13-42f9-8b32-c8bae56f3f47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b94e4f6c31743f09ef70d321c245d00', 'request_id': 'req-97a285bc-8f13-42f9-8b32-c8bae56f3f47'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:21.451591 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-97a285bc-8f13-42f9-8b32-c8bae56f3f47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b94e4f6c31743f09ef70d321c245d00', 'request_id': 'req-97a285bc-8f13-42f9-8b32-c8bae56f3f47'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:21.476207 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-97a285bc-8f13-42f9-8b32-c8bae56f3f47 admin admin] The token cache is being invalidate because project 1b94e4f6c31743f09ef70d321c245d00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:25:21.476960 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-97a285bc-8f13-42f9-8b32-c8bae56f3f47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:21.477665 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-97a285bc-8f13-42f9-8b32-c8bae56f3f47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:21.479667 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 770/1543] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:25:21 2022] DELETE /identity/v3/projects/1b94e4f6c31743f09ef70d321c245d00 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:21.490656 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a47f3a-9ed1-466f-a0bc-a7fa0656d375 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:21.490656 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c4a47f3a-9ed1-466f-a0bc-a7fa0656d375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:21.501354 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a47f3a-9ed1-466f-a0bc-a7fa0656d375 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:21.627596 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0429031-d7f8-493a-98cc-dcf755ebedfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:21.628301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0429031-d7f8-493a-98cc-dcf755ebedfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:21.628621 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0429031-d7f8-493a-98cc-dcf755ebedfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:21.628957 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0429031-d7f8-493a-98cc-dcf755ebedfe admin admin] PATH_INFO: `/v3/users/ce68727ee5944d399aad70dece8aea07` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:21.630447 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0429031-d7f8-493a-98cc-dcf755ebedfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce68727ee5944d399aad70dece8aea07)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:21.632646 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0429031-d7f8-493a-98cc-dcf755ebedfe admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:21.651293 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a285bc-8f13-42f9-8b32-c8bae56f3f47 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:21.652914 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-97a285bc-8f13-42f9-8b32-c8bae56f3f47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:21.668590 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a285bc-8f13-42f9-8b32-c8bae56f3f47 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:21.673704 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2495903b-8b52-4a64-9884-2badd4567f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:21.674447 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495903b-8b52-4a64-9884-2badd4567f9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:21.674782 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495903b-8b52-4a64-9884-2badd4567f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:21.675126 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495903b-8b52-4a64-9884-2badd4567f9d admin admin] PATH_INFO: `/v3/projects/070b448957a04cab95aeb822ca109bec` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:21.676308 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2495903b-8b52-4a64-9884-2badd4567f9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=070b448957a04cab95aeb822ca109bec)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:21.678676 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2495903b-8b52-4a64-9884-2badd4567f9d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:21.685988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f0429031-d7f8-493a-98cc-dcf755ebedfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce68727ee5944d399aad70dece8aea07'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:21.686638 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f0429031-d7f8-493a-98cc-dcf755ebedfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce68727ee5944d399aad70dece8aea07'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:21.694010 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f0429031-d7f8-493a-98cc-dcf755ebedfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce68727ee5944d399aad70dece8aea07'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:21.706873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f0429031-d7f8-493a-98cc-dcf755ebedfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce68727ee5944d399aad70dece8aea07'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:21.707667 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f0429031-d7f8-493a-98cc-dcf755ebedfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce68727ee5944d399aad70dece8aea07'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:21.723895 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 774/1544] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:25:21 2022] DELETE /identity/v3/users/ce68727ee5944d399aad70dece8aea07 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:21.738060 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2495903b-8b52-4a64-9884-2badd4567f9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '070b448957a04cab95aeb822ca109bec', 'request_id': 'req-2495903b-8b52-4a64-9884-2badd4567f9d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:21.749552 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2495903b-8b52-4a64-9884-2badd4567f9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '070b448957a04cab95aeb822ca109bec', 'request_id': 'req-2495903b-8b52-4a64-9884-2badd4567f9d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:21.772400 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2495903b-8b52-4a64-9884-2badd4567f9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '070b448957a04cab95aeb822ca109bec', 'request_id': 'req-2495903b-8b52-4a64-9884-2badd4567f9d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:21.772400 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2495903b-8b52-4a64-9884-2badd4567f9d admin admin] The token cache is being invalidate because project 070b448957a04cab95aeb822ca109bec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:25:21.772400 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2495903b-8b52-4a64-9884-2badd4567f9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:21.773086 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2495903b-8b52-4a64-9884-2badd4567f9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:21.774636 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 771/1545] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:25:21 2022] DELETE /identity/v3/projects/070b448957a04cab95aeb822ca109bec => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:25:21.780207 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d9b6b-350c-4827-9edb-ee0ea5edac0e None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:21.781623 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d9b6b-350c-4827-9edb-ee0ea5edac0e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:21.781623 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d9b6b-350c-4827-9edb-ee0ea5edac0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:21.811301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-465d9b6b-350c-4827-9edb-ee0ea5edac0e None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:21.812599 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-465d9b6b-350c-4827-9edb-ee0ea5edac0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:21.826473 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:21.894152 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 775/1546] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:21.902520 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712090b8-3cf2-41bd-bac1-9a6100557f17 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:21.903019 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712090b8-3cf2-41bd-bac1-9a6100557f17 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:21.903397 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712090b8-3cf2-41bd-bac1-9a6100557f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:21.939718 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-712090b8-3cf2-41bd-bac1-9a6100557f17 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:21.941264 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-712090b8-3cf2-41bd-bac1-9a6100557f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:21.952154 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 772/1547] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:21.956757 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d9b6b-350c-4827-9edb-ee0ea5edac0e None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:21.966708 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d9b6b-350c-4827-9edb-ee0ea5edac0e None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:21.972046 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76516e-2cef-40ad-80b2-688a69915474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:21.972747 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76516e-2cef-40ad-80b2-688a69915474 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:21.972967 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76516e-2cef-40ad-80b2-688a69915474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:21.973217 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76516e-2cef-40ad-80b2-688a69915474 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:21.973926 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76516e-2cef-40ad-80b2-688a69915474 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:25:21.974210 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76516e-2cef-40ad-80b2-688a69915474 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:21.975863 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76516e-2cef-40ad-80b2-688a69915474 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:21.989749 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 776/1548] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:25:21.994237 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712090b8-3cf2-41bd-bac1-9a6100557f17 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:22.015135 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712090b8-3cf2-41bd-bac1-9a6100557f17 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:22.029208 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe97b40-7e95-4021-9c92-e7cb98a4e01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:22.029208 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe97b40-7e95-4021-9c92-e7cb98a4e01b admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:22.029208 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe97b40-7e95-4021-9c92-e7cb98a4e01b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:22.029208 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe97b40-7e95-4021-9c92-e7cb98a4e01b admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:22.029652 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe97b40-7e95-4021-9c92-e7cb98a4e01b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:22.029652 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe97b40-7e95-4021-9c92-e7cb98a4e01b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:22.044598 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76516e-2cef-40ad-80b2-688a69915474 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:22.048415 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0b76516e-2cef-40ad-80b2-688a69915474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:22.094578 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76516e-2cef-40ad-80b2-688a69915474 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:22.105781 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 773/1549] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:25:21 2022] POST /identity/v3/projects => generated 365 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:22.110994 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe97b40-7e95-4021-9c92-e7cb98a4e01b admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:22.114948 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd98c9-b27e-4a15-9bd8-16bc50c473cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:22.115771 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd98c9-b27e-4a15-9bd8-16bc50c473cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:22.116078 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd98c9-b27e-4a15-9bd8-16bc50c473cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:22.116382 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd98c9-b27e-4a15-9bd8-16bc50c473cb admin admin] PATH_INFO: `/v3/projects/4bad739f929645e2b8d1679464d76b2c` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:22.121334 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd98c9-b27e-4a15-9bd8-16bc50c473cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bad739f929645e2b8d1679464d76b2c)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:22.124602 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd98c9-b27e-4a15-9bd8-16bc50c473cb admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:22.266690 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fbfd98c9-b27e-4a15-9bd8-16bc50c473cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bad739f929645e2b8d1679464d76b2c', 'request_id': 'req-fbfd98c9-b27e-4a15-9bd8-16bc50c473cb'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:22.274060 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fbfd98c9-b27e-4a15-9bd8-16bc50c473cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bad739f929645e2b8d1679464d76b2c', 'request_id': 'req-fbfd98c9-b27e-4a15-9bd8-16bc50c473cb'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:22.292349 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fbfd98c9-b27e-4a15-9bd8-16bc50c473cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bad739f929645e2b8d1679464d76b2c', 'request_id': 'req-fbfd98c9-b27e-4a15-9bd8-16bc50c473cb'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:22.314196 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe97b40-7e95-4021-9c92-e7cb98a4e01b admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:22.322441 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fbfd98c9-b27e-4a15-9bd8-16bc50c473cb admin admin] The token cache is being invalidate because project 4bad739f929645e2b8d1679464d76b2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:25:22.322888 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fbfd98c9-b27e-4a15-9bd8-16bc50c473cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:22.324293 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fbfd98c9-b27e-4a15-9bd8-16bc50c473cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:22.329043 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 777/1550] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:25:22 2022] DELETE /identity/v3/projects/4bad739f929645e2b8d1679464d76b2c => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:25:22.334821 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d180ca-eb0f-44bc-b075-0cc7c169294d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:22.335722 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d180ca-eb0f-44bc-b075-0cc7c169294d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:22.336099 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d180ca-eb0f-44bc-b075-0cc7c169294d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:22.384875 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-a1d180ca-eb0f-44bc-b075-0cc7c169294d None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:22.384875 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a1d180ca-eb0f-44bc-b075-0cc7c169294d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:22.426183 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:22.496128 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75249c04-ad18-465b-9ec4-cfc7261a1384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:22.499262 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75249c04-ad18-465b-9ec4-cfc7261a1384 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:22.499554 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75249c04-ad18-465b-9ec4-cfc7261a1384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:22.499837 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75249c04-ad18-465b-9ec4-cfc7261a1384 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:22.500507 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75249c04-ad18-465b-9ec4-cfc7261a1384 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:22.502534 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75249c04-ad18-465b-9ec4-cfc7261a1384 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:22.544509 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 774/1551] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:25:22 2022] POST /identity/v3/users => generated 283 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:22.548622 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75249c04-ad18-465b-9ec4-cfc7261a1384 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:22.556654 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-75249c04-ad18-465b-9ec4-cfc7261a1384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:22.583917 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75249c04-ad18-465b-9ec4-cfc7261a1384 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:22.590882 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 778/1552] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:22.610862 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6ec32-4b0c-4110-b288-511dd46dd0ad None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:22.611158 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6ec32-4b0c-4110-b288-511dd46dd0ad None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:22.615537 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6ec32-4b0c-4110-b288-511dd46dd0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:22.623131 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735c10b-4137-424f-aa93-a8e7e5090f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:22.626619 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735c10b-4137-424f-aa93-a8e7e5090f5b admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:22.626922 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735c10b-4137-424f-aa93-a8e7e5090f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:22.627207 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735c10b-4137-424f-aa93-a8e7e5090f5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:22.627894 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c735c10b-4137-424f-aa93-a8e7e5090f5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:22.629566 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c735c10b-4137-424f-aa93-a8e7e5090f5b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:22.673408 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 775/1553] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 13:25:22.674941 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735c10b-4137-424f-aa93-a8e7e5090f5b admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:22.701140 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735c10b-4137-424f-aa93-a8e7e5090f5b admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:22.707539 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ab0f5-fecb-4f39-9474-b3556a8c6390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:22.708168 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ab0f5-fecb-4f39-9474-b3556a8c6390 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:22.708598 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ab0f5-fecb-4f39-9474-b3556a8c6390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:22.708947 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ab0f5-fecb-4f39-9474-b3556a8c6390 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:22.709796 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ab0f5-fecb-4f39-9474-b3556a8c6390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:22.712883 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ab0f5-fecb-4f39-9474-b3556a8c6390 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:22.719426 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-a8e6ec32-4b0c-4110-b288-511dd46dd0ad None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:22.725761 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a8e6ec32-4b0c-4110-b288-511dd46dd0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:22.731070 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 776/1554] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:22.732598 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ab0f5-fecb-4f39-9474-b3556a8c6390 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:22.744825 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ab0f5-fecb-4f39-9474-b3556a8c6390 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:22.750304 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155f748-407a-4d2f-bf02-a9e61e204a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:22.751512 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155f748-407a-4d2f-bf02-a9e61e204a95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:22.751832 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155f748-407a-4d2f-bf02-a9e61e204a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:22.752112 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155f748-407a-4d2f-bf02-a9e61e204a95 admin admin] PATH_INFO: `/v3/projects/8bae221caae946d8b2c65f74f7c03169/users/d098fb50f101453b8e8569a818238ed1/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:22.754694 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 779/1555] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:22.755690 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6ec32-4b0c-4110-b288-511dd46dd0ad None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:22.794823 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a155f748-407a-4d2f-bf02-a9e61e204a95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bae221caae946d8b2c65f74f7c03169, user_id=d098fb50f101453b8e8569a818238ed1, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:22.800419 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6ec32-4b0c-4110-b288-511dd46dd0ad None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:22.800888 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a155f748-407a-4d2f-bf02-a9e61e204a95 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:22.819245 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 777/1556] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:22 2022] PUT /identity/v3/projects/8bae221caae946d8b2c65f74f7c03169/users/d098fb50f101453b8e8569a818238ed1/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:22.836318 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb70a8-f424-48f9-ae13-291528787bd0 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:22.836810 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb70a8-f424-48f9-ae13-291528787bd0 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:22.837155 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb70a8-f424-48f9-ae13-291528787bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:22.850554 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca9f82c-5f85-4b31-9509-e76f532d39b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:22.853455 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9f82c-5f85-4b31-9509-e76f532d39b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:22.855442 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9f82c-5f85-4b31-9509-e76f532d39b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:22.855717 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9f82c-5f85-4b31-9509-e76f532d39b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:22.856395 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca9f82c-5f85-4b31-9509-e76f532d39b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:25:22.856705 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca9f82c-5f85-4b31-9509-e76f532d39b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:22.858357 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca9f82c-5f85-4b31-9509-e76f532d39b7 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:22.898085 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-79fb70a8-f424-48f9-ae13-291528787bd0 None None] MFA Rules not processed for user `d098fb50f101453b8e8569a818238ed1`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:22.902711 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-79fb70a8-f424-48f9-ae13-291528787bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:22.920816 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 780/1557] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:25:22.923731 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca9f82c-5f85-4b31-9509-e76f532d39b7 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:22.958045 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca9f82c-5f85-4b31-9509-e76f532d39b7 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:22.976276 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:23.080362 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 778/1558] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:23.081395 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5c367-acaf-4f54-abdd-ca2f92b573b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:23.082061 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5c367-acaf-4f54-abdd-ca2f92b573b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:23.082341 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5c367-acaf-4f54-abdd-ca2f92b573b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:23.082610 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5c367-acaf-4f54-abdd-ca2f92b573b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:23.083252 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5c367-acaf-4f54-abdd-ca2f92b573b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:23.085337 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5c367-acaf-4f54-abdd-ca2f92b573b9 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:23.085775 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb70a8-f424-48f9-ae13-291528787bd0 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:23.116949 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb70a8-f424-48f9-ae13-291528787bd0 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:23.122614 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778a5d3-d51c-4d1b-bae3-04670b27c2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:23.123251 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778a5d3-d51c-4d1b-bae3-04670b27c2fd admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:23.123517 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778a5d3-d51c-4d1b-bae3-04670b27c2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:23.123962 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778a5d3-d51c-4d1b-bae3-04670b27c2fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:23.124463 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a778a5d3-d51c-4d1b-bae3-04670b27c2fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:23.126513 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a778a5d3-d51c-4d1b-bae3-04670b27c2fd admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:23.131617 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 781/1559] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:25:22 2022] POST /identity/v3/projects => generated 385 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:23.132676 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5c367-acaf-4f54-abdd-ca2f92b573b9 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:23.171970 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 779/1560] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:25:23 2022] POST /identity/v3/projects => generated 365 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:23.172969 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778a5d3-d51c-4d1b-bae3-04670b27c2fd admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:23.268095 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5c367-acaf-4f54-abdd-ca2f92b573b9 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:23.310892 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:23.366203 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778a5d3-d51c-4d1b-bae3-04670b27c2fd admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:23.379926 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a18fe1f-fd97-40b9-9b83-f39c7b2c80f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:23.379926 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18fe1f-fd97-40b9-9b83-f39c7b2c80f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:23.380247 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18fe1f-fd97-40b9-9b83-f39c7b2c80f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:23.382834 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18fe1f-fd97-40b9-9b83-f39c7b2c80f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:23.383183 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a18fe1f-fd97-40b9-9b83-f39c7b2c80f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:23.389885 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a18fe1f-fd97-40b9-9b83-f39c7b2c80f7 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:23.463585 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b65bf0e-3a75-4acd-ba84-a66b12d11ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:23.466470 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65bf0e-3a75-4acd-ba84-a66b12d11ce3 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:23.466776 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65bf0e-3a75-4acd-ba84-a66b12d11ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:23.467189 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65bf0e-3a75-4acd-ba84-a66b12d11ce3 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:23.471550 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 780/1561] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:25:23 2022] POST /identity/v3/users => generated 289 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:23.471700 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b65bf0e-3a75-4acd-ba84-a66b12d11ce3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:23.472751 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a18fe1f-fd97-40b9-9b83-f39c7b2c80f7 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:23.489415 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b65bf0e-3a75-4acd-ba84-a66b12d11ce3 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:23.518005 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a18fe1f-fd97-40b9-9b83-f39c7b2c80f7 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:23.526115 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbddfb-bf0e-4eea-a83b-ba8750f751fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:23.527082 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbddfb-bf0e-4eea-a83b-ba8750f751fb admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:23.530827 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbddfb-bf0e-4eea-a83b-ba8750f751fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:23.531647 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbddfb-bf0e-4eea-a83b-ba8750f751fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:23.534248 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dbddfb-bf0e-4eea-a83b-ba8750f751fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:23.536760 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dbddfb-bf0e-4eea-a83b-ba8750f751fb admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:23.554897 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 782/1562] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:25:23 2022] POST /identity/v3/users => generated 293 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:23.559684 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b65bf0e-3a75-4acd-ba84-a66b12d11ce3 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:23.564738 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 781/1563] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:23.571499 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbddfb-bf0e-4eea-a83b-ba8750f751fb admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:23.575693 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b65bf0e-3a75-4acd-ba84-a66b12d11ce3 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:23.582913 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52adc84c-80fa-4675-afd4-9d0df1e79d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:23.583657 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adc84c-80fa-4675-afd4-9d0df1e79d6f admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:23.583934 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adc84c-80fa-4675-afd4-9d0df1e79d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:23.584258 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adc84c-80fa-4675-afd4-9d0df1e79d6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:23.585006 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52adc84c-80fa-4675-afd4-9d0df1e79d6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:23.586937 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52adc84c-80fa-4675-afd4-9d0df1e79d6f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:23.595104 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbddfb-bf0e-4eea-a83b-ba8750f751fb admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:23.606081 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c4450-52bb-4031-9767-1fca41f81252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:23.606889 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c4450-52bb-4031-9767-1fca41f81252 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:23.607154 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c4450-52bb-4031-9767-1fca41f81252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:23.607428 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c4450-52bb-4031-9767-1fca41f81252 admin admin] PATH_INFO: `/v3/projects/eec18bdc527b4d77aff9d15c283fa645/users/2001275c2bdc425cb4988503fbce4b3e/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:23.612251 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 783/1564] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 13:25:23.614274 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52adc84c-80fa-4675-afd4-9d0df1e79d6f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:23.635325 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52adc84c-80fa-4675-afd4-9d0df1e79d6f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:23.637063 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c4450-52bb-4031-9767-1fca41f81252 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eec18bdc527b4d77aff9d15c283fa645, user_id=2001275c2bdc425cb4988503fbce4b3e, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:23.640929 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c4450-52bb-4031-9767-1fca41f81252 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:23.645993 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a3bbc-d68c-415b-bdb6-8d9d73a933dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:23.657766 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a3bbc-d68c-415b-bdb6-8d9d73a933dc admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:23.661483 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a3bbc-d68c-415b-bdb6-8d9d73a933dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:23.661973 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a3bbc-d68c-415b-bdb6-8d9d73a933dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:23.663715 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a3bbc-d68c-415b-bdb6-8d9d73a933dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:23.669097 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a3bbc-d68c-415b-bdb6-8d9d73a933dc admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:23.692053 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 782/1565] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:23 2022] PUT /identity/v3/projects/eec18bdc527b4d77aff9d15c283fa645/users/2001275c2bdc425cb4988503fbce4b3e/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:23.694071 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 784/1566] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:23.694185 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c4450-52bb-4031-9767-1fca41f81252 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:23.695538 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a3bbc-d68c-415b-bdb6-8d9d73a933dc admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:23.712252 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a3bbc-d68c-415b-bdb6-8d9d73a933dc admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:23.724153 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:23.786651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c4450-52bb-4031-9767-1fca41f81252 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:23.792876 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f2c30-0b8c-4ef9-9961-2464adffb5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:23.793711 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f2c30-0b8c-4ef9-9961-2464adffb5f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:23.794232 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f2c30-0b8c-4ef9-9961-2464adffb5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:23.794672 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f2c30-0b8c-4ef9-9961-2464adffb5f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:23.795556 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f2c30-0b8c-4ef9-9961-2464adffb5f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:23.795883 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ff332-1d70-4b83-a983-de32d5e6a8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:23.796576 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ff332-1d70-4b83-a983-de32d5e6a8d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:23.796853 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ff332-1d70-4b83-a983-de32d5e6a8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:23.797122 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ff332-1d70-4b83-a983-de32d5e6a8d0 admin admin] PATH_INFO: `/v3/projects/9bdb0b8af39146528ef6ce73a38a2be5/users/868444b0ba564c7aabc2f154e8ffcb3d/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:23.797681 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f2c30-0b8c-4ef9-9961-2464adffb5f9 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:23.820698 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 785/1567] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:23.821576 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f2c30-0b8c-4ef9-9961-2464adffb5f9 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:23.834052 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f2c30-0b8c-4ef9-9961-2464adffb5f9 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:23.836920 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ff332-1d70-4b83-a983-de32d5e6a8d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bdb0b8af39146528ef6ce73a38a2be5, user_id=868444b0ba564c7aabc2f154e8ffcb3d, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:23.839196 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29db125-61ca-4535-8f0a-c0cb2b2d21a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:23.839737 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ff332-1d70-4b83-a983-de32d5e6a8d0 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:23.840138 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29db125-61ca-4535-8f0a-c0cb2b2d21a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:23.840506 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29db125-61ca-4535-8f0a-c0cb2b2d21a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:23.840872 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29db125-61ca-4535-8f0a-c0cb2b2d21a0 admin admin] PATH_INFO: `/v3/projects/eec18bdc527b4d77aff9d15c283fa645/users/2001275c2bdc425cb4988503fbce4b3e/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:23.846429 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29db125-61ca-4535-8f0a-c0cb2b2d21a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eec18bdc527b4d77aff9d15c283fa645, user_id=2001275c2bdc425cb4988503fbce4b3e, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:23.849350 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29db125-61ca-4535-8f0a-c0cb2b2d21a0 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:23.855998 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 783/1568] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:23 2022] PUT /identity/v3/projects/9bdb0b8af39146528ef6ce73a38a2be5/users/868444b0ba564c7aabc2f154e8ffcb3d/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:25:23.864086 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 786/1569] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:23 2022] PUT /identity/v3/projects/eec18bdc527b4d77aff9d15c283fa645/users/2001275c2bdc425cb4988503fbce4b3e/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:25:23.866264 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626894d3-f517-4206-8359-1a44cacf42b5 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:23.866543 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626894d3-f517-4206-8359-1a44cacf42b5 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:23.866815 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626894d3-f517-4206-8359-1a44cacf42b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:23.876088 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f3110-d304-4f9a-baa5-4d7f969bbe23 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:23.876369 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f3110-d304-4f9a-baa5-4d7f969bbe23 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:23.876639 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f3110-d304-4f9a-baa5-4d7f969bbe23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:23.907431 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-292f3110-d304-4f9a-baa5-4d7f969bbe23 None None] MFA Rules not processed for user `2001275c2bdc425cb4988503fbce4b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:23.908648 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-292f3110-d304-4f9a-baa5-4d7f969bbe23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:23.912527 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-626894d3-f517-4206-8359-1a44cacf42b5 None None] MFA Rules not processed for user `868444b0ba564c7aabc2f154e8ffcb3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:23.914165 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-626894d3-f517-4206-8359-1a44cacf42b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:23.988137 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 784/1570] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:23.991486 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 787/1571] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:23 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:25:23.992879 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626894d3-f517-4206-8359-1a44cacf42b5 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:24.002708 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f3110-d304-4f9a-baa5-4d7f969bbe23 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:24.004390 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-292f3110-d304-4f9a-baa5-4d7f969bbe23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:24.008296 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:24.067769 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626894d3-f517-4206-8359-1a44cacf42b5 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:24.072443 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd40bd-856e-4671-bfb2-4b23bb2125bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:24.072980 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd40bd-856e-4671-bfb2-4b23bb2125bf admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:24.073369 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd40bd-856e-4671-bfb2-4b23bb2125bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:24.073683 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd40bd-856e-4671-bfb2-4b23bb2125bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:24.074324 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd40bd-856e-4671-bfb2-4b23bb2125bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:24.074819 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f3110-d304-4f9a-baa5-4d7f969bbe23 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:24.076231 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd40bd-856e-4671-bfb2-4b23bb2125bf admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:24.078472 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebb1a2-c6e2-4c50-ba72-32ed14c8f3b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:24.079092 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebb1a2-c6e2-4c50-ba72-32ed14c8f3b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:24.079400 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebb1a2-c6e2-4c50-ba72-32ed14c8f3b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:24.079670 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebb1a2-c6e2-4c50-ba72-32ed14c8f3b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:24.089239 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ebb1a2-c6e2-4c50-ba72-32ed14c8f3b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:24.090720 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ebb1a2-c6e2-4c50-ba72-32ed14c8f3b0 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:24.102890 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 788/1572] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:24 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:25:24.106419 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 785/1573] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:25:23 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:24.112432 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebb1a2-c6e2-4c50-ba72-32ed14c8f3b0 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:24.128335 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebb1a2-c6e2-4c50-ba72-32ed14c8f3b0 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:24.169969 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:24.213491 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd40bd-856e-4671-bfb2-4b23bb2125bf admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:24.225025 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03125ca0-6e74-434d-af39-a43ffa3779f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:24.225768 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03125ca0-6e74-434d-af39-a43ffa3779f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:24.226111 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03125ca0-6e74-434d-af39-a43ffa3779f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:24.226462 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03125ca0-6e74-434d-af39-a43ffa3779f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:24.227441 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03125ca0-6e74-434d-af39-a43ffa3779f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:24.229972 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03125ca0-6e74-434d-af39-a43ffa3779f2 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:24.286012 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd40bd-856e-4671-bfb2-4b23bb2125bf admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:24.290050 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420807e-c581-4aec-9415-7907c948e392 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:24.290777 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420807e-c581-4aec-9415-7907c948e392 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:24.291119 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420807e-c581-4aec-9415-7907c948e392 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:24.291449 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420807e-c581-4aec-9415-7907c948e392 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:24.293989 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 789/1574] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:25:24 2022] POST /identity/v3/users => generated 299 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:24.294954 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03125ca0-6e74-434d-af39-a43ffa3779f2 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:24.316504 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03125ca0-6e74-434d-af39-a43ffa3779f2 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:24.335451 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a85f2d-baf9-4eb8-96dc-8cfb3aa7125b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:24.336016 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a85f2d-baf9-4eb8-96dc-8cfb3aa7125b admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:24.336409 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a85f2d-baf9-4eb8-96dc-8cfb3aa7125b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:24.336766 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a85f2d-baf9-4eb8-96dc-8cfb3aa7125b admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:24.337443 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a85f2d-baf9-4eb8-96dc-8cfb3aa7125b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:24.344067 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a85f2d-baf9-4eb8-96dc-8cfb3aa7125b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:24.376838 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 790/1575] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:24 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:24.382721 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a85f2d-baf9-4eb8-96dc-8cfb3aa7125b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:24.402134 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a85f2d-baf9-4eb8-96dc-8cfb3aa7125b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:24.416680 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ed5ac-5331-4f1e-8b6b-c281365e5335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:24.425046 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ed5ac-5331-4f1e-8b6b-c281365e5335 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:24.425046 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ed5ac-5331-4f1e-8b6b-c281365e5335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:24.425046 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ed5ac-5331-4f1e-8b6b-c281365e5335 admin admin] PATH_INFO: `/v3/projects/19d363060efe4d3ca14a5ff4c444fee6/users/7ac6536e5d0e434e9d1adfd4b0ba5187/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:24.434620 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1420807e-c581-4aec-9415-7907c948e392 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:24.435555 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1420807e-c581-4aec-9415-7907c948e392 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:24.451769 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ed5ac-5331-4f1e-8b6b-c281365e5335 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19d363060efe4d3ca14a5ff4c444fee6, user_id=7ac6536e5d0e434e9d1adfd4b0ba5187, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:24.453601 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 786/1576] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:25:24.466032 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ed5ac-5331-4f1e-8b6b-c281365e5335 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:24.493583 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 791/1577] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:24 2022] PUT /identity/v3/projects/19d363060efe4d3ca14a5ff4c444fee6/users/7ac6536e5d0e434e9d1adfd4b0ba5187/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:24.497837 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420807e-c581-4aec-9415-7907c948e392 service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:24.518478 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420807e-c581-4aec-9415-7907c948e392 service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:24.590063 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:24.621627 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4adfb1-c9ba-47e5-8c1b-9f42cfd0e151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:24.622948 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4adfb1-c9ba-47e5-8c1b-9f42cfd0e151 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:24.623309 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4adfb1-c9ba-47e5-8c1b-9f42cfd0e151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:24.623608 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4adfb1-c9ba-47e5-8c1b-9f42cfd0e151 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:24.626159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4adfb1-c9ba-47e5-8c1b-9f42cfd0e151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:24.630472 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4adfb1-c9ba-47e5-8c1b-9f42cfd0e151 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:24.678574 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 787/1578] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:24 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:24.685301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ed5ac-5331-4f1e-8b6b-c281365e5335 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:24.700513 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ed5ac-5331-4f1e-8b6b-c281365e5335 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:24.712254 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9c6d7-b0c7-4d8a-bd5e-a6e24ab26bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:24.713115 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9c6d7-b0c7-4d8a-bd5e-a6e24ab26bef admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:24.723125 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9c6d7-b0c7-4d8a-bd5e-a6e24ab26bef admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:24.723582 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9c6d7-b0c7-4d8a-bd5e-a6e24ab26bef admin admin] PATH_INFO: `/v3/projects/19d363060efe4d3ca14a5ff4c444fee6/users/7ac6536e5d0e434e9d1adfd4b0ba5187/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:24.738345 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9c6d7-b0c7-4d8a-bd5e-a6e24ab26bef admin admin] RBAC: Authorizing `identity:create_grant(project_id=19d363060efe4d3ca14a5ff4c444fee6, user_id=7ac6536e5d0e434e9d1adfd4b0ba5187, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:24.741408 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9c6d7-b0c7-4d8a-bd5e-a6e24ab26bef admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:24.754664 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 792/1579] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:24 2022] PUT /identity/v3/projects/19d363060efe4d3ca14a5ff4c444fee6/users/7ac6536e5d0e434e9d1adfd4b0ba5187/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:25:24.769321 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1431b6-b60b-468f-b3d1-a581c96dbdfe None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:24.769653 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1431b6-b60b-468f-b3d1-a581c96dbdfe None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:24.769935 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1431b6-b60b-468f-b3d1-a581c96dbdfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:24.807060 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-0d1431b6-b60b-468f-b3d1-a581c96dbdfe None None] MFA Rules not processed for user `7ac6536e5d0e434e9d1adfd4b0ba5187`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:24.813908 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0d1431b6-b60b-468f-b3d1-a581c96dbdfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:24.930733 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 788/1580] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:24 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:24.942064 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9c6d7-b0c7-4d8a-bd5e-a6e24ab26bef admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:24.944050 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-dbf9c6d7-b0c7-4d8a-bd5e-a6e24ab26bef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:25.022523 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9c6d7-b0c7-4d8a-bd5e-a6e24ab26bef admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:25.042880 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52e4cd-38ed-42ce-9a4c-7deae50ce9b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:25.044275 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52e4cd-38ed-42ce-9a4c-7deae50ce9b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:25.044659 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52e4cd-38ed-42ce-9a4c-7deae50ce9b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:25.045138 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52e4cd-38ed-42ce-9a4c-7deae50ce9b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:25.060389 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52e4cd-38ed-42ce-9a4c-7deae50ce9b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:25.063816 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52e4cd-38ed-42ce-9a4c-7deae50ce9b3 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:25.076366 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 793/1581] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:24 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:25:25.842417 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1431b6-b60b-468f-b3d1-a581c96dbdfe None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:25.936867 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1431b6-b60b-468f-b3d1-a581c96dbdfe None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:25.943660 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9f10c-23b7-45b7-818f-5f174b449ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:25.944553 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9f10c-23b7-45b7-818f-5f174b449ebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:25.945015 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9f10c-23b7-45b7-818f-5f174b449ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:25.945516 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9f10c-23b7-45b7-818f-5f174b449ebc admin admin] PATH_INFO: `/v3/users/868444b0ba564c7aabc2f154e8ffcb3d` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:25.947020 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9f10c-23b7-45b7-818f-5f174b449ebc admin admin] RBAC: Authorizing `identity:delete_user(user_id=868444b0ba564c7aabc2f154e8ffcb3d)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:25.949926 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9f10c-23b7-45b7-818f-5f174b449ebc admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:26.055067 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-20b9f10c-23b7-45b7-818f-5f174b449ebc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '868444b0ba564c7aabc2f154e8ffcb3d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:26.056536 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-20b9f10c-23b7-45b7-818f-5f174b449ebc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '868444b0ba564c7aabc2f154e8ffcb3d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:26.080911 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-20b9f10c-23b7-45b7-818f-5f174b449ebc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '868444b0ba564c7aabc2f154e8ffcb3d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:26.102038 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-20b9f10c-23b7-45b7-818f-5f174b449ebc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '868444b0ba564c7aabc2f154e8ffcb3d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:26.104998 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-20b9f10c-23b7-45b7-818f-5f174b449ebc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '868444b0ba564c7aabc2f154e8ffcb3d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:26.110646 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:26.153475 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 789/1582] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:25:25 2022] DELETE /identity/v3/users/868444b0ba564c7aabc2f154e8ffcb3d => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:26.157553 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847aed9-8453-4fe9-9746-496af71bdb1d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:26.158012 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847aed9-8453-4fe9-9746-496af71bdb1d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:26.158154 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847aed9-8453-4fe9-9746-496af71bdb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:26.224246 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-5847aed9-8453-4fe9-9746-496af71bdb1d None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:26.225758 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5847aed9-8453-4fe9-9746-496af71bdb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:26.342548 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 794/1583] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:26.356748 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9f10c-23b7-45b7-818f-5f174b449ebc admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:26.359233 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-20b9f10c-23b7-45b7-818f-5f174b449ebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:26.482931 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9f10c-23b7-45b7-818f-5f174b449ebc admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:26.487355 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57fd99a-28b5-4225-9423-a2afe3350987 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:26.488082 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fd99a-28b5-4225-9423-a2afe3350987 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:26.488459 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fd99a-28b5-4225-9423-a2afe3350987 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:26.488802 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fd99a-28b5-4225-9423-a2afe3350987 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:26.505909 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57fd99a-28b5-4225-9423-a2afe3350987 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:26.509579 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57fd99a-28b5-4225-9423-a2afe3350987 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:26.521368 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 790/1584] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:25:26.648178 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847aed9-8453-4fe9-9746-496af71bdb1d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:26.650041 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5847aed9-8453-4fe9-9746-496af71bdb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:26.662508 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:26.670160 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847aed9-8453-4fe9-9746-496af71bdb1d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:26.677852 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5489b-0591-4c9b-93f1-33ca7e58bdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:26.678811 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5489b-0591-4c9b-93f1-33ca7e58bdaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:26.679313 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5489b-0591-4c9b-93f1-33ca7e58bdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:26.679776 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5489b-0591-4c9b-93f1-33ca7e58bdaf admin admin] PATH_INFO: `/v3/users/3fc912f00741464287202a6b4fbbe78f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:26.681595 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c5489b-0591-4c9b-93f1-33ca7e58bdaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fc912f00741464287202a6b4fbbe78f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:26.683755 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c5489b-0591-4c9b-93f1-33ca7e58bdaf admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:26.766495 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-04c5489b-0591-4c9b-93f1-33ca7e58bdaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fc912f00741464287202a6b4fbbe78f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:26.768310 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-04c5489b-0591-4c9b-93f1-33ca7e58bdaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fc912f00741464287202a6b4fbbe78f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:26.784674 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-04c5489b-0591-4c9b-93f1-33ca7e58bdaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fc912f00741464287202a6b4fbbe78f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:26.803356 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-04c5489b-0591-4c9b-93f1-33ca7e58bdaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fc912f00741464287202a6b4fbbe78f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:26.804241 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-04c5489b-0591-4c9b-93f1-33ca7e58bdaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fc912f00741464287202a6b4fbbe78f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:26.825673 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 795/1585] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:25:26 2022] DELETE /identity/v3/users/3fc912f00741464287202a6b4fbbe78f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:26.830224 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3146e7-6f17-416d-8e66-34df4f574a58 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:26.830974 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3146e7-6f17-416d-8e66-34df4f574a58 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:26.830974 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3146e7-6f17-416d-8e66-34df4f574a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:26.865485 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-fe3146e7-6f17-416d-8e66-34df4f574a58 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:26.866857 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-fe3146e7-6f17-416d-8e66-34df4f574a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:26.953017 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 791/1586] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:26.985590 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5489b-0591-4c9b-93f1-33ca7e58bdaf admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:26.987561 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-04c5489b-0591-4c9b-93f1-33ca7e58bdaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:27.065498 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3146e7-6f17-416d-8e66-34df4f574a58 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:27.067127 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-fe3146e7-6f17-416d-8e66-34df4f574a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:27.103799 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3146e7-6f17-416d-8e66-34df4f574a58 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:27.119551 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01eaef4-c18e-4722-bd53-86aeb00903cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:27.120481 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01eaef4-c18e-4722-bd53-86aeb00903cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:27.120905 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01eaef4-c18e-4722-bd53-86aeb00903cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:27.121465 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01eaef4-c18e-4722-bd53-86aeb00903cf admin admin] PATH_INFO: `/v3/projects/9bdb0b8af39146528ef6ce73a38a2be5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:27.123186 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01eaef4-c18e-4722-bd53-86aeb00903cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bdb0b8af39146528ef6ce73a38a2be5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:27.125450 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01eaef4-c18e-4722-bd53-86aeb00903cf admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:27.129046 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5489b-0591-4c9b-93f1-33ca7e58bdaf admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:27.133453 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82354f4b-890d-4b6c-b35b-003c9a28cf95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:27.134640 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82354f4b-890d-4b6c-b35b-003c9a28cf95 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:27.134913 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82354f4b-890d-4b6c-b35b-003c9a28cf95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:27.135191 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82354f4b-890d-4b6c-b35b-003c9a28cf95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:27.145613 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82354f4b-890d-4b6c-b35b-003c9a28cf95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:27.147166 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82354f4b-890d-4b6c-b35b-003c9a28cf95 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:27.157930 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 796/1587] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:25:27.188831 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c01eaef4-c18e-4722-bd53-86aeb00903cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bdb0b8af39146528ef6ce73a38a2be5', 'request_id': 'req-c01eaef4-c18e-4722-bd53-86aeb00903cf'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:27.202568 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c01eaef4-c18e-4722-bd53-86aeb00903cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bdb0b8af39146528ef6ce73a38a2be5', 'request_id': 'req-c01eaef4-c18e-4722-bd53-86aeb00903cf'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:27.220378 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c01eaef4-c18e-4722-bd53-86aeb00903cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bdb0b8af39146528ef6ce73a38a2be5', 'request_id': 'req-c01eaef4-c18e-4722-bd53-86aeb00903cf'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:27.241027 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c01eaef4-c18e-4722-bd53-86aeb00903cf admin admin] The token cache is being invalidate because project 9bdb0b8af39146528ef6ce73a38a2be5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:25:27.241552 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c01eaef4-c18e-4722-bd53-86aeb00903cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:27.242418 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c01eaef4-c18e-4722-bd53-86aeb00903cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:27.245617 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 792/1588] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:25:27 2022] DELETE /identity/v3/projects/9bdb0b8af39146528ef6ce73a38a2be5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:25:27.248778 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82354f4b-890d-4b6c-b35b-003c9a28cf95 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:27.267141 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82354f4b-890d-4b6c-b35b-003c9a28cf95 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:27.359548 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b18780-fe52-4ed9-89b5-e0c1bb9d0277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:27.360855 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b18780-fe52-4ed9-89b5-e0c1bb9d0277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:27.361309 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b18780-fe52-4ed9-89b5-e0c1bb9d0277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:27.361789 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b18780-fe52-4ed9-89b5-e0c1bb9d0277 admin admin] PATH_INFO: `/v3/users/7ac6536e5d0e434e9d1adfd4b0ba5187` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:27.369185 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b18780-fe52-4ed9-89b5-e0c1bb9d0277 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ac6536e5d0e434e9d1adfd4b0ba5187)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:27.371978 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b18780-fe52-4ed9-89b5-e0c1bb9d0277 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:27.408962 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:27.473880 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e9b18780-fe52-4ed9-89b5-e0c1bb9d0277 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ac6536e5d0e434e9d1adfd4b0ba5187'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:27.476669 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e9b18780-fe52-4ed9-89b5-e0c1bb9d0277 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ac6536e5d0e434e9d1adfd4b0ba5187'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:27.485580 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e9b18780-fe52-4ed9-89b5-e0c1bb9d0277 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ac6536e5d0e434e9d1adfd4b0ba5187'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:27.499068 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e9b18780-fe52-4ed9-89b5-e0c1bb9d0277 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ac6536e5d0e434e9d1adfd4b0ba5187'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:27.499856 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e9b18780-fe52-4ed9-89b5-e0c1bb9d0277 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ac6536e5d0e434e9d1adfd4b0ba5187'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:27.519362 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 797/1589] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:25:27 2022] DELETE /identity/v3/users/7ac6536e5d0e434e9d1adfd4b0ba5187 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:27.572548 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01eaef4-c18e-4722-bd53-86aeb00903cf admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:27.574197 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c01eaef4-c18e-4722-bd53-86aeb00903cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:27.626528 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01eaef4-c18e-4722-bd53-86aeb00903cf admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:27.663337 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:27.732744 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048ed51-a740-416b-a2d1-ace26569c005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:27.733859 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048ed51-a740-416b-a2d1-ace26569c005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:27.734318 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048ed51-a740-416b-a2d1-ace26569c005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:27.734766 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048ed51-a740-416b-a2d1-ace26569c005 admin admin] PATH_INFO: `/v3/projects/1468af9337a44adb9ac2637833e95c8a` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:27.736307 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b048ed51-a740-416b-a2d1-ace26569c005 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1468af9337a44adb9ac2637833e95c8a)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:27.738997 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b048ed51-a740-416b-a2d1-ace26569c005 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:27.836828 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-b048ed51-a740-416b-a2d1-ace26569c005 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1468af9337a44adb9ac2637833e95c8a', 'request_id': 'req-b048ed51-a740-416b-a2d1-ace26569c005'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:27.847356 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-b048ed51-a740-416b-a2d1-ace26569c005 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1468af9337a44adb9ac2637833e95c8a', 'request_id': 'req-b048ed51-a740-416b-a2d1-ace26569c005'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:27.856708 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-b048ed51-a740-416b-a2d1-ace26569c005 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1468af9337a44adb9ac2637833e95c8a', 'request_id': 'req-b048ed51-a740-416b-a2d1-ace26569c005'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:27.873296 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-b048ed51-a740-416b-a2d1-ace26569c005 admin admin] The token cache is being invalidate because project 1468af9337a44adb9ac2637833e95c8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:25:27.873971 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-b048ed51-a740-416b-a2d1-ace26569c005 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:27.874518 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-b048ed51-a740-416b-a2d1-ace26569c005 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:27.877582 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 793/1590] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:25:27 2022] DELETE /identity/v3/projects/1468af9337a44adb9ac2637833e95c8a => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:27.881244 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b18780-fe52-4ed9-89b5-e0c1bb9d0277 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:27.882767 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e9b18780-fe52-4ed9-89b5-e0c1bb9d0277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:27.897752 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b18780-fe52-4ed9-89b5-e0c1bb9d0277 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:27.940346 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048ed51-a740-416b-a2d1-ace26569c005 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:27.941986 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b048ed51-a740-416b-a2d1-ace26569c005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:27.980707 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc61a6-b09e-4c0a-82eb-aac67ac624f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:27.981343 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc61a6-b09e-4c0a-82eb-aac67ac624f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:27.981641 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc61a6-b09e-4c0a-82eb-aac67ac624f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:27.981912 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc61a6-b09e-4c0a-82eb-aac67ac624f6 admin admin] PATH_INFO: `/v3/users/10402c04b94843c099ba662402f2373e` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:27.984025 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc61a6-b09e-4c0a-82eb-aac67ac624f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10402c04b94843c099ba662402f2373e)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:27.986701 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc61a6-b09e-4c0a-82eb-aac67ac624f6 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:28.024280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048ed51-a740-416b-a2d1-ace26569c005 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:28.030997 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03240187-48e3-434b-9c6c-1976dc3c59c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:28.031697 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03240187-48e3-434b-9c6c-1976dc3c59c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:28.032109 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03240187-48e3-434b-9c6c-1976dc3c59c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:28.033884 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03240187-48e3-434b-9c6c-1976dc3c59c6 admin admin] PATH_INFO: `/v3/users/d098fb50f101453b8e8569a818238ed1` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:28.035472 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03240187-48e3-434b-9c6c-1976dc3c59c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d098fb50f101453b8e8569a818238ed1)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:28.037678 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03240187-48e3-434b-9c6c-1976dc3c59c6 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:28.061267 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-02bc61a6-b09e-4c0a-82eb-aac67ac624f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10402c04b94843c099ba662402f2373e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:28.062027 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-02bc61a6-b09e-4c0a-82eb-aac67ac624f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10402c04b94843c099ba662402f2373e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:28.071840 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-02bc61a6-b09e-4c0a-82eb-aac67ac624f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10402c04b94843c099ba662402f2373e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:28.089481 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-02bc61a6-b09e-4c0a-82eb-aac67ac624f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10402c04b94843c099ba662402f2373e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:28.090446 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-02bc61a6-b09e-4c0a-82eb-aac67ac624f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10402c04b94843c099ba662402f2373e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:28.097200 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-03240187-48e3-434b-9c6c-1976dc3c59c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd098fb50f101453b8e8569a818238ed1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:28.098031 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-03240187-48e3-434b-9c6c-1976dc3c59c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd098fb50f101453b8e8569a818238ed1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:28.100442 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:28.107107 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-03240187-48e3-434b-9c6c-1976dc3c59c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd098fb50f101453b8e8569a818238ed1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:28.107340 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 798/1591] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:25:27 2022] DELETE /identity/v3/users/10402c04b94843c099ba662402f2373e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:28.108635 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc61a6-b09e-4c0a-82eb-aac67ac624f6 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:28.110535 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-02bc61a6-b09e-4c0a-82eb-aac67ac624f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:28.150151 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:28.152007 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-03240187-48e3-434b-9c6c-1976dc3c59c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd098fb50f101453b8e8569a818238ed1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:28.154676 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-03240187-48e3-434b-9c6c-1976dc3c59c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd098fb50f101453b8e8569a818238ed1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:28.181907 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 794/1592] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:25:27 2022] DELETE /identity/v3/users/d098fb50f101453b8e8569a818238ed1 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:28.187345 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdcbad-3ece-42cf-a667-f4cfd7818914 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:28.187635 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdcbad-3ece-42cf-a667-f4cfd7818914 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:28.187909 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdcbad-3ece-42cf-a667-f4cfd7818914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:28.238644 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-c4cdcbad-3ece-42cf-a667-f4cfd7818914 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:28.239140 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc61a6-b09e-4c0a-82eb-aac67ac624f6 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:28.240179 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c4cdcbad-3ece-42cf-a667-f4cfd7818914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:28.409018 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 795/1593] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:25:28.412683 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb280f9-e670-4af4-8029-f239d5f10d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:28.413227 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb280f9-e670-4af4-8029-f239d5f10d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:28.413507 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb280f9-e670-4af4-8029-f239d5f10d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:28.413807 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb280f9-e670-4af4-8029-f239d5f10d34 admin admin] PATH_INFO: `/v3/projects/19d363060efe4d3ca14a5ff4c444fee6` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:28.415012 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb280f9-e670-4af4-8029-f239d5f10d34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19d363060efe4d3ca14a5ff4c444fee6)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:28.416916 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb280f9-e670-4af4-8029-f239d5f10d34 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:28.418588 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cdcbad-3ece-42cf-a667-f4cfd7818914 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:28.420328 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c4cdcbad-3ece-42cf-a667-f4cfd7818914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:28.493925 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2fb280f9-e670-4af4-8029-f239d5f10d34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19d363060efe4d3ca14a5ff4c444fee6', 'request_id': 'req-2fb280f9-e670-4af4-8029-f239d5f10d34'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:28.501473 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2fb280f9-e670-4af4-8029-f239d5f10d34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19d363060efe4d3ca14a5ff4c444fee6', 'request_id': 'req-2fb280f9-e670-4af4-8029-f239d5f10d34'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:28.510148 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2fb280f9-e670-4af4-8029-f239d5f10d34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19d363060efe4d3ca14a5ff4c444fee6', 'request_id': 'req-2fb280f9-e670-4af4-8029-f239d5f10d34'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:28.514327 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cdcbad-3ece-42cf-a667-f4cfd7818914 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:28.534342 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2fb280f9-e670-4af4-8029-f239d5f10d34 admin admin] The token cache is being invalidate because project 19d363060efe4d3ca14a5ff4c444fee6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:25:28.535215 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2fb280f9-e670-4af4-8029-f239d5f10d34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:28.536539 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2fb280f9-e670-4af4-8029-f239d5f10d34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:28.540790 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 799/1594] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:25:28 2022] DELETE /identity/v3/projects/19d363060efe4d3ca14a5ff4c444fee6 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:28.546477 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092cbc5-e81c-4b34-a22c-91bcc7b60a54 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:28.546477 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092cbc5-e81c-4b34-a22c-91bcc7b60a54 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:28.546722 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092cbc5-e81c-4b34-a22c-91bcc7b60a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:28.582919 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-9092cbc5-e81c-4b34-a22c-91bcc7b60a54 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:28.585568 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9092cbc5-e81c-4b34-a22c-91bcc7b60a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:28.604943 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f3067-337d-41e1-b47a-d15319d57385 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:28.605462 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f3067-337d-41e1-b47a-d15319d57385 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:28.606484 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f3067-337d-41e1-b47a-d15319d57385 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:28.606749 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f3067-337d-41e1-b47a-d15319d57385 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:28.609224 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e97f3067-337d-41e1-b47a-d15319d57385 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:28.653409 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:28.669310 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 800/1595] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:25:28.677980 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9253b-d752-4c6f-99f8-80a3ddbe6cca None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:28.678475 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9253b-d752-4c6f-99f8-80a3ddbe6cca None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:28.678623 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9253b-d752-4c6f-99f8-80a3ddbe6cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:28.702515 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-4ba9253b-d752-4c6f-99f8-80a3ddbe6cca None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:28.703758 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4ba9253b-d752-4c6f-99f8-80a3ddbe6cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:28.712661 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 801/1596] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:25:28.715705 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9253b-d752-4c6f-99f8-80a3ddbe6cca None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:28.717355 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4ba9253b-d752-4c6f-99f8-80a3ddbe6cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:28.732001 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9253b-d752-4c6f-99f8-80a3ddbe6cca None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:28.737286 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d78c3-dc89-4d76-b781-d2c042893090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:28.738000 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d78c3-dc89-4d76-b781-d2c042893090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:28.738289 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d78c3-dc89-4d76-b781-d2c042893090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:28.738543 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d78c3-dc89-4d76-b781-d2c042893090 admin admin] PATH_INFO: `/v3/projects/2cd4d437accb49188cf6667526dcbe84` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:28.739708 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d78c3-dc89-4d76-b781-d2c042893090 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cd4d437accb49188cf6667526dcbe84)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:28.741681 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d78c3-dc89-4d76-b781-d2c042893090 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:28.802678 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6c4d78c3-dc89-4d76-b781-d2c042893090 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cd4d437accb49188cf6667526dcbe84', 'request_id': 'req-6c4d78c3-dc89-4d76-b781-d2c042893090'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:28.809277 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6c4d78c3-dc89-4d76-b781-d2c042893090 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cd4d437accb49188cf6667526dcbe84', 'request_id': 'req-6c4d78c3-dc89-4d76-b781-d2c042893090'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:28.812034 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:28.817876 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6c4d78c3-dc89-4d76-b781-d2c042893090 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cd4d437accb49188cf6667526dcbe84', 'request_id': 'req-6c4d78c3-dc89-4d76-b781-d2c042893090'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:28.839969 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6c4d78c3-dc89-4d76-b781-d2c042893090 admin admin] The token cache is being invalidate because project 2cd4d437accb49188cf6667526dcbe84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:25:28.840396 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6c4d78c3-dc89-4d76-b781-d2c042893090 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:28.841197 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6c4d78c3-dc89-4d76-b781-d2c042893090 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:28.843075 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 802/1597] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:25:28 2022] DELETE /identity/v3/projects/2cd4d437accb49188cf6667526dcbe84 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:28.843707 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d78c3-dc89-4d76-b781-d2c042893090 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:28.845057 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6c4d78c3-dc89-4d76-b781-d2c042893090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:28.859263 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f3067-337d-41e1-b47a-d15319d57385 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:28.860719 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f3067-337d-41e1-b47a-d15319d57385 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:28.873769 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 796/1598] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:25:28.874989 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05375ca-1117-4dad-8fd0-3fde36527834 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:28.875270 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05375ca-1117-4dad-8fd0-3fde36527834 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:28.875537 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05375ca-1117-4dad-8fd0-3fde36527834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:28.896792 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-d05375ca-1117-4dad-8fd0-3fde36527834 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:28.898063 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d05375ca-1117-4dad-8fd0-3fde36527834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:28.930956 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d78c3-dc89-4d76-b781-d2c042893090 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:28.939791 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8ff15-6d33-425e-9f5b-0346fcff0043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:28.940345 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8ff15-6d33-425e-9f5b-0346fcff0043 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:28.940635 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8ff15-6d33-425e-9f5b-0346fcff0043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:28.940906 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8ff15-6d33-425e-9f5b-0346fcff0043 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:28.941583 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f8ff15-6d33-425e-9f5b-0346fcff0043 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:25:28.941892 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f8ff15-6d33-425e-9f5b-0346fcff0043 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:28.943608 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f8ff15-6d33-425e-9f5b-0346fcff0043 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:28.959947 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 803/1599] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:25:28.961074 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8ff15-6d33-425e-9f5b-0346fcff0043 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:28.969972 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 797/1600] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:28.971394 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8ff15-6d33-425e-9f5b-0346fcff0043 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:28.977434 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564039bd-3fcd-46fe-92be-1200301f1399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:28.978117 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564039bd-3fcd-46fe-92be-1200301f1399 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:28.978563 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564039bd-3fcd-46fe-92be-1200301f1399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:28.978843 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564039bd-3fcd-46fe-92be-1200301f1399 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:28.979222 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d782c17-0d1b-4161-9c23-12776e62f4a0 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:28.979492 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564039bd-3fcd-46fe-92be-1200301f1399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:28.979601 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d782c17-0d1b-4161-9c23-12776e62f4a0 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:28.979909 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d782c17-0d1b-4161-9c23-12776e62f4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:28.981488 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564039bd-3fcd-46fe-92be-1200301f1399 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:29.005737 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-5d782c17-0d1b-4161-9c23-12776e62f4a0 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:29.007246 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5d782c17-0d1b-4161-9c23-12776e62f4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:29.016597 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 804/1601] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:25:28 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:29.018265 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 798/1602] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:29.020806 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564039bd-3fcd-46fe-92be-1200301f1399 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:29.022324 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d782c17-0d1b-4161-9c23-12776e62f4a0 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:29.031978 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d782c17-0d1b-4161-9c23-12776e62f4a0 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:29.096023 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:29.103671 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35da5f7-ca2b-4ea1-ae23-8022f791a646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:29.104771 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35da5f7-ca2b-4ea1-ae23-8022f791a646 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:29.105118 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35da5f7-ca2b-4ea1-ae23-8022f791a646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:29.105349 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35da5f7-ca2b-4ea1-ae23-8022f791a646 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:29.106391 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35da5f7-ca2b-4ea1-ae23-8022f791a646 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:25:29.106792 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35da5f7-ca2b-4ea1-ae23-8022f791a646 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:29.108377 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35da5f7-ca2b-4ea1-ae23-8022f791a646 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:29.115309 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564039bd-3fcd-46fe-92be-1200301f1399 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:29.121568 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42525a0a-afd4-4fe0-a781-c1dd3834c3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:29.122270 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42525a0a-afd4-4fe0-a781-c1dd3834c3de admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:29.122636 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42525a0a-afd4-4fe0-a781-c1dd3834c3de admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:29.123146 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 799/1603] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:25:29.125683 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42525a0a-afd4-4fe0-a781-c1dd3834c3de admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:29.126518 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42525a0a-afd4-4fe0-a781-c1dd3834c3de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:29.127755 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35da5f7-ca2b-4ea1-ae23-8022f791a646 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:29.129971 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42525a0a-afd4-4fe0-a781-c1dd3834c3de admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:29.173086 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35da5f7-ca2b-4ea1-ae23-8022f791a646 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:29.178862 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 805/1604] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:25:29 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:25:29.181099 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42525a0a-afd4-4fe0-a781-c1dd3834c3de admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:29.181899 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c047c-f34d-419f-a35c-2c0f25138088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:29.182581 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c047c-f34d-419f-a35c-2c0f25138088 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:29.182859 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c047c-f34d-419f-a35c-2c0f25138088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:29.183130 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c047c-f34d-419f-a35c-2c0f25138088 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:29.183769 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c047c-f34d-419f-a35c-2c0f25138088 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:29.186024 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c047c-f34d-419f-a35c-2c0f25138088 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:29.192634 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42525a0a-afd4-4fe0-a781-c1dd3834c3de admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:29.199507 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c118bf-e829-4ccb-a26d-9c246a699d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:29.200614 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c118bf-e829-4ccb-a26d-9c246a699d58 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:29.200944 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c118bf-e829-4ccb-a26d-9c246a699d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:29.201248 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c118bf-e829-4ccb-a26d-9c246a699d58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:29.201947 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c118bf-e829-4ccb-a26d-9c246a699d58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:29.203541 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c118bf-e829-4ccb-a26d-9c246a699d58 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:29.217607 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 806/1605] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 13:25:29.219550 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 800/1606] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:25:29 2022] POST /identity/v3/projects => generated 375 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:29.220583 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c118bf-e829-4ccb-a26d-9c246a699d58 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:29.223212 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c047c-f34d-419f-a35c-2c0f25138088 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:29.241990 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c118bf-e829-4ccb-a26d-9c246a699d58 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:29.276352 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:29.302195 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c047c-f34d-419f-a35c-2c0f25138088 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:29.307754 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd611a0-7504-41fa-8328-ac484dc13ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:29.308592 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd611a0-7504-41fa-8328-ac484dc13ef6 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:29.308944 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd611a0-7504-41fa-8328-ac484dc13ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:29.309272 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd611a0-7504-41fa-8328-ac484dc13ef6 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:29.310454 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd611a0-7504-41fa-8328-ac484dc13ef6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:29.312386 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd611a0-7504-41fa-8328-ac484dc13ef6 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:29.328746 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579948c8-d280-4fca-9072-4828dea82954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:29.329421 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579948c8-d280-4fca-9072-4828dea82954 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:29.329825 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579948c8-d280-4fca-9072-4828dea82954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:29.330152 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579948c8-d280-4fca-9072-4828dea82954 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:29.330918 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579948c8-d280-4fca-9072-4828dea82954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:29.332643 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579948c8-d280-4fca-9072-4828dea82954 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:29.340173 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 801/1607] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:25:29 2022] POST /identity/v3/users => generated 288 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:29.344070 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 807/1608] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 13:25:29.344323 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd611a0-7504-41fa-8328-ac484dc13ef6 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:29.347988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579948c8-d280-4fca-9072-4828dea82954 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:29.356781 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd611a0-7504-41fa-8328-ac484dc13ef6 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:29.358605 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579948c8-d280-4fca-9072-4828dea82954 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:29.366368 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40808f5-c7bd-4754-9f08-bef30fa591e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:29.366368 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40808f5-c7bd-4754-9f08-bef30fa591e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:29.366368 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40808f5-c7bd-4754-9f08-bef30fa591e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:29.366368 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40808f5-c7bd-4754-9f08-bef30fa591e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:29.366789 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40808f5-c7bd-4754-9f08-bef30fa591e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:29.367363 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40808f5-c7bd-4754-9f08-bef30fa591e6 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:29.367981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0de8f-33a5-488b-a0cb-e92d7fa86496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:29.368890 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0de8f-33a5-488b-a0cb-e92d7fa86496 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:29.369272 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0de8f-33a5-488b-a0cb-e92d7fa86496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:29.369689 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0de8f-33a5-488b-a0cb-e92d7fa86496 admin admin] PATH_INFO: `/v3/projects/45228b637385460f9521067cfb01a509/users/228922913cf1492a8d12a1a19bf7fd09/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:29.383997 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 802/1609] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 13:25:29.388065 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40808f5-c7bd-4754-9f08-bef30fa591e6 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:29.398737 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40808f5-c7bd-4754-9f08-bef30fa591e6 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:29.404874 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4be611-c503-426d-9814-91999550f24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:29.406897 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae0de8f-33a5-488b-a0cb-e92d7fa86496 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45228b637385460f9521067cfb01a509, user_id=228922913cf1492a8d12a1a19bf7fd09, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:29.409880 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae0de8f-33a5-488b-a0cb-e92d7fa86496 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:29.411432 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4be611-c503-426d-9814-91999550f24d admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:29.411432 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4be611-c503-426d-9814-91999550f24d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:29.411741 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4be611-c503-426d-9814-91999550f24d admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:29.412537 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4be611-c503-426d-9814-91999550f24d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:29.414902 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4be611-c503-426d-9814-91999550f24d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:29.436486 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 803/1610] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 13:25:29.437176 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4be611-c503-426d-9814-91999550f24d admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:29.439128 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8e4be611-c503-426d-9814-91999550f24d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:29.448865 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 808/1611] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:29 2022] PUT /identity/v3/projects/45228b637385460f9521067cfb01a509/users/228922913cf1492a8d12a1a19bf7fd09/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:25:29.449838 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0de8f-33a5-488b-a0cb-e92d7fa86496 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:29.460587 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4be611-c503-426d-9814-91999550f24d admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:29.534744 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0de8f-33a5-488b-a0cb-e92d7fa86496 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:29.537740 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d284d0-6524-49b4-922c-2e40ed3f35e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:29.538403 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d284d0-6524-49b4-922c-2e40ed3f35e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:29.538682 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d284d0-6524-49b4-922c-2e40ed3f35e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:29.538971 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d284d0-6524-49b4-922c-2e40ed3f35e1 admin admin] PATH_INFO: `/v3/projects/8bae221caae946d8b2c65f74f7c03169` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:29.540323 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d284d0-6524-49b4-922c-2e40ed3f35e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bae221caae946d8b2c65f74f7c03169)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:29.540589 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b8ace-9b54-40b9-9da2-09f18073e0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:29.541437 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b8ace-9b54-40b9-9da2-09f18073e0dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:29.541870 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b8ace-9b54-40b9-9da2-09f18073e0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:29.542358 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b8ace-9b54-40b9-9da2-09f18073e0dd admin admin] PATH_INFO: `/v3/projects/5969c3225d6d408289289966c2e37723/users/ceca5a46d43f4df582876376ac2b3230/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:29.542490 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d284d0-6524-49b4-922c-2e40ed3f35e1 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:29.559674 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1b8ace-9b54-40b9-9da2-09f18073e0dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5969c3225d6d408289289966c2e37723, user_id=ceca5a46d43f4df582876376ac2b3230, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:29.562927 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1b8ace-9b54-40b9-9da2-09f18073e0dd admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:29.584316 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 809/1612] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:29 2022] PUT /identity/v3/projects/5969c3225d6d408289289966c2e37723/users/ceca5a46d43f4df582876376ac2b3230/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:29.585782 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58109d0-5216-410c-97f3-13b9598d5dda None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:29.586069 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58109d0-5216-410c-97f3-13b9598d5dda None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:29.586342 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58109d0-5216-410c-97f3-13b9598d5dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:29.606356 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-a58109d0-5216-410c-97f3-13b9598d5dda None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:29.607565 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a58109d0-5216-410c-97f3-13b9598d5dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:29.614387 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-46d284d0-6524-49b4-922c-2e40ed3f35e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bae221caae946d8b2c65f74f7c03169', 'request_id': 'req-46d284d0-6524-49b4-922c-2e40ed3f35e1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:29.620511 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:29.624426 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-46d284d0-6524-49b4-922c-2e40ed3f35e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bae221caae946d8b2c65f74f7c03169', 'request_id': 'req-46d284d0-6524-49b4-922c-2e40ed3f35e1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:29.631434 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-46d284d0-6524-49b4-922c-2e40ed3f35e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bae221caae946d8b2c65f74f7c03169', 'request_id': 'req-46d284d0-6524-49b4-922c-2e40ed3f35e1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:29.658282 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-46d284d0-6524-49b4-922c-2e40ed3f35e1 admin admin] The token cache is being invalidate because project 8bae221caae946d8b2c65f74f7c03169 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:25:29.658977 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-46d284d0-6524-49b4-922c-2e40ed3f35e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:29.660798 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-46d284d0-6524-49b4-922c-2e40ed3f35e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:29.677688 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 804/1613] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:25:29 2022] DELETE /identity/v3/projects/8bae221caae946d8b2c65f74f7c03169 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:29.679381 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5878795-22c5-4416-8b0a-637b1efb50c7 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:29.681287 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5878795-22c5-4416-8b0a-637b1efb50c7 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:29.681411 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 810/1614] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:29.682309 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5878795-22c5-4416-8b0a-637b1efb50c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:29.685651 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58109d0-5216-410c-97f3-13b9598d5dda None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:29.687774 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a58109d0-5216-410c-97f3-13b9598d5dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:29.702361 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58109d0-5216-410c-97f3-13b9598d5dda None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:29.708854 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadba5b-e91b-4f75-a42f-8da99240697f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:29.709566 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadba5b-e91b-4f75-a42f-8da99240697f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:29.710138 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadba5b-e91b-4f75-a42f-8da99240697f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:29.710414 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadba5b-e91b-4f75-a42f-8da99240697f admin admin] PATH_INFO: `/v3/users/2001275c2bdc425cb4988503fbce4b3e` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:29.711861 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fadba5b-e91b-4f75-a42f-8da99240697f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2001275c2bdc425cb4988503fbce4b3e)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:29.713916 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fadba5b-e91b-4f75-a42f-8da99240697f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:29.730198 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-c5878795-22c5-4416-8b0a-637b1efb50c7 None None] MFA Rules not processed for user `ceca5a46d43f4df582876376ac2b3230`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:29.733483 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c5878795-22c5-4416-8b0a-637b1efb50c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:29.773287 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:29.803744 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-8fadba5b-e91b-4f75-a42f-8da99240697f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2001275c2bdc425cb4988503fbce4b3e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:29.809164 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-8fadba5b-e91b-4f75-a42f-8da99240697f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2001275c2bdc425cb4988503fbce4b3e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:29.823575 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-8fadba5b-e91b-4f75-a42f-8da99240697f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2001275c2bdc425cb4988503fbce4b3e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:29.827662 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 805/1615] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:29.828729 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5878795-22c5-4416-8b0a-637b1efb50c7 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:29.830666 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c5878795-22c5-4416-8b0a-637b1efb50c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:29.842707 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-8fadba5b-e91b-4f75-a42f-8da99240697f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2001275c2bdc425cb4988503fbce4b3e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:29.843561 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-8fadba5b-e91b-4f75-a42f-8da99240697f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2001275c2bdc425cb4988503fbce4b3e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:29.861325 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 811/1616] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:25:29 2022] DELETE /identity/v3/users/2001275c2bdc425cb4988503fbce4b3e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:29.864423 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadba5b-e91b-4f75-a42f-8da99240697f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:29.864423 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8fadba5b-e91b-4f75-a42f-8da99240697f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:29.935400 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5878795-22c5-4416-8b0a-637b1efb50c7 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:30.001168 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c8699-9ae4-42e8-b908-62c062cd0d32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:30.001925 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c8699-9ae4-42e8-b908-62c062cd0d32 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:30.002335 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c8699-9ae4-42e8-b908-62c062cd0d32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:30.002686 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c8699-9ae4-42e8-b908-62c062cd0d32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:30.004500 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-dd9c8699-9ae4-42e8-b908-62c062cd0d32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:30.030931 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadba5b-e91b-4f75-a42f-8da99240697f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:30.034579 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c8699-9ae4-42e8-b908-62c062cd0d32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:30.036126 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c8699-9ae4-42e8-b908-62c062cd0d32 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:30.036977 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e330b-443d-4f75-bf7d-9e024d3aa650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:30.037618 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e330b-443d-4f75-bf7d-9e024d3aa650 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:30.038048 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e330b-443d-4f75-bf7d-9e024d3aa650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:30.038323 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e330b-443d-4f75-bf7d-9e024d3aa650 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:30.039014 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e330b-443d-4f75-bf7d-9e024d3aa650 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:30.041334 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e330b-443d-4f75-bf7d-9e024d3aa650 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:30.053935 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 806/1617] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:25:30.095940 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 812/1618] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:25:29 2022] POST /identity/v3/projects => generated 375 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:30.099984 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c8699-9ae4-42e8-b908-62c062cd0d32 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:30.119121 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c8699-9ae4-42e8-b908-62c062cd0d32 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:30.201004 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3948c-8d14-46fe-8591-9e5504bdd602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:30.201641 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3948c-8d14-46fe-8591-9e5504bdd602 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:30.201992 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3948c-8d14-46fe-8591-9e5504bdd602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:30.202178 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3948c-8d14-46fe-8591-9e5504bdd602 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:30.202827 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b3948c-8d14-46fe-8591-9e5504bdd602 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:30.205326 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b3948c-8d14-46fe-8591-9e5504bdd602 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:30.232500 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 807/1619] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:25:30 2022] POST /identity/v3/users => generated 294 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:30.236813 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e330b-443d-4f75-bf7d-9e024d3aa650 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:30.248783 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e330b-443d-4f75-bf7d-9e024d3aa650 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:30.255237 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afcdbd5-362f-4bbe-b95f-44ea0aa1c638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:30.256200 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcdbd5-362f-4bbe-b95f-44ea0aa1c638 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:30.256494 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcdbd5-362f-4bbe-b95f-44ea0aa1c638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:30.256761 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcdbd5-362f-4bbe-b95f-44ea0aa1c638 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:30.257413 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afcdbd5-362f-4bbe-b95f-44ea0aa1c638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:30.259290 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afcdbd5-362f-4bbe-b95f-44ea0aa1c638 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:30.273186 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 813/1620] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:30.277718 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3948c-8d14-46fe-8591-9e5504bdd602 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:30.302356 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3948c-8d14-46fe-8591-9e5504bdd602 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:30.307391 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584f4fd9-fba1-45f2-b8c3-8706ed905c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:30.308064 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f4fd9-fba1-45f2-b8c3-8706ed905c96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:30.308466 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f4fd9-fba1-45f2-b8c3-8706ed905c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:30.308662 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f4fd9-fba1-45f2-b8c3-8706ed905c96 admin admin] PATH_INFO: `/v3/projects/eee8917fbffd445bac7659770051669a/users/8990011dcfb94a5490976a59235b5469/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:30.337250 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:30.341564 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584f4fd9-fba1-45f2-b8c3-8706ed905c96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eee8917fbffd445bac7659770051669a, user_id=8990011dcfb94a5490976a59235b5469, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:30.344384 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584f4fd9-fba1-45f2-b8c3-8706ed905c96 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:30.352590 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afcdbd5-362f-4bbe-b95f-44ea0aa1c638 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:30.354935 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2afcdbd5-362f-4bbe-b95f-44ea0aa1c638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:30.365762 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:30.371992 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afcdbd5-362f-4bbe-b95f-44ea0aa1c638 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:30.377059 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 808/1621] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:30 2022] PUT /identity/v3/projects/eee8917fbffd445bac7659770051669a/users/8990011dcfb94a5490976a59235b5469/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:30.381330 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584f4fd9-fba1-45f2-b8c3-8706ed905c96 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:30.479216 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584f4fd9-fba1-45f2-b8c3-8706ed905c96 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:30.485825 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce6e89-3f1f-4027-b318-7f994c33be22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:30.486458 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce6e89-3f1f-4027-b318-7f994c33be22 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:30.486735 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce6e89-3f1f-4027-b318-7f994c33be22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:30.487003 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce6e89-3f1f-4027-b318-7f994c33be22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:30.487701 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce6e89-3f1f-4027-b318-7f994c33be22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:30.489388 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce6e89-3f1f-4027-b318-7f994c33be22 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:30.493714 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba7f08-6224-49c4-98b4-996ad6561046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:30.494452 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba7f08-6224-49c4-98b4-996ad6561046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:30.494747 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba7f08-6224-49c4-98b4-996ad6561046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:30.495065 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba7f08-6224-49c4-98b4-996ad6561046 admin admin] PATH_INFO: `/v3/projects/eec18bdc527b4d77aff9d15c283fa645` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:30.500126 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba7f08-6224-49c4-98b4-996ad6561046 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eec18bdc527b4d77aff9d15c283fa645)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:30.503152 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba7f08-6224-49c4-98b4-996ad6561046 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:30.512969 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 809/1622] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:30.514295 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce6e89-3f1f-4027-b318-7f994c33be22 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:30.526001 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce6e89-3f1f-4027-b318-7f994c33be22 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:30.532166 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e8aa4-0ef4-435f-88ab-b73e2c4fd697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:30.532948 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e8aa4-0ef4-435f-88ab-b73e2c4fd697 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:30.533378 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e8aa4-0ef4-435f-88ab-b73e2c4fd697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:30.533596 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e8aa4-0ef4-435f-88ab-b73e2c4fd697 admin admin] PATH_INFO: `/v3/projects/eee8917fbffd445bac7659770051669a/users/8990011dcfb94a5490976a59235b5469/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:30.537694 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42e8aa4-0ef4-435f-88ab-b73e2c4fd697 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eee8917fbffd445bac7659770051669a, user_id=8990011dcfb94a5490976a59235b5469, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:30.542624 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42e8aa4-0ef4-435f-88ab-b73e2c4fd697 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:30.556970 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 810/1623] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:30 2022] PUT /identity/v3/projects/eee8917fbffd445bac7659770051669a/users/8990011dcfb94a5490976a59235b5469/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:30.572331 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9387d17-8555-4ed6-a4fd-67645a8df358 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:30.572682 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9387d17-8555-4ed6-a4fd-67645a8df358 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:30.572968 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9387d17-8555-4ed6-a4fd-67645a8df358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:30.623847 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-43ba7f08-6224-49c4-98b4-996ad6561046 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eec18bdc527b4d77aff9d15c283fa645', 'request_id': 'req-43ba7f08-6224-49c4-98b4-996ad6561046'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:30.633567 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-e9387d17-8555-4ed6-a4fd-67645a8df358 None None] MFA Rules not processed for user `8990011dcfb94a5490976a59235b5469`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:30.635517 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e9387d17-8555-4ed6-a4fd-67645a8df358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:30.636650 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-43ba7f08-6224-49c4-98b4-996ad6561046 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eec18bdc527b4d77aff9d15c283fa645', 'request_id': 'req-43ba7f08-6224-49c4-98b4-996ad6561046'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:30.645372 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-43ba7f08-6224-49c4-98b4-996ad6561046 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eec18bdc527b4d77aff9d15c283fa645', 'request_id': 'req-43ba7f08-6224-49c4-98b4-996ad6561046'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:30.679644 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-43ba7f08-6224-49c4-98b4-996ad6561046 admin admin] The token cache is being invalidate because project eec18bdc527b4d77aff9d15c283fa645 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:25:30.679893 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-43ba7f08-6224-49c4-98b4-996ad6561046 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:30.681924 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-43ba7f08-6224-49c4-98b4-996ad6561046 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:30.684226 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 814/1624] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:25:30 2022] DELETE /identity/v3/projects/eec18bdc527b4d77aff9d15c283fa645 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:30.694086 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3d59f-a57a-43a3-9870-04c046f20831 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:30.696636 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3d59f-a57a-43a3-9870-04c046f20831 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:30.696636 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3d59f-a57a-43a3-9870-04c046f20831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:30.728978 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-a0a3d59f-a57a-43a3-9870-04c046f20831 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:30.730572 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a0a3d59f-a57a-43a3-9870-04c046f20831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:30.790292 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 811/1625] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:25:30.807781 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9387d17-8555-4ed6-a4fd-67645a8df358 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:30.809327 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e9387d17-8555-4ed6-a4fd-67645a8df358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:30.838893 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 815/1626] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:30.848390 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e47ab5-2bf1-4b04-a74c-5eaa0db69360 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:30.848390 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e47ab5-2bf1-4b04-a74c-5eaa0db69360 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:30.848390 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e47ab5-2bf1-4b04-a74c-5eaa0db69360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:30.896975 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-26e47ab5-2bf1-4b04-a74c-5eaa0db69360 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:30.898254 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-26e47ab5-2bf1-4b04-a74c-5eaa0db69360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:30.925703 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 816/1627] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:30.927198 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e47ab5-2bf1-4b04-a74c-5eaa0db69360 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:30.931002 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9387d17-8555-4ed6-a4fd-67645a8df358 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:30.945193 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb43d1f-a17f-4790-a966-345eb74a5941 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:30.946049 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb43d1f-a17f-4790-a966-345eb74a5941 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:30.946260 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb43d1f-a17f-4790-a966-345eb74a5941 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:30.946608 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb43d1f-a17f-4790-a966-345eb74a5941 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:30.947759 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e47ab5-2bf1-4b04-a74c-5eaa0db69360 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:30.948737 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-afb43d1f-a17f-4790-a966-345eb74a5941 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:30.962699 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53cc36-2529-4cb5-8277-c9adfb35bd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:30.963331 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53cc36-2529-4cb5-8277-c9adfb35bd12 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:30.963610 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53cc36-2529-4cb5-8277-c9adfb35bd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:30.963883 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53cc36-2529-4cb5-8277-c9adfb35bd12 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:30.964537 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de53cc36-2529-4cb5-8277-c9adfb35bd12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:25:30.964838 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de53cc36-2529-4cb5-8277-c9adfb35bd12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:30.966500 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de53cc36-2529-4cb5-8277-c9adfb35bd12 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:30.977713 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:30.995060 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 817/1628] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:25:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:25:31.004035 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53cc36-2529-4cb5-8277-c9adfb35bd12 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:31.028392 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53cc36-2529-4cb5-8277-c9adfb35bd12 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:31.037161 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ab8f5-bb09-4ad0-b085-8ef312a7749f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:31.042442 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ab8f5-bb09-4ad0-b085-8ef312a7749f admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:31.042806 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ab8f5-bb09-4ad0-b085-8ef312a7749f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:31.043161 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ab8f5-bb09-4ad0-b085-8ef312a7749f admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:31.044022 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ab8f5-bb09-4ad0-b085-8ef312a7749f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:31.046071 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ab8f5-bb09-4ad0-b085-8ef312a7749f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:31.059320 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb43d1f-a17f-4790-a966-345eb74a5941 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:31.061851 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb43d1f-a17f-4790-a966-345eb74a5941 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:31.072499 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:31.098081 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 812/1629] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:25:31.108774 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 818/1630] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:25:31 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:31.116808 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb43d1f-a17f-4790-a966-345eb74a5941 service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:31.137128 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb43d1f-a17f-4790-a966-345eb74a5941 service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:31.203394 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa2fe3-b1f4-43d8-881c-9cfa18180cef None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:31.203591 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa2fe3-b1f4-43d8-881c-9cfa18180cef None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:31.203869 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa2fe3-b1f4-43d8-881c-9cfa18180cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:31.293291 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79aa6d-3f02-4bac-bf25-cb9f17a33444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:31.293291 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79aa6d-3f02-4bac-bf25-cb9f17a33444 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:31.293291 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79aa6d-3f02-4bac-bf25-cb9f17a33444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:31.293291 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79aa6d-3f02-4bac-bf25-cb9f17a33444 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:31.293768 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e79aa6d-3f02-4bac-bf25-cb9f17a33444 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:31.296049 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e79aa6d-3f02-4bac-bf25-cb9f17a33444 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:31.297934 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-52fa2fe3-b1f4-43d8-881c-9cfa18180cef None None] MFA Rules not processed for user `228922913cf1492a8d12a1a19bf7fd09`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:31.301274 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-52fa2fe3-b1f4-43d8-881c-9cfa18180cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:31.341734 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 813/1631] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:25:31 2022] POST /identity/v3/users => generated 289 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:31.344515 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79aa6d-3f02-4bac-bf25-cb9f17a33444 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:31.378211 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79aa6d-3f02-4bac-bf25-cb9f17a33444 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:31.389022 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53434060-11f9-4f12-9d66-5be5859db5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:31.389990 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53434060-11f9-4f12-9d66-5be5859db5fb admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:31.390441 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53434060-11f9-4f12-9d66-5be5859db5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:31.390958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53434060-11f9-4f12-9d66-5be5859db5fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:31.391837 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53434060-11f9-4f12-9d66-5be5859db5fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:31.395696 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53434060-11f9-4f12-9d66-5be5859db5fb admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:31.413278 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 814/1632] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:31.417282 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53434060-11f9-4f12-9d66-5be5859db5fb admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:31.428847 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53434060-11f9-4f12-9d66-5be5859db5fb admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:31.434183 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db482c91-2b18-4738-b566-d54fafa423fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:31.435324 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db482c91-2b18-4738-b566-d54fafa423fc admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:31.435772 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db482c91-2b18-4738-b566-d54fafa423fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:31.436203 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db482c91-2b18-4738-b566-d54fafa423fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:31.437013 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db482c91-2b18-4738-b566-d54fafa423fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:31.438866 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db482c91-2b18-4738-b566-d54fafa423fc admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:31.459930 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 819/1633] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:25:31.462366 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa2fe3-b1f4-43d8-881c-9cfa18180cef None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:31.465131 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-52fa2fe3-b1f4-43d8-881c-9cfa18180cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:31.465674 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 815/1634] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 13:25:31.470798 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db482c91-2b18-4738-b566-d54fafa423fc admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:31.489557 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db482c91-2b18-4738-b566-d54fafa423fc admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:31.494219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa2fe3-b1f4-43d8-881c-9cfa18180cef None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:31.500656 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d4279-6397-4ad8-8951-dc612f7ee45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:31.501637 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d4279-6397-4ad8-8951-dc612f7ee45e admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:31.501919 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d4279-6397-4ad8-8951-dc612f7ee45e admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:31.502186 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d4279-6397-4ad8-8951-dc612f7ee45e admin admin] PATH_INFO: `/v3/projects/275c20b71ede4ac999d9f3efc8d351c1/users/3ef905f821dd448c9bbbc3f12c08e26b/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:31.507467 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ad17b-7798-4798-82a1-6e2942a2e27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:31.508134 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ad17b-7798-4798-82a1-6e2942a2e27d admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:31.508518 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ad17b-7798-4798-82a1-6e2942a2e27d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:31.510633 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ad17b-7798-4798-82a1-6e2942a2e27d admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:31.510633 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ad17b-7798-4798-82a1-6e2942a2e27d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:31.515901 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ad17b-7798-4798-82a1-6e2942a2e27d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:31.575459 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034d4279-6397-4ad8-8951-dc612f7ee45e admin admin] RBAC: Authorizing `identity:create_grant(project_id=275c20b71ede4ac999d9f3efc8d351c1, user_id=3ef905f821dd448c9bbbc3f12c08e26b, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:31.583223 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034d4279-6397-4ad8-8951-dc612f7ee45e admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:31.588159 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 820/1635] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:25:31 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:31.593550 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ad17b-7798-4798-82a1-6e2942a2e27d admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:31.613346 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 816/1636] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:31 2022] PUT /identity/v3/projects/275c20b71ede4ac999d9f3efc8d351c1/users/3ef905f821dd448c9bbbc3f12c08e26b/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:31.625001 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7786f33-0795-4a4a-a5fb-244c982dac95 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:31.625636 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7786f33-0795-4a4a-a5fb-244c982dac95 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:31.626100 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7786f33-0795-4a4a-a5fb-244c982dac95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:31.677641 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-b7786f33-0795-4a4a-a5fb-244c982dac95 None None] MFA Rules not processed for user `3ef905f821dd448c9bbbc3f12c08e26b`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:31.679938 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b7786f33-0795-4a4a-a5fb-244c982dac95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:31.768844 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ad17b-7798-4798-82a1-6e2942a2e27d admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:31.797883 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:31.853134 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 817/1637] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:25:31.859638 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7786f33-0795-4a4a-a5fb-244c982dac95 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:31.907665 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7ecdc-250a-4c30-bec0-10d7a0fe2e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:31.911129 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7ecdc-250a-4c30-bec0-10d7a0fe2e92 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:31.911129 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7ecdc-250a-4c30-bec0-10d7a0fe2e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:31.911129 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7ecdc-250a-4c30-bec0-10d7a0fe2e92 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:31.914160 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7ecdc-250a-4c30-bec0-10d7a0fe2e92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:31.918595 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7ecdc-250a-4c30-bec0-10d7a0fe2e92 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:31.961401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:31.976345 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 821/1638] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:25:31 2022] POST /identity/v3/users => generated 293 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:31.977440 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7ecdc-250a-4c30-bec0-10d7a0fe2e92 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:32.016618 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7ecdc-250a-4c30-bec0-10d7a0fe2e92 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:32.027549 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6a857-1d9a-4264-acf4-05022be9678a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:32.028228 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6a857-1d9a-4264-acf4-05022be9678a admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:32.028505 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6a857-1d9a-4264-acf4-05022be9678a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:32.028813 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6a857-1d9a-4264-acf4-05022be9678a admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:32.029465 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd6a857-1d9a-4264-acf4-05022be9678a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:32.031885 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd6a857-1d9a-4264-acf4-05022be9678a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:32.048255 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 822/1639] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:32.052562 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6a857-1d9a-4264-acf4-05022be9678a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:32.055685 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7786f33-0795-4a4a-a5fb-244c982dac95 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:32.063078 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c629eb-4df5-4c15-acfc-3f92f55d4a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:32.064008 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c629eb-4df5-4c15-acfc-3f92f55d4a8a admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:32.064427 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c629eb-4df5-4c15-acfc-3f92f55d4a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:32.064845 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c629eb-4df5-4c15-acfc-3f92f55d4a8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:32.066421 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c629eb-4df5-4c15-acfc-3f92f55d4a8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:32.069307 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c629eb-4df5-4c15-acfc-3f92f55d4a8a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:32.088964 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6a857-1d9a-4264-acf4-05022be9678a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:32.095262 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c8452-a98b-482c-ad81-6b0931e7923b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:32.096073 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c8452-a98b-482c-ad81-6b0931e7923b admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:32.096498 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c8452-a98b-482c-ad81-6b0931e7923b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:32.096861 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c8452-a98b-482c-ad81-6b0931e7923b admin admin] PATH_INFO: `/v3/projects/2dae1c8352cb49a5b290cece5b08a016/users/21ca09a8686743269edc4aa47f1ada13/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:32.109569 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 818/1640] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:25:31 2022] POST /identity/v3/projects => generated 377 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:25:32.113134 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c629eb-4df5-4c15-acfc-3f92f55d4a8a admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:32.123813 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c8452-a98b-482c-ad81-6b0931e7923b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dae1c8352cb49a5b290cece5b08a016, user_id=21ca09a8686743269edc4aa47f1ada13, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:32.126910 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c8452-a98b-482c-ad81-6b0931e7923b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:32.143666 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 823/1641] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:32 2022] PUT /identity/v3/projects/2dae1c8352cb49a5b290cece5b08a016/users/21ca09a8686743269edc4aa47f1ada13/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:32.147438 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c8452-a98b-482c-ad81-6b0931e7923b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:32.194444 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c629eb-4df5-4c15-acfc-3f92f55d4a8a admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:32.220844 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c8452-a98b-482c-ad81-6b0931e7923b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:32.225672 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e1467-4e20-41c8-b630-a0386854f94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:32.226305 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e1467-4e20-41c8-b630-a0386854f94c admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:32.226580 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e1467-4e20-41c8-b630-a0386854f94c admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:32.226849 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e1467-4e20-41c8-b630-a0386854f94c admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:32.227759 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e1467-4e20-41c8-b630-a0386854f94c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:32.230004 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e1467-4e20-41c8-b630-a0386854f94c admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:32.241014 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 824/1642] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 13:25:32.245142 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e1467-4e20-41c8-b630-a0386854f94c admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:32.257120 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e1467-4e20-41c8-b630-a0386854f94c admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:32.262027 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bab5a0-6afe-4ff1-aff9-b24aab77c02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:32.262650 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bab5a0-6afe-4ff1-aff9-b24aab77c02b admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:32.262918 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bab5a0-6afe-4ff1-aff9-b24aab77c02b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:32.263198 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bab5a0-6afe-4ff1-aff9-b24aab77c02b admin admin] PATH_INFO: `/v3/projects/2dae1c8352cb49a5b290cece5b08a016/users/21ca09a8686743269edc4aa47f1ada13/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:32.265268 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bab5a0-6afe-4ff1-aff9-b24aab77c02b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dae1c8352cb49a5b290cece5b08a016, user_id=21ca09a8686743269edc4aa47f1ada13, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:32.268059 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c6e29-bbea-4f08-91f9-4b9ddc880705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:32.268059 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c6e29-bbea-4f08-91f9-4b9ddc880705 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:32.268059 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c6e29-bbea-4f08-91f9-4b9ddc880705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:32.268059 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c6e29-bbea-4f08-91f9-4b9ddc880705 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:32.268580 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bab5a0-6afe-4ff1-aff9-b24aab77c02b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:32.268651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c6e29-bbea-4f08-91f9-4b9ddc880705 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:32.270549 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c6e29-bbea-4f08-91f9-4b9ddc880705 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:32.279519 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 825/1643] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:32 2022] PUT /identity/v3/projects/2dae1c8352cb49a5b290cece5b08a016/users/21ca09a8686743269edc4aa47f1ada13/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:25:32.301614 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 819/1644] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:25:32 2022] POST /identity/v3/users => generated 295 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:25:32.304339 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bab5a0-6afe-4ff1-aff9-b24aab77c02b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:32.428270 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bab5a0-6afe-4ff1-aff9-b24aab77c02b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:32.435551 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eed6d8-7762-4b35-af5a-5ab908b0b99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:32.436494 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eed6d8-7762-4b35-af5a-5ab908b0b99e admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:32.436980 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eed6d8-7762-4b35-af5a-5ab908b0b99e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:32.437636 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eed6d8-7762-4b35-af5a-5ab908b0b99e admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:32.438504 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eed6d8-7762-4b35-af5a-5ab908b0b99e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:32.444058 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eed6d8-7762-4b35-af5a-5ab908b0b99e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:32.464253 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 826/1645] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:32.470757 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c6e29-bbea-4f08-91f9-4b9ddc880705 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:32.487607 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c6e29-bbea-4f08-91f9-4b9ddc880705 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:32.492627 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f59f025-74a8-469e-a2aa-206d8f5d9509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:32.493384 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59f025-74a8-469e-a2aa-206d8f5d9509 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:32.493685 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59f025-74a8-469e-a2aa-206d8f5d9509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:32.493955 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59f025-74a8-469e-a2aa-206d8f5d9509 admin admin] PATH_INFO: `/v3/projects/6892bb604fca41f5adcf193128d8d168/users/8b23f9497c154cc59f5557a55e42b4ed/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:32.498509 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:32.514471 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f59f025-74a8-469e-a2aa-206d8f5d9509 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6892bb604fca41f5adcf193128d8d168, user_id=8b23f9497c154cc59f5557a55e42b4ed, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:32.517479 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f59f025-74a8-469e-a2aa-206d8f5d9509 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:32.535753 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 820/1646] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:32 2022] PUT /identity/v3/projects/6892bb604fca41f5adcf193128d8d168/users/8b23f9497c154cc59f5557a55e42b4ed/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:32.540213 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eed6d8-7762-4b35-af5a-5ab908b0b99e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:32.551847 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eed6d8-7762-4b35-af5a-5ab908b0b99e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:32.615253 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:32.639876 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fda652-81d0-4886-9653-121d3e29be1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:32.640684 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fda652-81d0-4886-9653-121d3e29be1d admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:32.641125 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fda652-81d0-4886-9653-121d3e29be1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:32.641447 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fda652-81d0-4886-9653-121d3e29be1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:32.642179 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fda652-81d0-4886-9653-121d3e29be1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:32.643798 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fda652-81d0-4886-9653-121d3e29be1d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:32.658588 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 827/1647] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:32.660137 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f59f025-74a8-469e-a2aa-206d8f5d9509 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:32.671497 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f59f025-74a8-469e-a2aa-206d8f5d9509 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:32.676555 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb593c51-f4a9-4a1b-be0c-c300d000f851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:32.677259 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb593c51-f4a9-4a1b-be0c-c300d000f851 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:32.678040 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb593c51-f4a9-4a1b-be0c-c300d000f851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:32.678040 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb593c51-f4a9-4a1b-be0c-c300d000f851 admin admin] PATH_INFO: `/v3/projects/6892bb604fca41f5adcf193128d8d168/users/8b23f9497c154cc59f5557a55e42b4ed/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:32.679830 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb593c51-f4a9-4a1b-be0c-c300d000f851 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6892bb604fca41f5adcf193128d8d168, user_id=8b23f9497c154cc59f5557a55e42b4ed, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:32.683144 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb593c51-f4a9-4a1b-be0c-c300d000f851 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:32.701593 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 821/1648] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:32 2022] PUT /identity/v3/projects/6892bb604fca41f5adcf193128d8d168/users/8b23f9497c154cc59f5557a55e42b4ed/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:32.707808 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00021643-c918-49f6-a33d-0802f0de4304 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:32.708100 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00021643-c918-49f6-a33d-0802f0de4304 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:32.708389 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00021643-c918-49f6-a33d-0802f0de4304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:32.743814 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-00021643-c918-49f6-a33d-0802f0de4304 None None] MFA Rules not processed for user `8b23f9497c154cc59f5557a55e42b4ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:32.745456 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-00021643-c918-49f6-a33d-0802f0de4304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:32.847800 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 828/1649] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:32 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:25:32.859887 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb593c51-f4a9-4a1b-be0c-c300d000f851 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:32.861615 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-bb593c51-f4a9-4a1b-be0c-c300d000f851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:32.945265 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb593c51-f4a9-4a1b-be0c-c300d000f851 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:32.950850 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748b52e-ec8d-437a-9f5c-45eebe84613e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:32.951803 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748b52e-ec8d-437a-9f5c-45eebe84613e service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:32.952096 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748b52e-ec8d-437a-9f5c-45eebe84613e service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:32.952375 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748b52e-ec8d-437a-9f5c-45eebe84613e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:33.048796 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748b52e-ec8d-437a-9f5c-45eebe84613e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:33.051135 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748b52e-ec8d-437a-9f5c-45eebe84613e service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:33.067519 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 822/1650] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:25:33.372309 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac99e34-66af-4132-9c77-e0fcd4edd70b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:33.372820 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac99e34-66af-4132-9c77-e0fcd4edd70b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:33.372918 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac99e34-66af-4132-9c77-e0fcd4edd70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:33.439355 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-1ac99e34-66af-4132-9c77-e0fcd4edd70b None None] MFA Rules not processed for user `21ca09a8686743269edc4aa47f1ada13`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:33.440877 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1ac99e34-66af-4132-9c77-e0fcd4edd70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:33.571359 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 829/1651] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:33.583190 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834a1e4-19ca-4de1-b451-5a747d4e866a None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:33.583456 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834a1e4-19ca-4de1-b451-5a747d4e866a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:33.583739 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834a1e4-19ca-4de1-b451-5a747d4e866a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:33.614764 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-e834a1e4-19ca-4de1-b451-5a747d4e866a None None] MFA Rules not processed for user `228922913cf1492a8d12a1a19bf7fd09`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:33.616051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e834a1e4-19ca-4de1-b451-5a747d4e866a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:33.684815 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 823/1652] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:33.696656 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac99e34-66af-4132-9c77-e0fcd4edd70b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:33.698585 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1ac99e34-66af-4132-9c77-e0fcd4edd70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:33.751280 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:33.775915 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac99e34-66af-4132-9c77-e0fcd4edd70b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:33.781629 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16db32-0c28-45bc-adea-d2297cdd0590 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719e4bf834d6490b96066e55a26fb159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:33.782266 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16db32-0c28-45bc-adea-d2297cdd0590 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:33.782549 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16db32-0c28-45bc-adea-d2297cdd0590 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:33.782820 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16db32-0c28-45bc-adea-d2297cdd0590 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:33.797989 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d16db32-0c28-45bc-adea-d2297cdd0590 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:33.800105 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d16db32-0c28-45bc-adea-d2297cdd0590 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:33.812413 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 830/1653] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:25:34.442478 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e834a1e4-19ca-4de1-b451-5a747d4e866a None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:34.452493 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e834a1e4-19ca-4de1-b451-5a747d4e866a None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:34.456429 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c0e31-2975-4b13-8731-767fd4a55773 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:34.457080 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c0e31-2975-4b13-8731-767fd4a55773 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:34.457358 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c0e31-2975-4b13-8731-767fd4a55773 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:34.457663 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c0e31-2975-4b13-8731-767fd4a55773 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:34.488355 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:34.528296 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31c0e31-2975-4b13-8731-767fd4a55773 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:34.529794 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31c0e31-2975-4b13-8731-767fd4a55773 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:34.542625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 824/1654] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:34 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:25:34.697328 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16db32-0c28-45bc-adea-d2297cdd0590 service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:34.712790 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16db32-0c28-45bc-adea-d2297cdd0590 service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:34.720955 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be0bcd-f583-4ffb-afa0-980a1e3262ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:34.721642 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be0bcd-f583-4ffb-afa0-980a1e3262ef service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:34.721924 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be0bcd-f583-4ffb-afa0-980a1e3262ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:34.722191 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be0bcd-f583-4ffb-afa0-980a1e3262ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:34.743168 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be0bcd-f583-4ffb-afa0-980a1e3262ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:34.745140 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be0bcd-f583-4ffb-afa0-980a1e3262ef service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:34.760214 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 831/1655] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:34 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:25:37.807479 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35565f14-e587-4291-91ce-3e1bef40fe2b None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:37.808099 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35565f14-e587-4291-91ce-3e1bef40fe2b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:37.808099 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35565f14-e587-4291-91ce-3e1bef40fe2b None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:37.809663 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 825/1656] 10.222.0.52 () {54 vars in 912 bytes} [Thu Oct 27 13:25:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:25:37.816914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361e5c2-3a75-4f7c-862c-f244ac3b71bb None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:37.817428 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361e5c2-3a75-4f7c-862c-f244ac3b71bb None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:37.817807 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361e5c2-3a75-4f7c-862c-f244ac3b71bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:37.872799 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-a361e5c2-3a75-4f7c-862c-f244ac3b71bb None None] MFA Rules not processed for user `cbcd6da4e42248a3b38101104fbc03cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:37.872799 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a361e5c2-3a75-4f7c-862c-f244ac3b71bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:37.949563 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 832/1657] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Oct 27 13:25:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:37.978561 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1f527-2779-43bb-92d2-14d8dd206e79 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:37.978843 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1f527-2779-43bb-92d2-14d8dd206e79 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:37.979114 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1f527-2779-43bb-92d2-14d8dd206e79 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:37.980716 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 826/1658] 10.222.0.52 () {54 vars in 961 bytes} [Thu Oct 27 13:25:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:25:37.986398 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5474a7-9a47-4c91-a17e-af3da0c97de1 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:37.986926 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5474a7-9a47-4c91-a17e-af3da0c97de1 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:37.987269 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5474a7-9a47-4c91-a17e-af3da0c97de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:38.011153 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-2e5474a7-9a47-4c91-a17e-af3da0c97de1 None None] MFA Rules not processed for user `cbcd6da4e42248a3b38101104fbc03cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:38.014998 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2e5474a7-9a47-4c91-a17e-af3da0c97de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:38.032127 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 833/1659] 10.222.0.52 () {58 vars in 1058 bytes} [Thu Oct 27 13:25:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:38.040286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1f527-2779-43bb-92d2-14d8dd206e79 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:38.055894 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1f527-2779-43bb-92d2-14d8dd206e79 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:38.061697 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3d6a1-fde6-42fa-93ac-11b476ba75fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbcd6da4e42248a3b38101104fbc03cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:38.062447 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3d6a1-fde6-42fa-93ac-11b476ba75fa service placement] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:38.062980 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3d6a1-fde6-42fa-93ac-11b476ba75fa service placement] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:38.063288 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3d6a1-fde6-42fa-93ac-11b476ba75fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:38.074576 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3d6a1-fde6-42fa-93ac-11b476ba75fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:38.076581 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3d6a1-fde6-42fa-93ac-11b476ba75fa service placement] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:38.097470 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 827/1660] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:25:39.049893 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5474a7-9a47-4c91-a17e-af3da0c97de1 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:39.182409 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5474a7-9a47-4c91-a17e-af3da0c97de1 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:39.188649 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345d9e8-d470-4ae1-a184-e8fb8e37207f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:39.190460 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345d9e8-d470-4ae1-a184-e8fb8e37207f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:39.191046 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345d9e8-d470-4ae1-a184-e8fb8e37207f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:39.191887 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345d9e8-d470-4ae1-a184-e8fb8e37207f admin admin] PATH_INFO: `/v3/users/3ef905f821dd448c9bbbc3f12c08e26b` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:39.193908 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d345d9e8-d470-4ae1-a184-e8fb8e37207f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ef905f821dd448c9bbbc3f12c08e26b)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:39.196819 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d345d9e8-d470-4ae1-a184-e8fb8e37207f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:39.288419 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d345d9e8-d470-4ae1-a184-e8fb8e37207f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ef905f821dd448c9bbbc3f12c08e26b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:39.289159 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d345d9e8-d470-4ae1-a184-e8fb8e37207f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ef905f821dd448c9bbbc3f12c08e26b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:39.296323 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:39.301812 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d345d9e8-d470-4ae1-a184-e8fb8e37207f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ef905f821dd448c9bbbc3f12c08e26b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:39.323220 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d345d9e8-d470-4ae1-a184-e8fb8e37207f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ef905f821dd448c9bbbc3f12c08e26b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:39.323990 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d345d9e8-d470-4ae1-a184-e8fb8e37207f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ef905f821dd448c9bbbc3f12c08e26b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:39.354339 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 834/1661] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:25:39 2022] DELETE /identity/v3/users/3ef905f821dd448c9bbbc3f12c08e26b => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:39.359625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea3d2e-9464-437e-b62e-f94ed875c9c1 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:39.360942 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea3d2e-9464-437e-b62e-f94ed875c9c1 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:39.361420 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea3d2e-9464-437e-b62e-f94ed875c9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:39.427394 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-4eea3d2e-9464-437e-b62e-f94ed875c9c1 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:39.430053 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-4eea3d2e-9464-437e-b62e-f94ed875c9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:39.557016 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 828/1662] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:25:39.584146 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345d9e8-d470-4ae1-a184-e8fb8e37207f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:39.585709 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d345d9e8-d470-4ae1-a184-e8fb8e37207f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:39.694463 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345d9e8-d470-4ae1-a184-e8fb8e37207f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:39.706378 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7325b1-19e9-4b45-b2d4-8b9eceac5a93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:39.707187 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7325b1-19e9-4b45-b2d4-8b9eceac5a93 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:39.707513 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7325b1-19e9-4b45-b2d4-8b9eceac5a93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:39.707881 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7325b1-19e9-4b45-b2d4-8b9eceac5a93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:39.733637 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7325b1-19e9-4b45-b2d4-8b9eceac5a93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:39.739492 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7325b1-19e9-4b45-b2d4-8b9eceac5a93 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:39.765039 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 835/1663] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:25:39.776262 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea3d2e-9464-437e-b62e-f94ed875c9c1 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:39.778411 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-4eea3d2e-9464-437e-b62e-f94ed875c9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:39.803702 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea3d2e-9464-437e-b62e-f94ed875c9c1 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:39.828951 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56d15b-5fcb-402b-8527-d57df415016d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:39.829657 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56d15b-5fcb-402b-8527-d57df415016d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:39.829936 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56d15b-5fcb-402b-8527-d57df415016d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:39.830204 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56d15b-5fcb-402b-8527-d57df415016d admin admin] PATH_INFO: `/v3/users/0c5b4232fcbe4c7ebb7e0ffc97ebe135` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:39.835572 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56d15b-5fcb-402b-8527-d57df415016d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c5b4232fcbe4c7ebb7e0ffc97ebe135)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:39.837962 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56d15b-5fcb-402b-8527-d57df415016d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:39.938743 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2e56d15b-5fcb-402b-8527-d57df415016d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c5b4232fcbe4c7ebb7e0ffc97ebe135'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:39.944114 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2e56d15b-5fcb-402b-8527-d57df415016d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c5b4232fcbe4c7ebb7e0ffc97ebe135'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:39.958935 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2e56d15b-5fcb-402b-8527-d57df415016d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c5b4232fcbe4c7ebb7e0ffc97ebe135'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:39.976242 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2e56d15b-5fcb-402b-8527-d57df415016d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c5b4232fcbe4c7ebb7e0ffc97ebe135'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:39.977314 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2e56d15b-5fcb-402b-8527-d57df415016d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c5b4232fcbe4c7ebb7e0ffc97ebe135'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:40.005799 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 829/1664] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:25:39 2022] DELETE /identity/v3/users/0c5b4232fcbe4c7ebb7e0ffc97ebe135 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:40.009746 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75531185-12da-4b83-a4a3-89daf8261487 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:40.010407 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75531185-12da-4b83-a4a3-89daf8261487 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:40.010694 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75531185-12da-4b83-a4a3-89daf8261487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:40.054468 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-75531185-12da-4b83-a4a3-89daf8261487 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:40.057309 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-75531185-12da-4b83-a4a3-89daf8261487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:40.159931 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 836/1665] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:25:40.183945 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56d15b-5fcb-402b-8527-d57df415016d admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:40.186103 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2e56d15b-5fcb-402b-8527-d57df415016d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:40.234266 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:40.283049 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56d15b-5fcb-402b-8527-d57df415016d admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:40.287680 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee8d5c-7d14-41c6-98df-c7b28a63bf4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:40.288502 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee8d5c-7d14-41c6-98df-c7b28a63bf4a service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:40.289106 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee8d5c-7d14-41c6-98df-c7b28a63bf4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:40.289693 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee8d5c-7d14-41c6-98df-c7b28a63bf4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:40.302580 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee8d5c-7d14-41c6-98df-c7b28a63bf4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:40.304652 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee8d5c-7d14-41c6-98df-c7b28a63bf4a service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:40.317425 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 830/1666] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:25:40.372023 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75531185-12da-4b83-a4a3-89daf8261487 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:40.373684 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-75531185-12da-4b83-a4a3-89daf8261487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:40.393369 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75531185-12da-4b83-a4a3-89daf8261487 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:40.402411 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22fb52-8336-49ad-bc5a-bc749f694cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:40.404113 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22fb52-8336-49ad-bc5a-bc749f694cbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:40.404605 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22fb52-8336-49ad-bc5a-bc749f694cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:40.405031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22fb52-8336-49ad-bc5a-bc749f694cbe admin admin] PATH_INFO: `/v3/projects/275c20b71ede4ac999d9f3efc8d351c1` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:40.408336 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d22fb52-8336-49ad-bc5a-bc749f694cbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=275c20b71ede4ac999d9f3efc8d351c1)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:40.412282 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d22fb52-8336-49ad-bc5a-bc749f694cbe admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:40.501289 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6d22fb52-8336-49ad-bc5a-bc749f694cbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '275c20b71ede4ac999d9f3efc8d351c1', 'request_id': 'req-6d22fb52-8336-49ad-bc5a-bc749f694cbe'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:40.510369 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6d22fb52-8336-49ad-bc5a-bc749f694cbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '275c20b71ede4ac999d9f3efc8d351c1', 'request_id': 'req-6d22fb52-8336-49ad-bc5a-bc749f694cbe'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:40.521694 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6d22fb52-8336-49ad-bc5a-bc749f694cbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '275c20b71ede4ac999d9f3efc8d351c1', 'request_id': 'req-6d22fb52-8336-49ad-bc5a-bc749f694cbe'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:40.531915 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:40.556415 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6d22fb52-8336-49ad-bc5a-bc749f694cbe admin admin] The token cache is being invalidate because project 275c20b71ede4ac999d9f3efc8d351c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:25:40.556810 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6d22fb52-8336-49ad-bc5a-bc749f694cbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:40.557652 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6d22fb52-8336-49ad-bc5a-bc749f694cbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:40.559788 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 837/1667] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:25:40 2022] DELETE /identity/v3/projects/275c20b71ede4ac999d9f3efc8d351c1 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:40.565859 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee8d5c-7d14-41c6-98df-c7b28a63bf4a service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:40.580194 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee8d5c-7d14-41c6-98df-c7b28a63bf4a service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:40.773091 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfdef43-d281-4afa-9566-f59a4f5b5b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:40.773958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdef43-d281-4afa-9566-f59a4f5b5b47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:40.774246 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdef43-d281-4afa-9566-f59a4f5b5b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:40.774587 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdef43-d281-4afa-9566-f59a4f5b5b47 admin admin] PATH_INFO: `/v3/users/8b23f9497c154cc59f5557a55e42b4ed` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:40.776048 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfdef43-d281-4afa-9566-f59a4f5b5b47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b23f9497c154cc59f5557a55e42b4ed)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:40.782854 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfdef43-d281-4afa-9566-f59a4f5b5b47 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:40.890994 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-3cfdef43-d281-4afa-9566-f59a4f5b5b47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b23f9497c154cc59f5557a55e42b4ed'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:40.895032 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-3cfdef43-d281-4afa-9566-f59a4f5b5b47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b23f9497c154cc59f5557a55e42b4ed'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:40.919250 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-3cfdef43-d281-4afa-9566-f59a4f5b5b47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b23f9497c154cc59f5557a55e42b4ed'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:40.954545 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-3cfdef43-d281-4afa-9566-f59a4f5b5b47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b23f9497c154cc59f5557a55e42b4ed'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:40.956197 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-3cfdef43-d281-4afa-9566-f59a4f5b5b47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b23f9497c154cc59f5557a55e42b4ed'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:40.980932 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 831/1668] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:25:40 2022] DELETE /identity/v3/users/8b23f9497c154cc59f5557a55e42b4ed => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:41.104474 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58040a-a232-49a4-b18e-13de903f87b6 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:41.105143 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58040a-a232-49a4-b18e-13de903f87b6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:41.105143 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58040a-a232-49a4-b18e-13de903f87b6 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:41.106604 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 838/1669] 10.222.0.52 () {54 vars in 912 bytes} [Thu Oct 27 13:25:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:25:41.120689 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e690f49-681d-48bf-a950-7d2a699a6092 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:41.121042 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e690f49-681d-48bf-a950-7d2a699a6092 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:41.121388 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e690f49-681d-48bf-a950-7d2a699a6092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:41.154647 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-0e690f49-681d-48bf-a950-7d2a699a6092 None None] MFA Rules not processed for user `cbcd6da4e42248a3b38101104fbc03cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:41.156372 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0e690f49-681d-48bf-a950-7d2a699a6092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:41.235620 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58040a-a232-49a4-b18e-13de903f87b6 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:41.237599 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ed58040a-a232-49a4-b18e-13de903f87b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:41.249787 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:41.300629 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 832/1670] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Oct 27 13:25:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:41.331910 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e690f49-681d-48bf-a950-7d2a699a6092 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:41.333770 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0e690f49-681d-48bf-a950-7d2a699a6092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:41.343345 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58040a-a232-49a4-b18e-13de903f87b6 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:41.349345 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1646a-6305-4c6d-923d-a2882b85c4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:41.350244 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1646a-6305-4c6d-923d-a2882b85c4b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:41.350595 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1646a-6305-4c6d-923d-a2882b85c4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:41.350930 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1646a-6305-4c6d-923d-a2882b85c4b8 admin admin] PATH_INFO: `/v3/projects/1eaa45e3c2144058816e4866ed84c263` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:41.351047 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e690f49-681d-48bf-a950-7d2a699a6092 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:41.352297 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1646a-6305-4c6d-923d-a2882b85c4b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eaa45e3c2144058816e4866ed84c263)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:41.355507 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1646a-6305-4c6d-923d-a2882b85c4b8 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:41.357861 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb344ec-3e09-494b-a341-b1b50af17604 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbcd6da4e42248a3b38101104fbc03cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:41.358895 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb344ec-3e09-494b-a341-b1b50af17604 service placement] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:41.359253 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb344ec-3e09-494b-a341-b1b50af17604 service placement] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:41.359598 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb344ec-3e09-494b-a341-b1b50af17604 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:41.370562 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb344ec-3e09-494b-a341-b1b50af17604 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:41.372431 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb344ec-3e09-494b-a341-b1b50af17604 service placement] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:41.386554 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 833/1671] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:25:41.446637 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb344ec-3e09-494b-a341-b1b50af17604 service placement] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:41.448304 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-cbb344ec-3e09-494b-a341-b1b50af17604 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:41.462215 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-49a1646a-6305-4c6d-923d-a2882b85c4b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eaa45e3c2144058816e4866ed84c263', 'request_id': 'req-49a1646a-6305-4c6d-923d-a2882b85c4b8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:41.467585 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb344ec-3e09-494b-a341-b1b50af17604 service placement] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:41.473393 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-49a1646a-6305-4c6d-923d-a2882b85c4b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eaa45e3c2144058816e4866ed84c263', 'request_id': 'req-49a1646a-6305-4c6d-923d-a2882b85c4b8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:41.485213 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-49a1646a-6305-4c6d-923d-a2882b85c4b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eaa45e3c2144058816e4866ed84c263', 'request_id': 'req-49a1646a-6305-4c6d-923d-a2882b85c4b8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:41.507055 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-49a1646a-6305-4c6d-923d-a2882b85c4b8 admin admin] The token cache is being invalidate because project 1eaa45e3c2144058816e4866ed84c263 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:25:41.507176 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-49a1646a-6305-4c6d-923d-a2882b85c4b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:41.508783 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-49a1646a-6305-4c6d-923d-a2882b85c4b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:41.511784 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 839/1672] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:25:41 2022] DELETE /identity/v3/projects/1eaa45e3c2144058816e4866ed84c263 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:25:41.516367 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84992c91-0624-457a-992e-559755861c9e None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:41.516861 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84992c91-0624-457a-992e-559755861c9e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:41.517314 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84992c91-0624-457a-992e-559755861c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:41.543873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-84992c91-0624-457a-992e-559755861c9e None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:41.545377 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-84992c91-0624-457a-992e-559755861c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:41.569061 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796b95d-70c1-432f-bf42-d2acb3ba66a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:41.570055 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796b95d-70c1-432f-bf42-d2acb3ba66a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:41.570302 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796b95d-70c1-432f-bf42-d2acb3ba66a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:41.570641 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796b95d-70c1-432f-bf42-d2acb3ba66a3 admin admin] PATH_INFO: `/v3/projects/6892bb604fca41f5adcf193128d8d168` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:41.572340 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e796b95d-70c1-432f-bf42-d2acb3ba66a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6892bb604fca41f5adcf193128d8d168)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:41.574563 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e796b95d-70c1-432f-bf42-d2acb3ba66a3 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:41.640468 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 840/1673] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:41.641398 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-e796b95d-70c1-432f-bf42-d2acb3ba66a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6892bb604fca41f5adcf193128d8d168', 'request_id': 'req-e796b95d-70c1-432f-bf42-d2acb3ba66a3'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:41.649840 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4843121-8d7c-4e21-aa35-11c2e7fdc255 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:41.650210 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4843121-8d7c-4e21-aa35-11c2e7fdc255 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:41.650433 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4843121-8d7c-4e21-aa35-11c2e7fdc255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:41.653673 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-e796b95d-70c1-432f-bf42-d2acb3ba66a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6892bb604fca41f5adcf193128d8d168', 'request_id': 'req-e796b95d-70c1-432f-bf42-d2acb3ba66a3'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:41.664492 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-e796b95d-70c1-432f-bf42-d2acb3ba66a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6892bb604fca41f5adcf193128d8d168', 'request_id': 'req-e796b95d-70c1-432f-bf42-d2acb3ba66a3'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:41.674017 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-c4843121-8d7c-4e21-aa35-11c2e7fdc255 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:41.675836 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c4843121-8d7c-4e21-aa35-11c2e7fdc255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:41.680694 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-e796b95d-70c1-432f-bf42-d2acb3ba66a3 admin admin] The token cache is being invalidate because project 6892bb604fca41f5adcf193128d8d168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:25:41.681084 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-e796b95d-70c1-432f-bf42-d2acb3ba66a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:41.681977 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-e796b95d-70c1-432f-bf42-d2acb3ba66a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:41.684677 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 834/1674] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:25:41 2022] DELETE /identity/v3/projects/6892bb604fca41f5adcf193128d8d168 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:25:41.691214 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcddecd-c96a-4687-82e9-7dfd746dc074 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:41.691570 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcddecd-c96a-4687-82e9-7dfd746dc074 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:41.692030 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcddecd-c96a-4687-82e9-7dfd746dc074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:41.706195 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:41.717852 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-3dcddecd-c96a-4687-82e9-7dfd746dc074 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:41.719763 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3dcddecd-c96a-4687-82e9-7dfd746dc074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:41.764824 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 841/1675] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:25:41.765733 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4843121-8d7c-4e21-aa35-11c2e7fdc255 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:41.776843 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4843121-8d7c-4e21-aa35-11c2e7fdc255 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:41.790893 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c7fc0-235d-4131-83a1-80679fc029a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:41.793019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c7fc0-235d-4131-83a1-80679fc029a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:41.794723 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c7fc0-235d-4131-83a1-80679fc029a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:41.795008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c7fc0-235d-4131-83a1-80679fc029a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:41.795722 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c7fc0-235d-4131-83a1-80679fc029a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:25:41.796038 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c7fc0-235d-4131-83a1-80679fc029a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:41.800828 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c7fc0-235d-4131-83a1-80679fc029a5 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:41.819094 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 842/1676] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:25:41.822127 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c7fc0-235d-4131-83a1-80679fc029a5 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:41.832859 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:41.845229 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c7fc0-235d-4131-83a1-80679fc029a5 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:41.856304 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070f9b9-fa2a-49c6-8292-6d67cd02281f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:41.856703 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070f9b9-fa2a-49c6-8292-6d67cd02281f admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:41.856980 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070f9b9-fa2a-49c6-8292-6d67cd02281f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:41.857250 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070f9b9-fa2a-49c6-8292-6d67cd02281f admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:41.857923 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070f9b9-fa2a-49c6-8292-6d67cd02281f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:41.859881 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070f9b9-fa2a-49c6-8292-6d67cd02281f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:41.860865 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 835/1677] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:41.862747 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6752a-362e-4d71-97b4-f1f6a8e62d81 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:41.863986 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6752a-362e-4d71-97b4-f1f6a8e62d81 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:41.864491 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6752a-362e-4d71-97b4-f1f6a8e62d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:41.886622 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-e8c6752a-362e-4d71-97b4-f1f6a8e62d81 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:41.888015 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e8c6752a-362e-4d71-97b4-f1f6a8e62d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:41.905775 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 836/1678] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:41.910852 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6752a-362e-4d71-97b4-f1f6a8e62d81 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:41.932384 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 843/1679] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:25:41 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:41.935767 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6752a-362e-4d71-97b4-f1f6a8e62d81 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:41.937356 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070f9b9-fa2a-49c6-8292-6d67cd02281f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:42.068278 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070f9b9-fa2a-49c6-8292-6d67cd02281f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:42.074632 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb9f59-b7cc-435e-a1c9-211d7a79c888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:42.076190 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb9f59-b7cc-435e-a1c9-211d7a79c888 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:42.076733 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb9f59-b7cc-435e-a1c9-211d7a79c888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:42.077298 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb9f59-b7cc-435e-a1c9-211d7a79c888 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:42.078188 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb9f59-b7cc-435e-a1c9-211d7a79c888 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:42.080417 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb9f59-b7cc-435e-a1c9-211d7a79c888 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:42.101794 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30bed4-f216-4afe-9ea9-23b936e9443e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:42.103775 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30bed4-f216-4afe-9ea9-23b936e9443e admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:42.106276 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30bed4-f216-4afe-9ea9-23b936e9443e admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:42.106756 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30bed4-f216-4afe-9ea9-23b936e9443e admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:42.109307 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd30bed4-f216-4afe-9ea9-23b936e9443e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:25:42.109899 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd30bed4-f216-4afe-9ea9-23b936e9443e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:42.114697 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd30bed4-f216-4afe-9ea9-23b936e9443e admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:42.121417 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 844/1680] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:25:41 2022] POST /identity/v3/users => generated 289 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:42.125811 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb9f59-b7cc-435e-a1c9-211d7a79c888 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:42.140447 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb9f59-b7cc-435e-a1c9-211d7a79c888 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:42.147156 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 837/1681] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:25:42.158040 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30bed4-f216-4afe-9ea9-23b936e9443e admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:42.163839 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22933705-92dc-4057-9b57-9106fa905a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:42.164952 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22933705-92dc-4057-9b57-9106fa905a14 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:42.165390 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22933705-92dc-4057-9b57-9106fa905a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:42.165837 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22933705-92dc-4057-9b57-9106fa905a14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:42.167229 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22933705-92dc-4057-9b57-9106fa905a14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:42.169387 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22933705-92dc-4057-9b57-9106fa905a14 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:42.184659 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 845/1682] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 13:25:42.189824 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22933705-92dc-4057-9b57-9106fa905a14 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:42.190384 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30bed4-f216-4afe-9ea9-23b936e9443e admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:42.201196 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb8512-b5f2-4482-a99c-41671210e8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:42.202072 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb8512-b5f2-4482-a99c-41671210e8c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:42.202504 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb8512-b5f2-4482-a99c-41671210e8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:42.202775 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb8512-b5f2-4482-a99c-41671210e8c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:42.204533 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb8512-b5f2-4482-a99c-41671210e8c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:42.205422 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22933705-92dc-4057-9b57-9106fa905a14 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:42.208452 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb8512-b5f2-4482-a99c-41671210e8c4 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:42.211073 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32cfcae-6b02-422a-9a34-0d890078ba78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:42.211989 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32cfcae-6b02-422a-9a34-0d890078ba78 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:42.212758 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32cfcae-6b02-422a-9a34-0d890078ba78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:42.213502 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32cfcae-6b02-422a-9a34-0d890078ba78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:42.214385 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32cfcae-6b02-422a-9a34-0d890078ba78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:42.216398 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32cfcae-6b02-422a-9a34-0d890078ba78 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:42.229269 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 846/1683] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 13:25:42.234098 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32cfcae-6b02-422a-9a34-0d890078ba78 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:42.252054 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32cfcae-6b02-422a-9a34-0d890078ba78 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:42.257468 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 838/1684] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:25:42 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:42.262042 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb8512-b5f2-4482-a99c-41671210e8c4 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:42.362903 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb8512-b5f2-4482-a99c-41671210e8c4 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:42.368610 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c75eb1-6d4b-4dc2-b584-f7c2ca9636a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:42.368859 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43cba88-6f0d-48ed-a764-3ab89e2ff69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:42.369311 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43cba88-6f0d-48ed-a764-3ab89e2ff69b admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:42.369621 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43cba88-6f0d-48ed-a764-3ab89e2ff69b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:42.369743 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c75eb1-6d4b-4dc2-b584-f7c2ca9636a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:42.369893 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43cba88-6f0d-48ed-a764-3ab89e2ff69b admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:42.370566 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43cba88-6f0d-48ed-a764-3ab89e2ff69b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:42.370959 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c75eb1-6d4b-4dc2-b584-f7c2ca9636a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:42.371344 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c75eb1-6d4b-4dc2-b584-f7c2ca9636a8 admin admin] PATH_INFO: `/v3/projects/6333a45d94b14e838588481692a0e944/users/06762108f83e4e47a0d568d236734b1c/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:42.372737 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43cba88-6f0d-48ed-a764-3ab89e2ff69b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:42.390526 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:42.394768 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c75eb1-6d4b-4dc2-b584-f7c2ca9636a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6333a45d94b14e838588481692a0e944, user_id=06762108f83e4e47a0d568d236734b1c, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:42.397221 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c75eb1-6d4b-4dc2-b584-f7c2ca9636a8 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:42.409875 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 839/1685] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:25:42 2022] POST /identity/v3/users => generated 292 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:25:42.414249 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43cba88-6f0d-48ed-a764-3ab89e2ff69b admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:42.417713 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 847/1686] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:42 2022] PUT /identity/v3/projects/6333a45d94b14e838588481692a0e944/users/06762108f83e4e47a0d568d236734b1c/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:42.427210 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43cba88-6f0d-48ed-a764-3ab89e2ff69b admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:42.429701 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f5d62-f131-4daa-a98f-d5fb0b1bd3cd None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:42.430327 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f5d62-f131-4daa-a98f-d5fb0b1bd3cd None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:42.430759 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f5d62-f131-4daa-a98f-d5fb0b1bd3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:42.481280 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-0b9f5d62-f131-4daa-a98f-d5fb0b1bd3cd None None] MFA Rules not processed for user `06762108f83e4e47a0d568d236734b1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:42.482813 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0b9f5d62-f131-4daa-a98f-d5fb0b1bd3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:42.496063 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:42.506065 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c9899f-6054-481c-b491-073850cd9d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:42.506690 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9899f-6054-481c-b491-073850cd9d82 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:42.506967 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9899f-6054-481c-b491-073850cd9d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:42.507237 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9899f-6054-481c-b491-073850cd9d82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:42.508402 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c9899f-6054-481c-b491-073850cd9d82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:42.510405 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c9899f-6054-481c-b491-073850cd9d82 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:42.529274 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 840/1687] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 13:25:42.530249 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c9899f-6054-481c-b491-073850cd9d82 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:42.542512 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c9899f-6054-481c-b491-073850cd9d82 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:42.547828 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb68bf-eb60-4d05-8a40-ab087b214417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:42.548453 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb68bf-eb60-4d05-8a40-ab087b214417 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:42.548725 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb68bf-eb60-4d05-8a40-ab087b214417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:42.548991 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb68bf-eb60-4d05-8a40-ab087b214417 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:42.549660 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb68bf-eb60-4d05-8a40-ab087b214417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:42.551918 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb68bf-eb60-4d05-8a40-ab087b214417 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:42.564684 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 841/1688] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:42.569978 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb68bf-eb60-4d05-8a40-ab087b214417 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:42.582225 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 848/1689] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:25:42.585965 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb68bf-eb60-4d05-8a40-ab087b214417 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:42.589104 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5022d-86a3-4e6a-9aee-57079e3df322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:42.589299 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f5d62-f131-4daa-a98f-d5fb0b1bd3cd None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:42.589844 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5022d-86a3-4e6a-9aee-57079e3df322 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:42.590233 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5022d-86a3-4e6a-9aee-57079e3df322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:42.590414 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5022d-86a3-4e6a-9aee-57079e3df322 admin admin] PATH_INFO: `/v3/projects/70c30fcc23b74f82920908719b951447/users/4720e3d8c30b4602a938da29e636f447/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:42.607192 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a5022d-86a3-4e6a-9aee-57079e3df322 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70c30fcc23b74f82920908719b951447, user_id=4720e3d8c30b4602a938da29e636f447, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:42.607825 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f5d62-f131-4daa-a98f-d5fb0b1bd3cd None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:42.609719 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a5022d-86a3-4e6a-9aee-57079e3df322 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:42.615916 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d46fde-679f-429d-877e-db9afda0379b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:42.617076 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d46fde-679f-429d-877e-db9afda0379b admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:42.618682 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d46fde-679f-429d-877e-db9afda0379b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:42.618933 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d46fde-679f-429d-877e-db9afda0379b admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:42.619707 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d46fde-679f-429d-877e-db9afda0379b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:42.622385 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d46fde-679f-429d-877e-db9afda0379b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:42.640325 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 842/1690] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:42 2022] PUT /identity/v3/projects/70c30fcc23b74f82920908719b951447/users/4720e3d8c30b4602a938da29e636f447/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:25:42.642104 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0c2c5-70bb-4dc4-8de0-4ea1f7e6ec91 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:42.642587 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0c2c5-70bb-4dc4-8de0-4ea1f7e6ec91 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:42.643065 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0c2c5-70bb-4dc4-8de0-4ea1f7e6ec91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:42.683272 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-97e0c2c5-70bb-4dc4-8de0-4ea1f7e6ec91 None None] MFA Rules not processed for user `4720e3d8c30b4602a938da29e636f447`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:42.688055 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 849/1691] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:25:42 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:42.688871 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-97e0c2c5-70bb-4dc4-8de0-4ea1f7e6ec91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:42.692264 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d46fde-679f-429d-877e-db9afda0379b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:42.774801 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 843/1692] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:42.776243 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f63d7-0a1e-42af-a8b0-cf672a57f1db None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:42.776524 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f63d7-0a1e-42af-a8b0-cf672a57f1db None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:42.776801 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f63d7-0a1e-42af-a8b0-cf672a57f1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:42.777975 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d46fde-679f-429d-877e-db9afda0379b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:42.783032 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f37d2-060a-474a-9579-f03c75690fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:42.783652 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f37d2-060a-474a-9579-f03c75690fd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:42.786462 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f37d2-060a-474a-9579-f03c75690fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:42.786462 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f37d2-060a-474a-9579-f03c75690fd4 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:42.786462 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f37d2-060a-474a-9579-f03c75690fd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:42.786838 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f37d2-060a-474a-9579-f03c75690fd4 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:42.798434 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-b05f63d7-0a1e-42af-a8b0-cf672a57f1db None None] MFA Rules not processed for user `6b715ce1b1b2441c968102cadb1dea50`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:42.799723 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b05f63d7-0a1e-42af-a8b0-cf672a57f1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:42.812622 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 850/1693] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:25:42 2022] POST /identity/v3/users => generated 289 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:42.814931 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f37d2-060a-474a-9579-f03c75690fd4 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:42.826688 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f37d2-060a-474a-9579-f03c75690fd4 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:42.831875 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bcefae-a56c-42aa-9344-15900cf62202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:42.832501 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bcefae-a56c-42aa-9344-15900cf62202 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:42.832752 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bcefae-a56c-42aa-9344-15900cf62202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:42.833027 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bcefae-a56c-42aa-9344-15900cf62202 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:42.833695 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bcefae-a56c-42aa-9344-15900cf62202 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:42.835659 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bcefae-a56c-42aa-9344-15900cf62202 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:42.859874 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 844/1694] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:42.860786 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f63d7-0a1e-42af-a8b0-cf672a57f1db None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:42.873216 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 851/1695] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:25:42 2022] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:42.877417 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bcefae-a56c-42aa-9344-15900cf62202 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:42.877926 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f63d7-0a1e-42af-a8b0-cf672a57f1db None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:42.904979 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:42.938498 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:42.951619 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b054325d-b4aa-40b8-8ef3-8143b6b0a12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:42.952544 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054325d-b4aa-40b8-8ef3-8143b6b0a12e admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:42.952982 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054325d-b4aa-40b8-8ef3-8143b6b0a12e admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:42.953406 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054325d-b4aa-40b8-8ef3-8143b6b0a12e admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:42.954422 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b054325d-b4aa-40b8-8ef3-8143b6b0a12e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:42.956331 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b054325d-b4aa-40b8-8ef3-8143b6b0a12e admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:42.962367 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bcefae-a56c-42aa-9344-15900cf62202 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:42.967335 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543573fd-b2da-4acd-8370-def26ba06655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:42.968198 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543573fd-b2da-4acd-8370-def26ba06655 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:42.968551 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543573fd-b2da-4acd-8370-def26ba06655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:42.971833 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543573fd-b2da-4acd-8370-def26ba06655 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:42.971833 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543573fd-b2da-4acd-8370-def26ba06655 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:42.971833 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543573fd-b2da-4acd-8370-def26ba06655 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:42.972766 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 845/1696] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:42.973841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b054325d-b4aa-40b8-8ef3-8143b6b0a12e admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:42.985088 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b054325d-b4aa-40b8-8ef3-8143b6b0a12e admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:42.990752 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009507f-01bd-47f0-8028-f25bcbe6a4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:42.993962 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009507f-01bd-47f0-8028-f25bcbe6a4fb admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:42.995597 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009507f-01bd-47f0-8028-f25bcbe6a4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:42.995976 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009507f-01bd-47f0-8028-f25bcbe6a4fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:42.997041 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0009507f-01bd-47f0-8028-f25bcbe6a4fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:42.998853 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0009507f-01bd-47f0-8028-f25bcbe6a4fb admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:43.000478 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 852/1697] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:25:42 2022] POST /identity/v3/users => generated 297 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:25:43.011618 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543573fd-b2da-4acd-8370-def26ba06655 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:43.014727 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 846/1698] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:43.015865 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009507f-01bd-47f0-8028-f25bcbe6a4fb admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:43.025117 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543573fd-b2da-4acd-8370-def26ba06655 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:43.031867 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd3077-468d-4967-9ae8-8473bc79ab6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:43.032481 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd3077-468d-4967-9ae8-8473bc79ab6d admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:43.033399 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd3077-468d-4967-9ae8-8473bc79ab6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:43.033399 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd3077-468d-4967-9ae8-8473bc79ab6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:43.033644 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009507f-01bd-47f0-8028-f25bcbe6a4fb admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:43.033759 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd3077-468d-4967-9ae8-8473bc79ab6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:43.035652 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd3077-468d-4967-9ae8-8473bc79ab6d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:43.040430 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86672981-d0d4-479b-94b6-53a966ece77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:43.041104 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86672981-d0d4-479b-94b6-53a966ece77f admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:43.041376 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86672981-d0d4-479b-94b6-53a966ece77f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:43.041680 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86672981-d0d4-479b-94b6-53a966ece77f admin admin] PATH_INFO: `/v3/projects/f8a238a986b74ad18ef16a93e17bd0e1/users/cb565c6b954b4c9fbb3b5dba6aa3c90d/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:43.050167 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 853/1699] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:43.054401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd3077-468d-4967-9ae8-8473bc79ab6d admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:43.059132 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86672981-d0d4-479b-94b6-53a966ece77f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8a238a986b74ad18ef16a93e17bd0e1, user_id=cb565c6b954b4c9fbb3b5dba6aa3c90d, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:43.062370 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86672981-d0d4-479b-94b6-53a966ece77f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:43.066212 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd3077-468d-4967-9ae8-8473bc79ab6d admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:43.071369 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744140b-7af0-42a0-936a-055500df6426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:43.072152 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744140b-7af0-42a0-936a-055500df6426 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:43.072659 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744140b-7af0-42a0-936a-055500df6426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:43.072968 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744140b-7af0-42a0-936a-055500df6426 admin admin] PATH_INFO: `/v3/projects/6898c35b50cc413c94cf4c9d53be6308/users/60e65a0951824e6e86e396654c2c4ffe/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:43.090087 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 847/1700] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:43 2022] PUT /identity/v3/projects/f8a238a986b74ad18ef16a93e17bd0e1/users/cb565c6b954b4c9fbb3b5dba6aa3c90d/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:43.090700 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1744140b-7af0-42a0-936a-055500df6426 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6898c35b50cc413c94cf4c9d53be6308, user_id=60e65a0951824e6e86e396654c2c4ffe, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:43.092592 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707636c-b901-45b5-9735-26ce7dc4b526 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:43.092874 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707636c-b901-45b5-9735-26ce7dc4b526 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:43.093180 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707636c-b901-45b5-9735-26ce7dc4b526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:43.093652 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1744140b-7af0-42a0-936a-055500df6426 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:43.116357 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 854/1701] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:43 2022] PUT /identity/v3/projects/6898c35b50cc413c94cf4c9d53be6308/users/60e65a0951824e6e86e396654c2c4ffe/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:43.118481 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744140b-7af0-42a0-936a-055500df6426 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:43.128148 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-d707636c-b901-45b5-9735-26ce7dc4b526 None None] MFA Rules not processed for user `cb565c6b954b4c9fbb3b5dba6aa3c90d`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:43.129366 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d707636c-b901-45b5-9735-26ce7dc4b526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:43.224098 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744140b-7af0-42a0-936a-055500df6426 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:43.229299 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4408e6-2caa-4d64-b172-757d69cd639f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:43.230058 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4408e6-2caa-4d64-b172-757d69cd639f admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:43.230570 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4408e6-2caa-4d64-b172-757d69cd639f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:43.230979 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4408e6-2caa-4d64-b172-757d69cd639f admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:43.231740 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4408e6-2caa-4d64-b172-757d69cd639f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:43.233697 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4408e6-2caa-4d64-b172-757d69cd639f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:43.252047 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 848/1702] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:43.256370 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 855/1703] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:43.257000 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707636c-b901-45b5-9735-26ce7dc4b526 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:43.265168 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4408e6-2caa-4d64-b172-757d69cd639f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:43.281976 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707636c-b901-45b5-9735-26ce7dc4b526 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:43.283005 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4408e6-2caa-4d64-b172-757d69cd639f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:43.287853 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a81990-d26b-4719-8a67-0d66a0ea7b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:43.288872 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a81990-d26b-4719-8a67-0d66a0ea7b44 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:43.289251 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a81990-d26b-4719-8a67-0d66a0ea7b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:43.289907 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a81990-d26b-4719-8a67-0d66a0ea7b44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:43.290684 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a81990-d26b-4719-8a67-0d66a0ea7b44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:43.293160 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a81990-d26b-4719-8a67-0d66a0ea7b44 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:43.299738 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89641b-a25c-45a8-9e15-61165389127d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:43.300815 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89641b-a25c-45a8-9e15-61165389127d admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:43.300815 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89641b-a25c-45a8-9e15-61165389127d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:43.302789 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89641b-a25c-45a8-9e15-61165389127d admin admin] PATH_INFO: `/v3/projects/6898c35b50cc413c94cf4c9d53be6308/users/60e65a0951824e6e86e396654c2c4ffe/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:43.306963 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd89641b-a25c-45a8-9e15-61165389127d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6898c35b50cc413c94cf4c9d53be6308, user_id=60e65a0951824e6e86e396654c2c4ffe, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:43.308716 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd89641b-a25c-45a8-9e15-61165389127d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:43.325764 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 856/1704] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:43 2022] PUT /identity/v3/projects/6898c35b50cc413c94cf4c9d53be6308/users/60e65a0951824e6e86e396654c2c4ffe/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:43.335007 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 849/1705] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:25:43 2022] POST /identity/v3/projects => generated 375 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:25:43.336176 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89641b-a25c-45a8-9e15-61165389127d admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:43.336717 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b7482-b851-4cea-86b0-b717f2a44f45 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:43.336996 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b7482-b851-4cea-86b0-b717f2a44f45 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:43.337322 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b7482-b851-4cea-86b0-b717f2a44f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:43.391481 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-917b7482-b851-4cea-86b0-b717f2a44f45 None None] MFA Rules not processed for user `60e65a0951824e6e86e396654c2c4ffe`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:43.393686 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-917b7482-b851-4cea-86b0-b717f2a44f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:43.497390 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:43.506044 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89641b-a25c-45a8-9e15-61165389127d admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:43.557034 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 850/1706] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:43 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:43.557903 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b7482-b851-4cea-86b0-b717f2a44f45 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:43.559582 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-917b7482-b851-4cea-86b0-b717f2a44f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:43.569809 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:43.646328 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb09d5-66ee-43c8-bfe4-d862de28162f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:43.647550 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb09d5-66ee-43c8-bfe4-d862de28162f admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:43.647875 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb09d5-66ee-43c8-bfe4-d862de28162f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:43.648228 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb09d5-66ee-43c8-bfe4-d862de28162f admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:43.649015 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fb09d5-66ee-43c8-bfe4-d862de28162f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:43.651369 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fb09d5-66ee-43c8-bfe4-d862de28162f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:43.660679 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b7482-b851-4cea-86b0-b717f2a44f45 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:43.665248 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6828335-8ee7-42ac-a80e-d18e4b57ca7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:43.665972 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6828335-8ee7-42ac-a80e-d18e4b57ca7c service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:43.666412 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6828335-8ee7-42ac-a80e-d18e4b57ca7c service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:43.666577 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6828335-8ee7-42ac-a80e-d18e4b57ca7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:43.668438 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a6828335-8ee7-42ac-a80e-d18e4b57ca7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:43.679859 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 857/1707] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:25:43 2022] POST /identity/v3/users => generated 294 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:43.680927 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb09d5-66ee-43c8-bfe4-d862de28162f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:43.683092 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-74fb09d5-66ee-43c8-bfe4-d862de28162f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:43.701527 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb09d5-66ee-43c8-bfe4-d862de28162f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:43.705211 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabec9c1-c6c2-4a9e-9b18-6dcbc4998a47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:43.705879 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabec9c1-c6c2-4a9e-9b18-6dcbc4998a47 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:43.706162 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabec9c1-c6c2-4a9e-9b18-6dcbc4998a47 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:43.706436 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabec9c1-c6c2-4a9e-9b18-6dcbc4998a47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:43.719187 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabec9c1-c6c2-4a9e-9b18-6dcbc4998a47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:43.720643 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabec9c1-c6c2-4a9e-9b18-6dcbc4998a47 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:43.732049 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 858/1708] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:43 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:25:43.732714 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabec9c1-c6c2-4a9e-9b18-6dcbc4998a47 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:43.745567 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabec9c1-c6c2-4a9e-9b18-6dcbc4998a47 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:43.750460 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc66789f-01fe-4664-adad-02590ade83c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:43.751048 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66789f-01fe-4664-adad-02590ade83c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:43.751334 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66789f-01fe-4664-adad-02590ade83c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:43.751614 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66789f-01fe-4664-adad-02590ade83c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:43.752265 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc66789f-01fe-4664-adad-02590ade83c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:43.753951 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc66789f-01fe-4664-adad-02590ade83c0 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:43.767904 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 859/1709] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:43.772179 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc66789f-01fe-4664-adad-02590ade83c0 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:43.784608 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc66789f-01fe-4664-adad-02590ade83c0 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:43.789506 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635c7eb-9330-4519-bec7-f869c80f5af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:43.790474 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635c7eb-9330-4519-bec7-f869c80f5af3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:43.790817 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635c7eb-9330-4519-bec7-f869c80f5af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:43.791155 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635c7eb-9330-4519-bec7-f869c80f5af3 admin admin] PATH_INFO: `/v3/projects/76dcfb66966a4cd98b2fc8233a3b4f19/users/df2dbb31e0a6421bbb54e94b87503f5d/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:43.813914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2635c7eb-9330-4519-bec7-f869c80f5af3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76dcfb66966a4cd98b2fc8233a3b4f19, user_id=df2dbb31e0a6421bbb54e94b87503f5d, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:43.817005 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2635c7eb-9330-4519-bec7-f869c80f5af3 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:43.846210 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6828335-8ee7-42ac-a80e-d18e4b57ca7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:43.846871 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 860/1710] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:43 2022] PUT /identity/v3/projects/76dcfb66966a4cd98b2fc8233a3b4f19/users/df2dbb31e0a6421bbb54e94b87503f5d/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:43.847741 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6828335-8ee7-42ac-a80e-d18e4b57ca7c service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:43.850666 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635c7eb-9330-4519-bec7-f869c80f5af3 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:43.860044 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 851/1711] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:43 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:25:43.911185 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6828335-8ee7-42ac-a80e-d18e4b57ca7c service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:43.921134 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6828335-8ee7-42ac-a80e-d18e4b57ca7c service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:43.999641 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa906d4b-c291-495a-b179-c12c85fc6024 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:44.000325 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa906d4b-c291-495a-b179-c12c85fc6024 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:44.000674 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa906d4b-c291-495a-b179-c12c85fc6024 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:44.001843 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa906d4b-c291-495a-b179-c12c85fc6024 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:44.010786 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635c7eb-9330-4519-bec7-f869c80f5af3 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:44.031037 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56fd6ee-b0d4-4bb3-8593-174c1fa21719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:44.033014 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fd6ee-b0d4-4bb3-8593-174c1fa21719 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:44.033588 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fd6ee-b0d4-4bb3-8593-174c1fa21719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:44.034068 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fd6ee-b0d4-4bb3-8593-174c1fa21719 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:44.035369 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56fd6ee-b0d4-4bb3-8593-174c1fa21719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:44.038534 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56fd6ee-b0d4-4bb3-8593-174c1fa21719 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:44.056486 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 861/1712] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 13:25:44.061347 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56fd6ee-b0d4-4bb3-8593-174c1fa21719 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:44.077190 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa906d4b-c291-495a-b179-c12c85fc6024 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:44.077190 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa906d4b-c291-495a-b179-c12c85fc6024 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:44.085886 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56fd6ee-b0d4-4bb3-8593-174c1fa21719 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:44.089317 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 852/1713] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:25:44.093038 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d505b-5e3e-4c39-9dbd-64d0d4d02777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:44.093770 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d505b-5e3e-4c39-9dbd-64d0d4d02777 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:44.094052 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d505b-5e3e-4c39-9dbd-64d0d4d02777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:44.094324 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d505b-5e3e-4c39-9dbd-64d0d4d02777 admin admin] PATH_INFO: `/v3/projects/76dcfb66966a4cd98b2fc8233a3b4f19/users/df2dbb31e0a6421bbb54e94b87503f5d/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:44.096847 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d505b-5e3e-4c39-9dbd-64d0d4d02777 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76dcfb66966a4cd98b2fc8233a3b4f19, user_id=df2dbb31e0a6421bbb54e94b87503f5d, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:44.099927 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d505b-5e3e-4c39-9dbd-64d0d4d02777 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:44.112119 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 862/1714] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:44 2022] PUT /identity/v3/projects/76dcfb66966a4cd98b2fc8233a3b4f19/users/df2dbb31e0a6421bbb54e94b87503f5d/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:44.123960 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0173813-a0e9-461d-8732-6a58778ebc1e None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:44.124244 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0173813-a0e9-461d-8732-6a58778ebc1e None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:44.124512 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0173813-a0e9-461d-8732-6a58778ebc1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:44.148851 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:44.164032 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-d0173813-a0e9-461d-8732-6a58778ebc1e None None] MFA Rules not processed for user `df2dbb31e0a6421bbb54e94b87503f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:44.166404 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d0173813-a0e9-461d-8732-6a58778ebc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:44.304113 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 853/1715] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:44 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:44.317264 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d505b-5e3e-4c39-9dbd-64d0d4d02777 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:44.357821 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:44.397400 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d505b-5e3e-4c39-9dbd-64d0d4d02777 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:44.404779 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29901c-6428-4e48-ad6b-387c57c14beb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:44.406313 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29901c-6428-4e48-ad6b-387c57c14beb service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:44.406607 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29901c-6428-4e48-ad6b-387c57c14beb service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:44.406885 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29901c-6428-4e48-ad6b-387c57c14beb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:44.505819 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee29901c-6428-4e48-ad6b-387c57c14beb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:44.507270 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee29901c-6428-4e48-ad6b-387c57c14beb service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:44.517164 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 863/1716] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:25:46.363533 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0173813-a0e9-461d-8732-6a58778ebc1e None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:46.378660 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0173813-a0e9-461d-8732-6a58778ebc1e None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:46.389647 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7071d3-c646-4ef4-a5a8-d4349b4d2de3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:46.390457 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7071d3-c646-4ef4-a5a8-d4349b4d2de3 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:46.390836 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7071d3-c646-4ef4-a5a8-d4349b4d2de3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:46.391221 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7071d3-c646-4ef4-a5a8-d4349b4d2de3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:46.509427 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7071d3-c646-4ef4-a5a8-d4349b4d2de3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:46.511002 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7071d3-c646-4ef4-a5a8-d4349b4d2de3 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:46.522573 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 854/1717] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:25:46.858016 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29901c-6428-4e48-ad6b-387c57c14beb service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:46.944695 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29901c-6428-4e48-ad6b-387c57c14beb service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:46.950403 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efcf3b-7d94-4147-9a72-428ad05be4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:46.951362 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efcf3b-7d94-4147-9a72-428ad05be4ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:46.951705 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efcf3b-7d94-4147-9a72-428ad05be4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:46.953555 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efcf3b-7d94-4147-9a72-428ad05be4ff admin admin] PATH_INFO: `/v3/users/4720e3d8c30b4602a938da29e636f447` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:46.954897 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54efcf3b-7d94-4147-9a72-428ad05be4ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=4720e3d8c30b4602a938da29e636f447)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:46.956985 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54efcf3b-7d94-4147-9a72-428ad05be4ff admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:47.018389 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-54efcf3b-7d94-4147-9a72-428ad05be4ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4720e3d8c30b4602a938da29e636f447'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:47.019247 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-54efcf3b-7d94-4147-9a72-428ad05be4ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4720e3d8c30b4602a938da29e636f447'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:47.027940 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-54efcf3b-7d94-4147-9a72-428ad05be4ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4720e3d8c30b4602a938da29e636f447'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:47.046097 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-54efcf3b-7d94-4147-9a72-428ad05be4ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4720e3d8c30b4602a938da29e636f447'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:47.047148 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-54efcf3b-7d94-4147-9a72-428ad05be4ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4720e3d8c30b4602a938da29e636f447'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:47.064327 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:47.072446 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 864/1718] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:25:46 2022] DELETE /identity/v3/users/4720e3d8c30b4602a938da29e636f447 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:47.077200 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9758e14-6792-45a6-88e3-555490b97a98 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:47.077483 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9758e14-6792-45a6-88e3-555490b97a98 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:47.077791 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9758e14-6792-45a6-88e3-555490b97a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:47.099041 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-f9758e14-6792-45a6-88e3-555490b97a98 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:47.100290 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f9758e14-6792-45a6-88e3-555490b97a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:47.197096 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 855/1719] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:47.205907 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efcf3b-7d94-4147-9a72-428ad05be4ff admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:47.207273 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-54efcf3b-7d94-4147-9a72-428ad05be4ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:47.290145 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efcf3b-7d94-4147-9a72-428ad05be4ff admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:47.314000 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86d695-4753-440a-b9ee-c370cbd3a3bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:47.314993 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86d695-4753-440a-b9ee-c370cbd3a3bc service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:47.315442 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86d695-4753-440a-b9ee-c370cbd3a3bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:47.315743 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86d695-4753-440a-b9ee-c370cbd3a3bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:47.340579 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de86d695-4753-440a-b9ee-c370cbd3a3bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:47.342202 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de86d695-4753-440a-b9ee-c370cbd3a3bc service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:47.355615 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 865/1720] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:25:47.383677 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9758e14-6792-45a6-88e3-555490b97a98 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:47.385156 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f9758e14-6792-45a6-88e3-555490b97a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:47.461361 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:47.513856 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9758e14-6792-45a6-88e3-555490b97a98 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:47.526745 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a473c-6f32-4623-bc78-ff8384116f2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:47.527646 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a473c-6f32-4623-bc78-ff8384116f2b service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:47.528150 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a473c-6f32-4623-bc78-ff8384116f2b service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:47.528564 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a473c-6f32-4623-bc78-ff8384116f2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:47.531450 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-061a473c-6f32-4623-bc78-ff8384116f2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:47.624957 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a473c-6f32-4623-bc78-ff8384116f2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:47.626503 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a473c-6f32-4623-bc78-ff8384116f2b service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:47.640366 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 856/1721] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:25:48.037737 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86d695-4753-440a-b9ee-c370cbd3a3bc service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:48.039335 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-de86d695-4753-440a-b9ee-c370cbd3a3bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:48.058247 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86d695-4753-440a-b9ee-c370cbd3a3bc service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:48.064547 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7f40f-4cb7-4778-8304-bae6338fb74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:48.065721 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7f40f-4cb7-4778-8304-bae6338fb74a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:48.066220 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7f40f-4cb7-4778-8304-bae6338fb74a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:48.066633 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7f40f-4cb7-4778-8304-bae6338fb74a admin admin] PATH_INFO: `/v3/projects/70c30fcc23b74f82920908719b951447` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:48.068141 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7f40f-4cb7-4778-8304-bae6338fb74a admin admin] RBAC: Authorizing `identity:delete_project(project_id=70c30fcc23b74f82920908719b951447)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:48.071832 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7f40f-4cb7-4778-8304-bae6338fb74a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:48.145865 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-64b7f40f-4cb7-4778-8304-bae6338fb74a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70c30fcc23b74f82920908719b951447', 'request_id': 'req-64b7f40f-4cb7-4778-8304-bae6338fb74a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:48.152822 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-64b7f40f-4cb7-4778-8304-bae6338fb74a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70c30fcc23b74f82920908719b951447', 'request_id': 'req-64b7f40f-4cb7-4778-8304-bae6338fb74a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:48.160298 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-64b7f40f-4cb7-4778-8304-bae6338fb74a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70c30fcc23b74f82920908719b951447', 'request_id': 'req-64b7f40f-4cb7-4778-8304-bae6338fb74a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:48.181667 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-64b7f40f-4cb7-4778-8304-bae6338fb74a admin admin] The token cache is being invalidate because project 70c30fcc23b74f82920908719b951447 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:25:48.181965 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-64b7f40f-4cb7-4778-8304-bae6338fb74a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:48.182637 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-64b7f40f-4cb7-4778-8304-bae6338fb74a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:48.185025 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 866/1722] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:25:48 2022] DELETE /identity/v3/projects/70c30fcc23b74f82920908719b951447 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:48.189468 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a473c-6f32-4623-bc78-ff8384116f2b service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:48.202257 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a473c-6f32-4623-bc78-ff8384116f2b service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:48.275478 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb459a00-c17d-4d16-8eff-05cbbf7bf2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:48.278321 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb459a00-c17d-4d16-8eff-05cbbf7bf2ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:48.278812 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb459a00-c17d-4d16-8eff-05cbbf7bf2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:48.279493 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb459a00-c17d-4d16-8eff-05cbbf7bf2ed admin admin] PATH_INFO: `/v3/users/60e65a0951824e6e86e396654c2c4ffe` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:48.281023 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb459a00-c17d-4d16-8eff-05cbbf7bf2ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=60e65a0951824e6e86e396654c2c4ffe)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:48.283746 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb459a00-c17d-4d16-8eff-05cbbf7bf2ed admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:48.357494 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-eb459a00-c17d-4d16-8eff-05cbbf7bf2ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60e65a0951824e6e86e396654c2c4ffe'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:48.358107 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-eb459a00-c17d-4d16-8eff-05cbbf7bf2ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60e65a0951824e6e86e396654c2c4ffe'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:48.368063 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-eb459a00-c17d-4d16-8eff-05cbbf7bf2ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60e65a0951824e6e86e396654c2c4ffe'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:48.383015 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-eb459a00-c17d-4d16-8eff-05cbbf7bf2ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60e65a0951824e6e86e396654c2c4ffe'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:48.383911 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-eb459a00-c17d-4d16-8eff-05cbbf7bf2ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60e65a0951824e6e86e396654c2c4ffe'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:48.400309 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 857/1723] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:25:48 2022] DELETE /identity/v3/users/60e65a0951824e6e86e396654c2c4ffe => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:48.884732 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7f40f-4cb7-4778-8304-bae6338fb74a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:48.886399 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-64b7f40f-4cb7-4778-8304-bae6338fb74a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:48.905769 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7f40f-4cb7-4778-8304-bae6338fb74a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:48.944398 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb459a00-c17d-4d16-8eff-05cbbf7bf2ed admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:48.945989 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-eb459a00-c17d-4d16-8eff-05cbbf7bf2ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:48.951963 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:49.011326 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed71bb4-2f89-4804-9c37-8acef2381499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:49.012009 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed71bb4-2f89-4804-9c37-8acef2381499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:49.012335 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed71bb4-2f89-4804-9c37-8acef2381499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:49.012683 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed71bb4-2f89-4804-9c37-8acef2381499 admin admin] PATH_INFO: `/v3/projects/6898c35b50cc413c94cf4c9d53be6308` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:49.014781 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed71bb4-2f89-4804-9c37-8acef2381499 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6898c35b50cc413c94cf4c9d53be6308)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:49.018203 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed71bb4-2f89-4804-9c37-8acef2381499 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:49.068487 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb459a00-c17d-4d16-8eff-05cbbf7bf2ed admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:49.077348 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c56b37-3871-4cf7-93c7-2ea09339bfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:49.078347 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c56b37-3871-4cf7-93c7-2ea09339bfae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:49.078822 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c56b37-3871-4cf7-93c7-2ea09339bfae admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:49.079256 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c56b37-3871-4cf7-93c7-2ea09339bfae admin admin] PATH_INFO: `/v3/users/ceca5a46d43f4df582876376ac2b3230` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:49.081611 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c56b37-3871-4cf7-93c7-2ea09339bfae admin admin] RBAC: Authorizing `identity:delete_user(user_id=ceca5a46d43f4df582876376ac2b3230)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:49.084116 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c56b37-3871-4cf7-93c7-2ea09339bfae admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:49.154498 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:49.177008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3ed71bb4-2f89-4804-9c37-8acef2381499 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6898c35b50cc413c94cf4c9d53be6308', 'request_id': 'req-3ed71bb4-2f89-4804-9c37-8acef2381499'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:49.188666 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3ed71bb4-2f89-4804-9c37-8acef2381499 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6898c35b50cc413c94cf4c9d53be6308', 'request_id': 'req-3ed71bb4-2f89-4804-9c37-8acef2381499'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:49.192458 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f4c56b37-3871-4cf7-93c7-2ea09339bfae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceca5a46d43f4df582876376ac2b3230'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:49.193242 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f4c56b37-3871-4cf7-93c7-2ea09339bfae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceca5a46d43f4df582876376ac2b3230'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:49.198089 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3ed71bb4-2f89-4804-9c37-8acef2381499 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6898c35b50cc413c94cf4c9d53be6308', 'request_id': 'req-3ed71bb4-2f89-4804-9c37-8acef2381499'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:49.202946 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f4c56b37-3871-4cf7-93c7-2ea09339bfae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceca5a46d43f4df582876376ac2b3230'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:49.224047 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f4c56b37-3871-4cf7-93c7-2ea09339bfae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceca5a46d43f4df582876376ac2b3230'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:49.225138 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f4c56b37-3871-4cf7-93c7-2ea09339bfae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceca5a46d43f4df582876376ac2b3230'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:49.242149 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3ed71bb4-2f89-4804-9c37-8acef2381499 admin admin] The token cache is being invalidate because project 6898c35b50cc413c94cf4c9d53be6308 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:25:49.242462 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3ed71bb4-2f89-4804-9c37-8acef2381499 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:49.243140 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3ed71bb4-2f89-4804-9c37-8acef2381499 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:49.247572 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 858/1724] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:25:48 2022] DELETE /identity/v3/users/ceca5a46d43f4df582876376ac2b3230 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:49.247781 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 867/1725] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:25:48 2022] DELETE /identity/v3/projects/6898c35b50cc413c94cf4c9d53be6308 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:49.251294 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1095e-c8cc-4cbf-a8b0-00ad350ad048 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:49.252255 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e98a6-468e-44ec-95cc-2ee0e9bca9d0 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:49.252625 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1095e-c8cc-4cbf-a8b0-00ad350ad048 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:49.252990 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e98a6-468e-44ec-95cc-2ee0e9bca9d0 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:49.253357 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1095e-c8cc-4cbf-a8b0-00ad350ad048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:49.253743 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e98a6-468e-44ec-95cc-2ee0e9bca9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:49.286257 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-353e98a6-468e-44ec-95cc-2ee0e9bca9d0 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:49.287556 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-353e98a6-468e-44ec-95cc-2ee0e9bca9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:49.291762 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-aad1095e-c8cc-4cbf-a8b0-00ad350ad048 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:49.293114 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-aad1095e-c8cc-4cbf-a8b0-00ad350ad048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:49.375069 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 859/1726] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:49.383612 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 868/1727] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:49.385755 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e98a6-468e-44ec-95cc-2ee0e9bca9d0 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:49.387304 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-353e98a6-468e-44ec-95cc-2ee0e9bca9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:49.393575 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ddde0-df8f-4b49-aac4-6c3d2784eec0 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:49.394785 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ddde0-df8f-4b49-aac4-6c3d2784eec0 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:49.395619 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ddde0-df8f-4b49-aac4-6c3d2784eec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:49.416976 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:49.423894 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-153ddde0-df8f-4b49-aac4-6c3d2784eec0 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:49.425107 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-153ddde0-df8f-4b49-aac4-6c3d2784eec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:49.435482 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 869/1728] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:25:49.439385 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ddde0-df8f-4b49-aac4-6c3d2784eec0 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:49.450444 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ddde0-df8f-4b49-aac4-6c3d2784eec0 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:49.456488 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e54ca-32d2-4346-8d31-d0e312c059a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:49.457126 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e54ca-32d2-4346-8d31-d0e312c059a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:49.457403 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e54ca-32d2-4346-8d31-d0e312c059a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:49.457702 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e54ca-32d2-4346-8d31-d0e312c059a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:49.458344 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e54ca-32d2-4346-8d31-d0e312c059a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:25:49.458646 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e54ca-32d2-4346-8d31-d0e312c059a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:49.466131 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e98a6-468e-44ec-95cc-2ee0e9bca9d0 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:49.467025 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e54ca-32d2-4346-8d31-d0e312c059a3 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:49.470056 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e7239-7205-4ab9-b990-da177d716e5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:49.470952 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e7239-7205-4ab9-b990-da177d716e5d service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:49.471067 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e7239-7205-4ab9-b990-da177d716e5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:49.471443 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e7239-7205-4ab9-b990-da177d716e5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:49.482076 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e7239-7205-4ab9-b990-da177d716e5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:49.485617 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 870/1729] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:25:49.486030 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e7239-7205-4ab9-b990-da177d716e5d service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:49.487623 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e54ca-32d2-4346-8d31-d0e312c059a3 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:49.494041 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 860/1730] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:25:49.502753 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e54ca-32d2-4346-8d31-d0e312c059a3 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:49.507735 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73f728-2dbb-46e3-b5d6-47e317801528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:49.508518 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73f728-2dbb-46e3-b5d6-47e317801528 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:49.508865 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73f728-2dbb-46e3-b5d6-47e317801528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:49.509204 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73f728-2dbb-46e3-b5d6-47e317801528 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:49.509961 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b73f728-2dbb-46e3-b5d6-47e317801528 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:49.512074 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b73f728-2dbb-46e3-b5d6-47e317801528 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:49.547425 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 871/1731] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:25:49 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:25:49.549056 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e7239-7205-4ab9-b990-da177d716e5d service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:49.561788 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e7239-7205-4ab9-b990-da177d716e5d service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:49.631605 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1af6b-5801-4812-94fe-c35b48917929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:49.632263 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1af6b-5801-4812-94fe-c35b48917929 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:49.632546 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1af6b-5801-4812-94fe-c35b48917929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:49.632903 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1af6b-5801-4812-94fe-c35b48917929 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:49.635855 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1af6b-5801-4812-94fe-c35b48917929 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:49.638399 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1af6b-5801-4812-94fe-c35b48917929 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:49.665409 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 861/1732] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:25:49 2022] POST /identity/v3/users => generated 287 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:49.669841 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73f728-2dbb-46e3-b5d6-47e317801528 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:49.682157 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73f728-2dbb-46e3-b5d6-47e317801528 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:49.691576 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92988fe3-c141-425a-b09f-35573e9f139d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:49.692273 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92988fe3-c141-425a-b09f-35573e9f139d admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:49.692623 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92988fe3-c141-425a-b09f-35573e9f139d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:49.692961 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92988fe3-c141-425a-b09f-35573e9f139d admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:49.693705 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92988fe3-c141-425a-b09f-35573e9f139d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:49.695399 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92988fe3-c141-425a-b09f-35573e9f139d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:49.708307 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 872/1733] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:49.712056 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1af6b-5801-4812-94fe-c35b48917929 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:49.728768 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1af6b-5801-4812-94fe-c35b48917929 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:49.737641 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a4908-3f9e-4e4d-8624-40866f8debec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:49.738245 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a4908-3f9e-4e4d-8624-40866f8debec admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:49.738528 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a4908-3f9e-4e4d-8624-40866f8debec admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:49.738790 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a4908-3f9e-4e4d-8624-40866f8debec admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:49.739919 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a4908-3f9e-4e4d-8624-40866f8debec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:49.741547 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a4908-3f9e-4e4d-8624-40866f8debec admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:49.760491 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 862/1734] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:49.764625 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92988fe3-c141-425a-b09f-35573e9f139d admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:49.775478 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92988fe3-c141-425a-b09f-35573e9f139d admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:49.780539 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47075891-8967-4176-b657-ca8fe8b7abb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:49.781202 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47075891-8967-4176-b657-ca8fe8b7abb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:49.781503 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47075891-8967-4176-b657-ca8fe8b7abb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:49.781811 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47075891-8967-4176-b657-ca8fe8b7abb5 admin admin] PATH_INFO: `/v3/projects/7187b10daa90480cac15d9e243986e8c/users/37953439b4d2491bbd71694567fb2abd/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:49.803644 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47075891-8967-4176-b657-ca8fe8b7abb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7187b10daa90480cac15d9e243986e8c, user_id=37953439b4d2491bbd71694567fb2abd, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:49.808403 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47075891-8967-4176-b657-ca8fe8b7abb5 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:49.829078 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 873/1735] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:49 2022] PUT /identity/v3/projects/7187b10daa90480cac15d9e243986e8c/users/37953439b4d2491bbd71694567fb2abd/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:25:49.839934 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f535eb-3c7b-4bcf-8a38-e45fc0ae2ce9 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:49.840532 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f535eb-3c7b-4bcf-8a38-e45fc0ae2ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:49.840532 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f535eb-3c7b-4bcf-8a38-e45fc0ae2ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:49.879116 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47075891-8967-4176-b657-ca8fe8b7abb5 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:49.884718 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-47075891-8967-4176-b657-ca8fe8b7abb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:49.889872 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-c9f535eb-3c7b-4bcf-8a38-e45fc0ae2ce9 None None] MFA Rules not processed for user `37953439b4d2491bbd71694567fb2abd`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:49.892081 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c9f535eb-3c7b-4bcf-8a38-e45fc0ae2ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:49.980111 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:49.992354 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 863/1736] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:50.004245 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f535eb-3c7b-4bcf-8a38-e45fc0ae2ce9 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:50.006018 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c9f535eb-3c7b-4bcf-8a38-e45fc0ae2ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:50.011578 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47075891-8967-4176-b657-ca8fe8b7abb5 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:50.017248 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baaa280-4ccd-44f3-827f-c107ff2ec558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:50.017982 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baaa280-4ccd-44f3-827f-c107ff2ec558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:50.018526 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baaa280-4ccd-44f3-827f-c107ff2ec558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:50.018526 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baaa280-4ccd-44f3-827f-c107ff2ec558 admin admin] PATH_INFO: `/v3/projects/5969c3225d6d408289289966c2e37723` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:50.019725 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baaa280-4ccd-44f3-827f-c107ff2ec558 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5969c3225d6d408289289966c2e37723)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:50.021803 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baaa280-4ccd-44f3-827f-c107ff2ec558 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:50.059126 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:50.082297 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9baaa280-4ccd-44f3-827f-c107ff2ec558 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5969c3225d6d408289289966c2e37723', 'request_id': 'req-9baaa280-4ccd-44f3-827f-c107ff2ec558'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:50.089511 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f535eb-3c7b-4bcf-8a38-e45fc0ae2ce9 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:50.090654 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9baaa280-4ccd-44f3-827f-c107ff2ec558 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5969c3225d6d408289289966c2e37723', 'request_id': 'req-9baaa280-4ccd-44f3-827f-c107ff2ec558'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:50.098176 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9baaa280-4ccd-44f3-827f-c107ff2ec558 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5969c3225d6d408289289966c2e37723', 'request_id': 'req-9baaa280-4ccd-44f3-827f-c107ff2ec558'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:50.114190 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9baaa280-4ccd-44f3-827f-c107ff2ec558 admin admin] The token cache is being invalidate because project 5969c3225d6d408289289966c2e37723 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:25:50.114502 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9baaa280-4ccd-44f3-827f-c107ff2ec558 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:50.115146 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9baaa280-4ccd-44f3-827f-c107ff2ec558 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:50.116686 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 874/1737] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:25:49 2022] DELETE /identity/v3/projects/5969c3225d6d408289289966c2e37723 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:50.120960 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baaa280-4ccd-44f3-827f-c107ff2ec558 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:50.123983 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9baaa280-4ccd-44f3-827f-c107ff2ec558 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:50.150944 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e421f28-30bd-4885-8afc-0e0ad86a51c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:50.151500 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e421f28-30bd-4885-8afc-0e0ad86a51c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:50.151988 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e421f28-30bd-4885-8afc-0e0ad86a51c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:50.151988 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e421f28-30bd-4885-8afc-0e0ad86a51c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:50.153811 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0e421f28-30bd-4885-8afc-0e0ad86a51c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:50.207943 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baaa280-4ccd-44f3-827f-c107ff2ec558 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:50.213260 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359307bf-964c-435a-b91d-263d12c7d9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:50.214277 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359307bf-964c-435a-b91d-263d12c7d9a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:50.214997 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359307bf-964c-435a-b91d-263d12c7d9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:50.214997 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359307bf-964c-435a-b91d-263d12c7d9a9 admin admin] PATH_INFO: `/v3/users/8990011dcfb94a5490976a59235b5469` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:50.216254 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359307bf-964c-435a-b91d-263d12c7d9a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8990011dcfb94a5490976a59235b5469)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:50.218230 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359307bf-964c-435a-b91d-263d12c7d9a9 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:50.228978 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e421f28-30bd-4885-8afc-0e0ad86a51c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:50.230613 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e421f28-30bd-4885-8afc-0e0ad86a51c7 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:50.247814 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 864/1738] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:25:50.289260 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-359307bf-964c-435a-b91d-263d12c7d9a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8990011dcfb94a5490976a59235b5469'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:50.290031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-359307bf-964c-435a-b91d-263d12c7d9a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8990011dcfb94a5490976a59235b5469'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:50.306996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-359307bf-964c-435a-b91d-263d12c7d9a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8990011dcfb94a5490976a59235b5469'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:50.319593 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:50.323429 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-359307bf-964c-435a-b91d-263d12c7d9a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8990011dcfb94a5490976a59235b5469'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:50.325066 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-359307bf-964c-435a-b91d-263d12c7d9a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8990011dcfb94a5490976a59235b5469'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:50.363302 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 875/1739] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:25:50 2022] DELETE /identity/v3/users/8990011dcfb94a5490976a59235b5469 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:25:50.944559 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e421f28-30bd-4885-8afc-0e0ad86a51c7 service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:50.971127 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e421f28-30bd-4885-8afc-0e0ad86a51c7 service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:51.060565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6b18d-6453-418a-a9b0-c9137e579f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:51.061237 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6b18d-6453-418a-a9b0-c9137e579f7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:51.061573 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6b18d-6453-418a-a9b0-c9137e579f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:51.061830 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6b18d-6453-418a-a9b0-c9137e579f7c admin admin] PATH_INFO: `/v3/projects/eee8917fbffd445bac7659770051669a` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:51.063536 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6b18d-6453-418a-a9b0-c9137e579f7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=eee8917fbffd445bac7659770051669a)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:51.065936 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6b18d-6453-418a-a9b0-c9137e579f7c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:51.153396 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:51.159355 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-51c6b18d-6453-418a-a9b0-c9137e579f7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eee8917fbffd445bac7659770051669a', 'request_id': 'req-51c6b18d-6453-418a-a9b0-c9137e579f7c'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:51.171762 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-51c6b18d-6453-418a-a9b0-c9137e579f7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eee8917fbffd445bac7659770051669a', 'request_id': 'req-51c6b18d-6453-418a-a9b0-c9137e579f7c'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:51.182792 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-51c6b18d-6453-418a-a9b0-c9137e579f7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eee8917fbffd445bac7659770051669a', 'request_id': 'req-51c6b18d-6453-418a-a9b0-c9137e579f7c'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:51.200256 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-51c6b18d-6453-418a-a9b0-c9137e579f7c admin admin] The token cache is being invalidate because project eee8917fbffd445bac7659770051669a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:25:51.200683 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-51c6b18d-6453-418a-a9b0-c9137e579f7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:51.201785 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-51c6b18d-6453-418a-a9b0-c9137e579f7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:51.210112 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 865/1740] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:25:50 2022] DELETE /identity/v3/projects/eee8917fbffd445bac7659770051669a => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:51.210332 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1c820-b2ea-4e2d-98e1-1ebf1afb8d0d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:51.210853 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1c820-b2ea-4e2d-98e1-1ebf1afb8d0d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:51.210853 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1c820-b2ea-4e2d-98e1-1ebf1afb8d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:51.239352 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-5fd1c820-b2ea-4e2d-98e1-1ebf1afb8d0d None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:51.241906 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5fd1c820-b2ea-4e2d-98e1-1ebf1afb8d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:51.380250 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 876/1741] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:25:51.389183 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b486ac3-78c1-420f-988a-881b9d304dc2 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:51.389609 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b486ac3-78c1-420f-988a-881b9d304dc2 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:51.390371 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b486ac3-78c1-420f-988a-881b9d304dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:51.417713 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-6b486ac3-78c1-420f-988a-881b9d304dc2 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:51.419194 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6b486ac3-78c1-420f-988a-881b9d304dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:51.427697 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 866/1742] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:51.432279 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd1c820-b2ea-4e2d-98e1-1ebf1afb8d0d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:51.442828 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd1c820-b2ea-4e2d-98e1-1ebf1afb8d0d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:51.448596 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556cb141-1ee5-4ef4-89f3-f8bf7d0353cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:51.449392 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556cb141-1ee5-4ef4-89f3-f8bf7d0353cf admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:51.449866 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556cb141-1ee5-4ef4-89f3-f8bf7d0353cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:51.450141 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556cb141-1ee5-4ef4-89f3-f8bf7d0353cf admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:51.450814 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556cb141-1ee5-4ef4-89f3-f8bf7d0353cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:25:51.451122 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556cb141-1ee5-4ef4-89f3-f8bf7d0353cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:51.452831 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556cb141-1ee5-4ef4-89f3-f8bf7d0353cf admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:51.466811 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 877/1743] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:25:51.471556 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b486ac3-78c1-420f-988a-881b9d304dc2 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:51.481474 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b486ac3-78c1-420f-988a-881b9d304dc2 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:51.486466 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a955d-ee47-44d8-bc88-e6aa136cc0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:51.487112 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a955d-ee47-44d8-bc88-e6aa136cc0fb admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:51.487396 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a955d-ee47-44d8-bc88-e6aa136cc0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:51.487665 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a955d-ee47-44d8-bc88-e6aa136cc0fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:51.488354 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a955d-ee47-44d8-bc88-e6aa136cc0fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:51.490330 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a955d-ee47-44d8-bc88-e6aa136cc0fb admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:51.520224 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 867/1744] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:25:51 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:25:51.524307 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556cb141-1ee5-4ef4-89f3-f8bf7d0353cf admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:51.536717 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556cb141-1ee5-4ef4-89f3-f8bf7d0353cf admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:51.612628 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da9cfb-bb06-4821-b6e1-2065ec860c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:51.613250 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da9cfb-bb06-4821-b6e1-2065ec860c9f admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:51.613558 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da9cfb-bb06-4821-b6e1-2065ec860c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:51.613833 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da9cfb-bb06-4821-b6e1-2065ec860c9f admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:51.614652 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da9cfb-bb06-4821-b6e1-2065ec860c9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:51.616597 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da9cfb-bb06-4821-b6e1-2065ec860c9f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:51.643399 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 878/1745] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:25:51 2022] POST /identity/v3/users => generated 292 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:51.647525 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a955d-ee47-44d8-bc88-e6aa136cc0fb admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:51.659082 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a955d-ee47-44d8-bc88-e6aa136cc0fb admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:51.674215 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b71e3-213d-4d62-9852-cb648babab65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:51.674943 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b71e3-213d-4d62-9852-cb648babab65 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:51.675286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b71e3-213d-4d62-9852-cb648babab65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:51.675774 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b71e3-213d-4d62-9852-cb648babab65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:51.676348 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0b71e3-213d-4d62-9852-cb648babab65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:51.678067 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0b71e3-213d-4d62-9852-cb648babab65 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:51.693587 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 868/1746] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:51 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:51.695390 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da9cfb-bb06-4821-b6e1-2065ec860c9f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:51.706340 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da9cfb-bb06-4821-b6e1-2065ec860c9f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:51.711808 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d538d3c-f8f8-4f8a-b2f4-53746c9b7c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:51.712695 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d538d3c-f8f8-4f8a-b2f4-53746c9b7c04 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:51.713012 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d538d3c-f8f8-4f8a-b2f4-53746c9b7c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:51.713287 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d538d3c-f8f8-4f8a-b2f4-53746c9b7c04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:51.713968 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d538d3c-f8f8-4f8a-b2f4-53746c9b7c04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:51.715637 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d538d3c-f8f8-4f8a-b2f4-53746c9b7c04 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:51.728159 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 879/1747] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 13:25:51.733232 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b71e3-213d-4d62-9852-cb648babab65 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:51.751001 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b71e3-213d-4d62-9852-cb648babab65 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:51.757358 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7650015-baf1-425f-b5ef-1fec3e8a06ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:51.758175 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7650015-baf1-425f-b5ef-1fec3e8a06ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:51.758460 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7650015-baf1-425f-b5ef-1fec3e8a06ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:51.758736 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7650015-baf1-425f-b5ef-1fec3e8a06ad admin admin] PATH_INFO: `/v3/projects/a08a5d79a8cc49d7bbfb1d08227b4614/users/d5b86703923a45cb8bd57c777296a5f6/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:51.775773 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7650015-baf1-425f-b5ef-1fec3e8a06ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=a08a5d79a8cc49d7bbfb1d08227b4614, user_id=d5b86703923a45cb8bd57c777296a5f6, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:51.778569 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7650015-baf1-425f-b5ef-1fec3e8a06ad admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:51.801600 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 869/1748] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:51 2022] PUT /identity/v3/projects/a08a5d79a8cc49d7bbfb1d08227b4614/users/d5b86703923a45cb8bd57c777296a5f6/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:25:51.812512 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105802d-16dd-492c-beec-d1c5a534101a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:51.813175 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105802d-16dd-492c-beec-d1c5a534101a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:51.813641 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105802d-16dd-492c-beec-d1c5a534101a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:51.847869 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-f105802d-16dd-492c-beec-d1c5a534101a None None] MFA Rules not processed for user `d5b86703923a45cb8bd57c777296a5f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:51.849089 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f105802d-16dd-492c-beec-d1c5a534101a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:51.919508 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:51.949886 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 880/1749] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:51.955336 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7650015-baf1-425f-b5ef-1fec3e8a06ad admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:52.058996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105802d-16dd-492c-beec-d1c5a534101a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:52.061180 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f105802d-16dd-492c-beec-d1c5a534101a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:52.071210 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7650015-baf1-425f-b5ef-1fec3e8a06ad admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:52.076176 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c517b44-c4ae-4272-92b9-2669ad76dd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:52.076892 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c517b44-c4ae-4272-92b9-2669ad76dd5d admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:52.077115 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c517b44-c4ae-4272-92b9-2669ad76dd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:52.077389 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c517b44-c4ae-4272-92b9-2669ad76dd5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:52.078111 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c517b44-c4ae-4272-92b9-2669ad76dd5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:52.080153 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c517b44-c4ae-4272-92b9-2669ad76dd5d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:52.082107 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105802d-16dd-492c-beec-d1c5a534101a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:52.089834 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638006af-5fc9-4ce3-8f29-5599807ff64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:52.090641 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638006af-5fc9-4ce3-8f29-5599807ff64f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:52.091023 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638006af-5fc9-4ce3-8f29-5599807ff64f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:52.091415 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638006af-5fc9-4ce3-8f29-5599807ff64f admin admin] PATH_INFO: `/v3/users/06762108f83e4e47a0d568d236734b1c` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:52.092726 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638006af-5fc9-4ce3-8f29-5599807ff64f admin admin] RBAC: Authorizing `identity:delete_user(user_id=06762108f83e4e47a0d568d236734b1c)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:52.095290 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638006af-5fc9-4ce3-8f29-5599807ff64f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:52.116739 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 870/1750] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:25:51 2022] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:25:52.117879 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c517b44-c4ae-4272-92b9-2669ad76dd5d admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:52.192052 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-638006af-5fc9-4ce3-8f29-5599807ff64f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06762108f83e4e47a0d568d236734b1c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:52.193665 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-638006af-5fc9-4ce3-8f29-5599807ff64f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06762108f83e4e47a0d568d236734b1c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:52.205592 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:52.205960 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-638006af-5fc9-4ce3-8f29-5599807ff64f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06762108f83e4e47a0d568d236734b1c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:52.214654 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c517b44-c4ae-4272-92b9-2669ad76dd5d admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:52.221961 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee8d04-1950-4817-9505-d6cef3432ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:52.223085 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee8d04-1950-4817-9505-d6cef3432ffb admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:52.223895 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee8d04-1950-4817-9505-d6cef3432ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:52.224928 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee8d04-1950-4817-9505-d6cef3432ffb admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:52.225809 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee8d04-1950-4817-9505-d6cef3432ffb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:52.226642 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-638006af-5fc9-4ce3-8f29-5599807ff64f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06762108f83e4e47a0d568d236734b1c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:52.228484 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-638006af-5fc9-4ce3-8f29-5599807ff64f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06762108f83e4e47a0d568d236734b1c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:52.228665 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee8d04-1950-4817-9505-d6cef3432ffb admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:52.260098 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 871/1751] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:25:52 2022] POST /identity/v3/users => generated 298 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:25:52.260542 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 881/1752] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:25:52 2022] DELETE /identity/v3/users/06762108f83e4e47a0d568d236734b1c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:52.261506 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee8d04-1950-4817-9505-d6cef3432ffb admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:52.264396 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5fee8d04-1950-4817-9505-d6cef3432ffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:52.266988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe819f13-8479-4015-9673-61ae30378d4a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:52.266988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe819f13-8479-4015-9673-61ae30378d4a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:52.266988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe819f13-8479-4015-9673-61ae30378d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:52.285613 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee8d04-1950-4817-9505-d6cef3432ffb admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:52.296044 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-fe819f13-8479-4015-9673-61ae30378d4a None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:52.298331 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-fe819f13-8479-4015-9673-61ae30378d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:52.366001 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0fdb0-3bc9-46c7-9988-c7bb530d6553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:52.366805 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0fdb0-3bc9-46c7-9988-c7bb530d6553 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:52.367238 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0fdb0-3bc9-46c7-9988-c7bb530d6553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:52.368128 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0fdb0-3bc9-46c7-9988-c7bb530d6553 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:52.368959 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0fdb0-3bc9-46c7-9988-c7bb530d6553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:52.371663 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0fdb0-3bc9-46c7-9988-c7bb530d6553 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:52.385686 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 882/1753] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:52.389764 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 872/1754] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:52.392263 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe819f13-8479-4015-9673-61ae30378d4a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:52.402506 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe819f13-8479-4015-9673-61ae30378d4a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:52.407731 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a262b-6db7-416d-a8f9-f8b639ae2902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:52.408528 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a262b-6db7-416d-a8f9-f8b639ae2902 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:52.408902 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a262b-6db7-416d-a8f9-f8b639ae2902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:52.409268 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a262b-6db7-416d-a8f9-f8b639ae2902 admin admin] PATH_INFO: `/v3/projects/fa327dd342cd4470a12b227f59892173/users/12dbc89506be4cadb1a1e1860288041d/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:52.420904 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0fdb0-3bc9-46c7-9988-c7bb530d6553 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:52.426507 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5fb0fdb0-3bc9-46c7-9988-c7bb530d6553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:52.433426 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a262b-6db7-416d-a8f9-f8b639ae2902 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa327dd342cd4470a12b227f59892173, user_id=12dbc89506be4cadb1a1e1860288041d, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:52.438022 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a262b-6db7-416d-a8f9-f8b639ae2902 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:52.467641 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 883/1755] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:52 2022] PUT /identity/v3/projects/fa327dd342cd4470a12b227f59892173/users/12dbc89506be4cadb1a1e1860288041d/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:25:52.471827 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a262b-6db7-416d-a8f9-f8b639ae2902 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:52.519760 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:52.526438 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0fdb0-3bc9-46c7-9988-c7bb530d6553 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:52.560962 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a262b-6db7-416d-a8f9-f8b639ae2902 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:52.567775 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b8924-6a1a-450b-8b5c-34569db75e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:52.571410 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b8924-6a1a-450b-8b5c-34569db75e37 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:52.572170 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b8924-6a1a-450b-8b5c-34569db75e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:52.572446 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b8924-6a1a-450b-8b5c-34569db75e37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:52.573555 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b8924-6a1a-450b-8b5c-34569db75e37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:52.578762 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b8924-6a1a-450b-8b5c-34569db75e37 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:52.592198 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 884/1756] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:52.597659 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b8924-6a1a-450b-8b5c-34569db75e37 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:52.612558 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b8924-6a1a-450b-8b5c-34569db75e37 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:52.618437 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129dd66d-d1c8-48d5-ba35-63eee4b27e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:52.619189 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129dd66d-d1c8-48d5-ba35-63eee4b27e99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:52.619537 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129dd66d-d1c8-48d5-ba35-63eee4b27e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:52.619882 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129dd66d-d1c8-48d5-ba35-63eee4b27e99 admin admin] PATH_INFO: `/v3/projects/fa327dd342cd4470a12b227f59892173/users/12dbc89506be4cadb1a1e1860288041d/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:52.621551 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ee078-52a2-48e1-9da5-5e5e44c6c98e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:52.622798 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ee078-52a2-48e1-9da5-5e5e44c6c98e service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:52.623985 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129dd66d-d1c8-48d5-ba35-63eee4b27e99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa327dd342cd4470a12b227f59892173, user_id=12dbc89506be4cadb1a1e1860288041d, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:52.625085 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ee078-52a2-48e1-9da5-5e5e44c6c98e service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:52.625875 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ee078-52a2-48e1-9da5-5e5e44c6c98e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:52.627727 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129dd66d-d1c8-48d5-ba35-63eee4b27e99 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:52.649876 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 885/1757] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:52 2022] PUT /identity/v3/projects/fa327dd342cd4470a12b227f59892173/users/12dbc89506be4cadb1a1e1860288041d/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:52.657678 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4ee078-52a2-48e1-9da5-5e5e44c6c98e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:52.659257 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4ee078-52a2-48e1-9da5-5e5e44c6c98e service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:52.661959 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5b586-c43d-4a55-b8d1-470b1376b891 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:52.666137 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5b586-c43d-4a55-b8d1-470b1376b891 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:52.666137 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5b586-c43d-4a55-b8d1-470b1376b891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:52.672741 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 873/1758] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:25:52.706242 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-ecc5b586-c43d-4a55-b8d1-470b1376b891 None None] MFA Rules not processed for user `12dbc89506be4cadb1a1e1860288041d`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:52.707516 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ecc5b586-c43d-4a55-b8d1-470b1376b891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:52.846219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 886/1759] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:52 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:52.858192 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ee078-52a2-48e1-9da5-5e5e44c6c98e service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:52.860038 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-eb4ee078-52a2-48e1-9da5-5e5e44c6c98e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:52.911431 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:52.930908 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ee078-52a2-48e1-9da5-5e5e44c6c98e service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:52.993463 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961dd95b-7fce-4d40-a72a-e58be215387f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:52.994307 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dd95b-7fce-4d40-a72a-e58be215387f service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:52.994587 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dd95b-7fce-4d40-a72a-e58be215387f service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:52.994859 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dd95b-7fce-4d40-a72a-e58be215387f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:53.011936 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961dd95b-7fce-4d40-a72a-e58be215387f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:53.013901 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961dd95b-7fce-4d40-a72a-e58be215387f service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:53.027049 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 874/1760] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:52 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:25:53.145963 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5b586-c43d-4a55-b8d1-470b1376b891 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:53.156615 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5b586-c43d-4a55-b8d1-470b1376b891 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:53.160493 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae217d8-712b-4a31-81f6-f0657f020354 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:53.161153 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae217d8-712b-4a31-81f6-f0657f020354 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:53.161443 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae217d8-712b-4a31-81f6-f0657f020354 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:53.161727 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae217d8-712b-4a31-81f6-f0657f020354 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:53.163679 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6ae217d8-712b-4a31-81f6-f0657f020354 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:53.242770 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae217d8-712b-4a31-81f6-f0657f020354 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:53.244797 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961dd95b-7fce-4d40-a72a-e58be215387f service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:53.246462 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-961dd95b-7fce-4d40-a72a-e58be215387f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:53.248883 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae217d8-712b-4a31-81f6-f0657f020354 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:53.272108 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 887/1761] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:25:53.334972 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961dd95b-7fce-4d40-a72a-e58be215387f service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:53.344624 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8eec7d-9bf5-43d0-8fa6-2893474bd8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:53.346386 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8eec7d-9bf5-43d0-8fa6-2893474bd8f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:53.346841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8eec7d-9bf5-43d0-8fa6-2893474bd8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:53.347390 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8eec7d-9bf5-43d0-8fa6-2893474bd8f9 admin admin] PATH_INFO: `/v3/projects/6333a45d94b14e838588481692a0e944` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:53.348702 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8eec7d-9bf5-43d0-8fa6-2893474bd8f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6333a45d94b14e838588481692a0e944)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:53.350937 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8eec7d-9bf5-43d0-8fa6-2893474bd8f9 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:53.443075 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2b8eec7d-9bf5-43d0-8fa6-2893474bd8f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6333a45d94b14e838588481692a0e944', 'request_id': 'req-2b8eec7d-9bf5-43d0-8fa6-2893474bd8f9'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:53.454360 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2b8eec7d-9bf5-43d0-8fa6-2893474bd8f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6333a45d94b14e838588481692a0e944', 'request_id': 'req-2b8eec7d-9bf5-43d0-8fa6-2893474bd8f9'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:53.463918 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2b8eec7d-9bf5-43d0-8fa6-2893474bd8f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6333a45d94b14e838588481692a0e944', 'request_id': 'req-2b8eec7d-9bf5-43d0-8fa6-2893474bd8f9'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:53.479482 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2b8eec7d-9bf5-43d0-8fa6-2893474bd8f9 admin admin] The token cache is being invalidate because project 6333a45d94b14e838588481692a0e944 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:25:53.479825 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2b8eec7d-9bf5-43d0-8fa6-2893474bd8f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:53.480487 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2b8eec7d-9bf5-43d0-8fa6-2893474bd8f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:53.482157 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 875/1762] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:25:53 2022] DELETE /identity/v3/projects/6333a45d94b14e838588481692a0e944 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:25:53.486411 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae217d8-712b-4a31-81f6-f0657f020354 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:53.499057 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae217d8-712b-4a31-81f6-f0657f020354 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:53.554897 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:53.594161 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237bdbd9-4907-46db-bbfd-f7d6e3530908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:53.595486 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bdbd9-4907-46db-bbfd-f7d6e3530908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:53.595866 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bdbd9-4907-46db-bbfd-f7d6e3530908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:53.597114 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bdbd9-4907-46db-bbfd-f7d6e3530908 admin admin] PATH_INFO: `/v3/users/cb565c6b954b4c9fbb3b5dba6aa3c90d` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:53.598482 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237bdbd9-4907-46db-bbfd-f7d6e3530908 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb565c6b954b4c9fbb3b5dba6aa3c90d)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:53.601909 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237bdbd9-4907-46db-bbfd-f7d6e3530908 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:53.668993 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8eec7d-9bf5-43d0-8fa6-2893474bd8f9 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:53.671025 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2b8eec7d-9bf5-43d0-8fa6-2893474bd8f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:53.672035 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-237bdbd9-4907-46db-bbfd-f7d6e3530908 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb565c6b954b4c9fbb3b5dba6aa3c90d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:53.672827 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-237bdbd9-4907-46db-bbfd-f7d6e3530908 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb565c6b954b4c9fbb3b5dba6aa3c90d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:53.682414 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-237bdbd9-4907-46db-bbfd-f7d6e3530908 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb565c6b954b4c9fbb3b5dba6aa3c90d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:53.694301 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8eec7d-9bf5-43d0-8fa6-2893474bd8f9 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:53.701396 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-237bdbd9-4907-46db-bbfd-f7d6e3530908 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb565c6b954b4c9fbb3b5dba6aa3c90d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:53.702079 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba331b6-18f5-4321-9abe-7313e2d4ebd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:53.702205 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-237bdbd9-4907-46db-bbfd-f7d6e3530908 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb565c6b954b4c9fbb3b5dba6aa3c90d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:53.703774 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba331b6-18f5-4321-9abe-7313e2d4ebd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:53.704261 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba331b6-18f5-4321-9abe-7313e2d4ebd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:53.704757 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba331b6-18f5-4321-9abe-7313e2d4ebd7 admin admin] PATH_INFO: `/v3/users/37953439b4d2491bbd71694567fb2abd` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:53.706126 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba331b6-18f5-4321-9abe-7313e2d4ebd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37953439b4d2491bbd71694567fb2abd)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:53.708914 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba331b6-18f5-4321-9abe-7313e2d4ebd7 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:53.725084 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 888/1763] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:25:53 2022] DELETE /identity/v3/users/cb565c6b954b4c9fbb3b5dba6aa3c90d => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:53.726087 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237bdbd9-4907-46db-bbfd-f7d6e3530908 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:53.727865 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-237bdbd9-4907-46db-bbfd-f7d6e3530908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:53.739025 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:53.789557 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5ba331b6-18f5-4321-9abe-7313e2d4ebd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37953439b4d2491bbd71694567fb2abd'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:53.791632 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5ba331b6-18f5-4321-9abe-7313e2d4ebd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37953439b4d2491bbd71694567fb2abd'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:53.815060 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5ba331b6-18f5-4321-9abe-7313e2d4ebd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37953439b4d2491bbd71694567fb2abd'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:53.821352 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237bdbd9-4907-46db-bbfd-f7d6e3530908 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:53.834629 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e6156-ee44-4da4-8071-07943d18b6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:53.835368 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e6156-ee44-4da4-8071-07943d18b6ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:53.835737 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e6156-ee44-4da4-8071-07943d18b6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:53.837380 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e6156-ee44-4da4-8071-07943d18b6ab admin admin] PATH_INFO: `/v3/users/d5b86703923a45cb8bd57c777296a5f6` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:53.845738 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e6156-ee44-4da4-8071-07943d18b6ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5b86703923a45cb8bd57c777296a5f6)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:53.848048 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e6156-ee44-4da4-8071-07943d18b6ab admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:53.855982 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5ba331b6-18f5-4321-9abe-7313e2d4ebd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37953439b4d2491bbd71694567fb2abd'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:53.857225 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5ba331b6-18f5-4321-9abe-7313e2d4ebd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37953439b4d2491bbd71694567fb2abd'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:53.881269 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 876/1764] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:25:53 2022] DELETE /identity/v3/users/37953439b4d2491bbd71694567fb2abd => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:53.886576 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edd21a-d818-4dbb-b24d-f0f8733d72ce None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:53.886947 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edd21a-d818-4dbb-b24d-f0f8733d72ce None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:53.887327 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edd21a-d818-4dbb-b24d-f0f8733d72ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:53.912340 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-49edd21a-d818-4dbb-b24d-f0f8733d72ce None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:53.914444 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-49edd21a-d818-4dbb-b24d-f0f8733d72ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:53.921423 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9c9e6156-ee44-4da4-8071-07943d18b6ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5b86703923a45cb8bd57c777296a5f6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:53.922620 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9c9e6156-ee44-4da4-8071-07943d18b6ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5b86703923a45cb8bd57c777296a5f6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:53.933293 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9c9e6156-ee44-4da4-8071-07943d18b6ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5b86703923a45cb8bd57c777296a5f6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:53.941825 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:53.961801 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9c9e6156-ee44-4da4-8071-07943d18b6ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5b86703923a45cb8bd57c777296a5f6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:53.962746 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9c9e6156-ee44-4da4-8071-07943d18b6ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5b86703923a45cb8bd57c777296a5f6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:53.998805 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 889/1765] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:25:53 2022] DELETE /identity/v3/users/d5b86703923a45cb8bd57c777296a5f6 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:54.001520 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6234dd-0512-4ee0-a821-c0aef96240d6 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:54.002110 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6234dd-0512-4ee0-a821-c0aef96240d6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:54.002392 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6234dd-0512-4ee0-a821-c0aef96240d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:54.058731 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-5f6234dd-0512-4ee0-a821-c0aef96240d6 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:54.063978 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5f6234dd-0512-4ee0-a821-c0aef96240d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:54.080733 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 877/1766] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:25:54.187313 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49edd21a-d818-4dbb-b24d-f0f8733d72ce None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:54.189653 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-49edd21a-d818-4dbb-b24d-f0f8733d72ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:54.230594 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 890/1767] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:54.237505 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6234dd-0512-4ee0-a821-c0aef96240d6 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:54.238898 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5f6234dd-0512-4ee0-a821-c0aef96240d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:54.324530 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49edd21a-d818-4dbb-b24d-f0f8733d72ce None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:54.385283 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6234dd-0512-4ee0-a821-c0aef96240d6 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:54.397776 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0227967-5275-4d23-bfbe-4592764f646a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:54.398438 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0227967-5275-4d23-bfbe-4592764f646a service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:54.399280 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0227967-5275-4d23-bfbe-4592764f646a service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:54.400180 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0227967-5275-4d23-bfbe-4592764f646a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:54.424323 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0227967-5275-4d23-bfbe-4592764f646a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:54.427056 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0227967-5275-4d23-bfbe-4592764f646a service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:54.450082 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 891/1768] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:25:54.451680 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0227967-5275-4d23-bfbe-4592764f646a service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:54.454430 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a0227967-5275-4d23-bfbe-4592764f646a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:54.469779 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0a654-09e5-4057-b58e-8a494a66c88a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:54.470328 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0a654-09e5-4057-b58e-8a494a66c88a service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:54.470613 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0a654-09e5-4057-b58e-8a494a66c88a service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:54.470886 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0a654-09e5-4057-b58e-8a494a66c88a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:54.471881 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0227967-5275-4d23-bfbe-4592764f646a service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:54.477476 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8639e-e9d0-47fc-a3e8-87449c02fdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:54.479596 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8639e-e9d0-47fc-a3e8-87449c02fdcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:54.479875 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8639e-e9d0-47fc-a3e8-87449c02fdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:54.480317 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8639e-e9d0-47fc-a3e8-87449c02fdcb admin admin] PATH_INFO: `/v3/projects/f8a238a986b74ad18ef16a93e17bd0e1` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:54.481885 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb8639e-e9d0-47fc-a3e8-87449c02fdcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8a238a986b74ad18ef16a93e17bd0e1)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:54.484258 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb8639e-e9d0-47fc-a3e8-87449c02fdcb admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:54.505831 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a0a654-09e5-4057-b58e-8a494a66c88a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:54.507397 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a0a654-09e5-4057-b58e-8a494a66c88a service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:54.534339 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:54.551766 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 878/1769] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:25:54.606654 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bbb8639e-e9d0-47fc-a3e8-87449c02fdcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8a238a986b74ad18ef16a93e17bd0e1', 'request_id': 'req-bbb8639e-e9d0-47fc-a3e8-87449c02fdcb'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:54.619387 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bbb8639e-e9d0-47fc-a3e8-87449c02fdcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8a238a986b74ad18ef16a93e17bd0e1', 'request_id': 'req-bbb8639e-e9d0-47fc-a3e8-87449c02fdcb'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:54.627599 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bbb8639e-e9d0-47fc-a3e8-87449c02fdcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8a238a986b74ad18ef16a93e17bd0e1', 'request_id': 'req-bbb8639e-e9d0-47fc-a3e8-87449c02fdcb'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:54.650309 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bbb8639e-e9d0-47fc-a3e8-87449c02fdcb admin admin] The token cache is being invalidate because project f8a238a986b74ad18ef16a93e17bd0e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:25:54.651241 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bbb8639e-e9d0-47fc-a3e8-87449c02fdcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:54.652365 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bbb8639e-e9d0-47fc-a3e8-87449c02fdcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:54.658306 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 892/1770] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:25:54 2022] DELETE /identity/v3/projects/f8a238a986b74ad18ef16a93e17bd0e1 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:54.659547 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0a654-09e5-4057-b58e-8a494a66c88a service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:54.677774 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0a654-09e5-4057-b58e-8a494a66c88a service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:54.907978 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd7c69-7a27-4d04-8dbd-feb48532eddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:54.908632 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd7c69-7a27-4d04-8dbd-feb48532eddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:54.911841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd7c69-7a27-4d04-8dbd-feb48532eddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:54.912129 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd7c69-7a27-4d04-8dbd-feb48532eddd admin admin] PATH_INFO: `/v3/users/df2dbb31e0a6421bbb54e94b87503f5d` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:54.928539 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd7c69-7a27-4d04-8dbd-feb48532eddd admin admin] RBAC: Authorizing `identity:delete_user(user_id=df2dbb31e0a6421bbb54e94b87503f5d)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:54.933621 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd7c69-7a27-4d04-8dbd-feb48532eddd admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:55.065898 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-bcdd7c69-7a27-4d04-8dbd-feb48532eddd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df2dbb31e0a6421bbb54e94b87503f5d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:55.067794 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-bcdd7c69-7a27-4d04-8dbd-feb48532eddd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df2dbb31e0a6421bbb54e94b87503f5d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:55.091947 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-bcdd7c69-7a27-4d04-8dbd-feb48532eddd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df2dbb31e0a6421bbb54e94b87503f5d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:55.123945 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-bcdd7c69-7a27-4d04-8dbd-feb48532eddd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df2dbb31e0a6421bbb54e94b87503f5d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:55.127691 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-bcdd7c69-7a27-4d04-8dbd-feb48532eddd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df2dbb31e0a6421bbb54e94b87503f5d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:55.193343 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 879/1771] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:25:54 2022] DELETE /identity/v3/users/df2dbb31e0a6421bbb54e94b87503f5d => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:25:55.538893 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8639e-e9d0-47fc-a3e8-87449c02fdcb admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:55.541132 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-bbb8639e-e9d0-47fc-a3e8-87449c02fdcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:55.553401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:55.560732 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8639e-e9d0-47fc-a3e8-87449c02fdcb admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:55.656035 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4134b-67cc-4d41-a56a-7762c5877cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:55.657915 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4134b-67cc-4d41-a56a-7762c5877cf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:55.658295 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4134b-67cc-4d41-a56a-7762c5877cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:55.659278 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4134b-67cc-4d41-a56a-7762c5877cf0 admin admin] PATH_INFO: `/v3/projects/a08a5d79a8cc49d7bbfb1d08227b4614` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:55.660870 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd4134b-67cc-4d41-a56a-7762c5877cf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a08a5d79a8cc49d7bbfb1d08227b4614)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:55.663203 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd4134b-67cc-4d41-a56a-7762c5877cf0 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:55.744404 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd7c69-7a27-4d04-8dbd-feb48532eddd admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:55.745878 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-bcdd7c69-7a27-4d04-8dbd-feb48532eddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:55.777807 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd7c69-7a27-4d04-8dbd-feb48532eddd admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:55.817466 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6dd4134b-67cc-4d41-a56a-7762c5877cf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a08a5d79a8cc49d7bbfb1d08227b4614', 'request_id': 'req-6dd4134b-67cc-4d41-a56a-7762c5877cf0'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:55.824523 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6dd4134b-67cc-4d41-a56a-7762c5877cf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a08a5d79a8cc49d7bbfb1d08227b4614', 'request_id': 'req-6dd4134b-67cc-4d41-a56a-7762c5877cf0'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:55.844084 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6dd4134b-67cc-4d41-a56a-7762c5877cf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a08a5d79a8cc49d7bbfb1d08227b4614', 'request_id': 'req-6dd4134b-67cc-4d41-a56a-7762c5877cf0'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:55.879670 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6dd4134b-67cc-4d41-a56a-7762c5877cf0 admin admin] The token cache is being invalidate because project a08a5d79a8cc49d7bbfb1d08227b4614 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:25:55.880280 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6dd4134b-67cc-4d41-a56a-7762c5877cf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:55.881110 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6dd4134b-67cc-4d41-a56a-7762c5877cf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:55.885961 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 893/1772] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:25:55 2022] DELETE /identity/v3/projects/a08a5d79a8cc49d7bbfb1d08227b4614 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:55.887312 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4134b-67cc-4d41-a56a-7762c5877cf0 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:55.889518 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6dd4134b-67cc-4d41-a56a-7762c5877cf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:55.918838 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9a708-7b79-4ad7-9de7-c9b1cf349a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:55.919655 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9a708-7b79-4ad7-9de7-c9b1cf349a19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:55.920146 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9a708-7b79-4ad7-9de7-c9b1cf349a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:55.920469 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9a708-7b79-4ad7-9de7-c9b1cf349a19 admin admin] PATH_INFO: `/v3/projects/7187b10daa90480cac15d9e243986e8c` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:55.923635 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9a708-7b79-4ad7-9de7-c9b1cf349a19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7187b10daa90480cac15d9e243986e8c)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:55.925771 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9a708-7b79-4ad7-9de7-c9b1cf349a19 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:55.981269 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:55.986650 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4134b-67cc-4d41-a56a-7762c5877cf0 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:56.009686 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588c1b3-7919-4e03-8f1c-cc10337cac17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:56.010323 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588c1b3-7919-4e03-8f1c-cc10337cac17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:56.010751 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588c1b3-7919-4e03-8f1c-cc10337cac17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:56.013790 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588c1b3-7919-4e03-8f1c-cc10337cac17 admin admin] PATH_INFO: `/v3/users/12dbc89506be4cadb1a1e1860288041d` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:56.014628 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0588c1b3-7919-4e03-8f1c-cc10337cac17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12dbc89506be4cadb1a1e1860288041d)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:56.019653 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0588c1b3-7919-4e03-8f1c-cc10337cac17 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:56.036729 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-84d9a708-7b79-4ad7-9de7-c9b1cf349a19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7187b10daa90480cac15d9e243986e8c', 'request_id': 'req-84d9a708-7b79-4ad7-9de7-c9b1cf349a19'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:56.059586 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-84d9a708-7b79-4ad7-9de7-c9b1cf349a19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7187b10daa90480cac15d9e243986e8c', 'request_id': 'req-84d9a708-7b79-4ad7-9de7-c9b1cf349a19'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:56.069761 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-84d9a708-7b79-4ad7-9de7-c9b1cf349a19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7187b10daa90480cac15d9e243986e8c', 'request_id': 'req-84d9a708-7b79-4ad7-9de7-c9b1cf349a19'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:56.084558 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-84d9a708-7b79-4ad7-9de7-c9b1cf349a19 admin admin] The token cache is being invalidate because project 7187b10daa90480cac15d9e243986e8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:25:56.085677 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-84d9a708-7b79-4ad7-9de7-c9b1cf349a19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:56.086636 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-84d9a708-7b79-4ad7-9de7-c9b1cf349a19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:56.088355 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 880/1773] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:25:55 2022] DELETE /identity/v3/projects/7187b10daa90480cac15d9e243986e8c => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:56.089316 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9a708-7b79-4ad7-9de7-c9b1cf349a19 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:56.091509 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-84d9a708-7b79-4ad7-9de7-c9b1cf349a19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:56.110137 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:56.124443 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0588c1b3-7919-4e03-8f1c-cc10337cac17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12dbc89506be4cadb1a1e1860288041d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:56.125813 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0588c1b3-7919-4e03-8f1c-cc10337cac17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12dbc89506be4cadb1a1e1860288041d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:56.137109 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0588c1b3-7919-4e03-8f1c-cc10337cac17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12dbc89506be4cadb1a1e1860288041d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:56.152724 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0588c1b3-7919-4e03-8f1c-cc10337cac17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12dbc89506be4cadb1a1e1860288041d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:56.153811 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0588c1b3-7919-4e03-8f1c-cc10337cac17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12dbc89506be4cadb1a1e1860288041d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:56.173567 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 894/1774] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:25:55 2022] DELETE /identity/v3/users/12dbc89506be4cadb1a1e1860288041d => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:56.175133 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a890fd-f92a-4089-a8aa-3cbfc7ed3c29 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:56.175578 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a890fd-f92a-4089-a8aa-3cbfc7ed3c29 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:56.175982 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a890fd-f92a-4089-a8aa-3cbfc7ed3c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:56.207959 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-95a890fd-f92a-4089-a8aa-3cbfc7ed3c29 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:56.209928 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-95a890fd-f92a-4089-a8aa-3cbfc7ed3c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:56.212109 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9a708-7b79-4ad7-9de7-c9b1cf349a19 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:56.359402 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad89b0-4e1a-4051-80ed-93660c46c137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:56.360080 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad89b0-4e1a-4051-80ed-93660c46c137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:56.360372 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad89b0-4e1a-4051-80ed-93660c46c137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:56.360634 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad89b0-4e1a-4051-80ed-93660c46c137 admin admin] PATH_INFO: `/v3/projects/76dcfb66966a4cd98b2fc8233a3b4f19` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:56.378484 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ad89b0-4e1a-4051-80ed-93660c46c137 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76dcfb66966a4cd98b2fc8233a3b4f19)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:56.386624 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 895/1775] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:56.388874 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ad89b0-4e1a-4051-80ed-93660c46c137 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:56.395062 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13bea82-f463-4a4d-924e-dc7f6e5f8579 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:56.395363 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13bea82-f463-4a4d-924e-dc7f6e5f8579 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:56.395681 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13bea82-f463-4a4d-924e-dc7f6e5f8579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:56.431735 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e13bea82-f463-4a4d-924e-dc7f6e5f8579 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:56.436589 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e13bea82-f463-4a4d-924e-dc7f6e5f8579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:56.460863 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 896/1776] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:56.465481 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13bea82-f463-4a4d-924e-dc7f6e5f8579 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:56.479303 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13bea82-f463-4a4d-924e-dc7f6e5f8579 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:56.495723 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10612aca-9950-464f-ab27-af2bfc13a292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:56.496536 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10612aca-9950-464f-ab27-af2bfc13a292 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:56.497423 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10612aca-9950-464f-ab27-af2bfc13a292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:56.497725 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10612aca-9950-464f-ab27-af2bfc13a292 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:56.500596 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10612aca-9950-464f-ab27-af2bfc13a292 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:25:56.500930 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10612aca-9950-464f-ab27-af2bfc13a292 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:56.504485 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10612aca-9950-464f-ab27-af2bfc13a292 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:56.525111 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-14ad89b0-4e1a-4051-80ed-93660c46c137 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76dcfb66966a4cd98b2fc8233a3b4f19', 'request_id': 'req-14ad89b0-4e1a-4051-80ed-93660c46c137'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:56.535997 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 897/1777] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:25:56.540709 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10612aca-9950-464f-ab27-af2bfc13a292 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:56.544220 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-14ad89b0-4e1a-4051-80ed-93660c46c137 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76dcfb66966a4cd98b2fc8233a3b4f19', 'request_id': 'req-14ad89b0-4e1a-4051-80ed-93660c46c137'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:56.548682 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:56.560653 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-14ad89b0-4e1a-4051-80ed-93660c46c137 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76dcfb66966a4cd98b2fc8233a3b4f19', 'request_id': 'req-14ad89b0-4e1a-4051-80ed-93660c46c137'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:56.572769 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10612aca-9950-464f-ab27-af2bfc13a292 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:56.586002 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-14ad89b0-4e1a-4051-80ed-93660c46c137 admin admin] The token cache is being invalidate because project 76dcfb66966a4cd98b2fc8233a3b4f19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:25:56.586543 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-14ad89b0-4e1a-4051-80ed-93660c46c137 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:56.589511 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-14ad89b0-4e1a-4051-80ed-93660c46c137 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:56.595754 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 881/1778] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:25:56 2022] DELETE /identity/v3/projects/76dcfb66966a4cd98b2fc8233a3b4f19 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:56.597132 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3193d-f8ee-4e39-89ca-b5d03f677dba None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:56.597415 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3193d-f8ee-4e39-89ca-b5d03f677dba None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:56.597764 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3193d-f8ee-4e39-89ca-b5d03f677dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:56.640247 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-0ad3193d-f8ee-4e39-89ca-b5d03f677dba None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:56.642268 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0ad3193d-f8ee-4e39-89ca-b5d03f677dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:56.659418 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c91f65-4449-4296-897a-fb33b49156ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:56.660189 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c91f65-4449-4296-897a-fb33b49156ad admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:56.660574 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c91f65-4449-4296-897a-fb33b49156ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:56.661661 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c91f65-4449-4296-897a-fb33b49156ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:56.662683 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c91f65-4449-4296-897a-fb33b49156ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:56.665310 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c91f65-4449-4296-897a-fb33b49156ad admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:56.728966 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 898/1779] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:25:56 2022] POST /identity/v3/projects => generated 391 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:56.735657 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c91f65-4449-4296-897a-fb33b49156ad admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:56.738073 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a6c91f65-4449-4296-897a-fb33b49156ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:56.770614 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 882/1780] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:25:56.780083 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8348f0d-4f2f-49f9-810e-8580a733b1d5 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:56.780362 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8348f0d-4f2f-49f9-810e-8580a733b1d5 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:56.780634 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8348f0d-4f2f-49f9-810e-8580a733b1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:56.788809 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:56.855462 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-a8348f0d-4f2f-49f9-810e-8580a733b1d5 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:56.856817 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a8348f0d-4f2f-49f9-810e-8580a733b1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:56.857991 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c91f65-4449-4296-897a-fb33b49156ad admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:56.867189 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 883/1781] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:56.871691 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8348f0d-4f2f-49f9-810e-8580a733b1d5 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:56.872280 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65572f-7db1-4a76-88a1-139aa00e528c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:56.873000 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65572f-7db1-4a76-88a1-139aa00e528c admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:56.873276 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65572f-7db1-4a76-88a1-139aa00e528c admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:56.873563 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65572f-7db1-4a76-88a1-139aa00e528c admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:56.874204 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af65572f-7db1-4a76-88a1-139aa00e528c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:56.876149 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af65572f-7db1-4a76-88a1-139aa00e528c admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:56.889235 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8348f0d-4f2f-49f9-810e-8580a733b1d5 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:56.895913 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef041b33-8036-4328-bc7f-fec7c9ffe0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:56.896608 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef041b33-8036-4328-bc7f-fec7c9ffe0c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:56.896911 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef041b33-8036-4328-bc7f-fec7c9ffe0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:56.897185 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef041b33-8036-4328-bc7f-fec7c9ffe0c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:56.897921 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef041b33-8036-4328-bc7f-fec7c9ffe0c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:25:56.898365 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef041b33-8036-4328-bc7f-fec7c9ffe0c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:56.900241 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef041b33-8036-4328-bc7f-fec7c9ffe0c0 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:56.911558 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 899/1782] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:25:56 2022] POST /identity/v3/users => generated 296 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:56.916022 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 884/1783] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:25:56.920281 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65572f-7db1-4a76-88a1-139aa00e528c admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:56.920437 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef041b33-8036-4328-bc7f-fec7c9ffe0c0 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:56.932675 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65572f-7db1-4a76-88a1-139aa00e528c admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:56.936961 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef041b33-8036-4328-bc7f-fec7c9ffe0c0 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:56.947738 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56e3fd-1e73-4c9c-a29e-f2fac3329214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:56.947738 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56e3fd-1e73-4c9c-a29e-f2fac3329214 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:56.947738 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56e3fd-1e73-4c9c-a29e-f2fac3329214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:56.948472 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56e3fd-1e73-4c9c-a29e-f2fac3329214 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:56.948551 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56e3fd-1e73-4c9c-a29e-f2fac3329214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:56.950315 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56e3fd-1e73-4c9c-a29e-f2fac3329214 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:56.953950 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60c57d-d086-450a-86d7-5ad727741a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:56.954789 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60c57d-d086-450a-86d7-5ad727741a67 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:56.955137 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60c57d-d086-450a-86d7-5ad727741a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:56.955473 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60c57d-d086-450a-86d7-5ad727741a67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:56.956370 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60c57d-d086-450a-86d7-5ad727741a67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:56.958824 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60c57d-d086-450a-86d7-5ad727741a67 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:56.966814 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 900/1784] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:56.967978 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56e3fd-1e73-4c9c-a29e-f2fac3329214 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:56.982444 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56e3fd-1e73-4c9c-a29e-f2fac3329214 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:56.987593 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c752d0-ed20-4d12-99cf-73a9c86ae067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:56.988572 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c752d0-ed20-4d12-99cf-73a9c86ae067 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:56.988852 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c752d0-ed20-4d12-99cf-73a9c86ae067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:56.989116 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c752d0-ed20-4d12-99cf-73a9c86ae067 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:56.990323 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c752d0-ed20-4d12-99cf-73a9c86ae067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:56.992430 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c752d0-ed20-4d12-99cf-73a9c86ae067 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:57.006970 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 885/1785] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:25:56 2022] POST /identity/v3/projects => generated 367 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:25:57.012102 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60c57d-d086-450a-86d7-5ad727741a67 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:57.016307 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 901/1786] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:57.017980 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c752d0-ed20-4d12-99cf-73a9c86ae067 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:57.047991 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c752d0-ed20-4d12-99cf-73a9c86ae067 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:57.115471 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60c57d-d086-450a-86d7-5ad727741a67 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:57.133485 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f403735-4ebb-4c7d-8849-64c4d8d8bafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:57.134575 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f403735-4ebb-4c7d-8849-64c4d8d8bafd admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:57.135187 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f403735-4ebb-4c7d-8849-64c4d8d8bafd admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:57.136254 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f403735-4ebb-4c7d-8849-64c4d8d8bafd admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:57.137627 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f403735-4ebb-4c7d-8849-64c4d8d8bafd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:57.142326 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f403735-4ebb-4c7d-8849-64c4d8d8bafd admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:57.160030 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c6729-948b-4a35-ba0a-fce4fa0cd193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:57.160819 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c6729-948b-4a35-ba0a-fce4fa0cd193 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:57.161358 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c6729-948b-4a35-ba0a-fce4fa0cd193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:57.161642 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c6729-948b-4a35-ba0a-fce4fa0cd193 admin admin] PATH_INFO: `/v3/projects/20fc3b9c6d2249469814c038b64b2663/users/398ce93f4bf24b2ea1d86fc5405fbe0a/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:57.181104 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 886/1787] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:25:57 2022] POST /identity/v3/users => generated 284 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:57.182090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f403735-4ebb-4c7d-8849-64c4d8d8bafd admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:57.184819 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6f403735-4ebb-4c7d-8849-64c4d8d8bafd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:57.197323 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c6729-948b-4a35-ba0a-fce4fa0cd193 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20fc3b9c6d2249469814c038b64b2663, user_id=398ce93f4bf24b2ea1d86fc5405fbe0a, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:57.200563 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f403735-4ebb-4c7d-8849-64c4d8d8bafd admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:57.205756 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c6729-948b-4a35-ba0a-fce4fa0cd193 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:57.206352 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff718b77-49bf-4fd6-bc12-f543c315bf03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:57.207382 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff718b77-49bf-4fd6-bc12-f543c315bf03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:57.207382 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff718b77-49bf-4fd6-bc12-f543c315bf03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:57.207600 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff718b77-49bf-4fd6-bc12-f543c315bf03 admin admin] PATH_INFO: `/v3/projects/fa327dd342cd4470a12b227f59892173` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:57.208769 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff718b77-49bf-4fd6-bc12-f543c315bf03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa327dd342cd4470a12b227f59892173)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:57.210786 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff718b77-49bf-4fd6-bc12-f543c315bf03 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:57.232333 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 902/1788] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:57 2022] PUT /identity/v3/projects/20fc3b9c6d2249469814c038b64b2663/users/398ce93f4bf24b2ea1d86fc5405fbe0a/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:57.233345 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c6729-948b-4a35-ba0a-fce4fa0cd193 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:57.269266 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:57.295949 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ff718b77-49bf-4fd6-bc12-f543c315bf03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa327dd342cd4470a12b227f59892173', 'request_id': 'req-ff718b77-49bf-4fd6-bc12-f543c315bf03'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:57.313523 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ff718b77-49bf-4fd6-bc12-f543c315bf03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa327dd342cd4470a12b227f59892173', 'request_id': 'req-ff718b77-49bf-4fd6-bc12-f543c315bf03'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:57.321725 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ff718b77-49bf-4fd6-bc12-f543c315bf03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa327dd342cd4470a12b227f59892173', 'request_id': 'req-ff718b77-49bf-4fd6-bc12-f543c315bf03'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:57.334636 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ff718b77-49bf-4fd6-bc12-f543c315bf03 admin admin] The token cache is being invalidate because project fa327dd342cd4470a12b227f59892173 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:25:57.334970 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ff718b77-49bf-4fd6-bc12-f543c315bf03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:57.335658 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ff718b77-49bf-4fd6-bc12-f543c315bf03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:57.337336 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 887/1789] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:25:57 2022] DELETE /identity/v3/projects/fa327dd342cd4470a12b227f59892173 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:57.345010 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1bf05-986c-4df8-9bca-b875e6700340 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:57.345732 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1bf05-986c-4df8-9bca-b875e6700340 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:57.346006 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1bf05-986c-4df8-9bca-b875e6700340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:57.359141 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c6729-948b-4a35-ba0a-fce4fa0cd193 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:57.389097 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-79d1bf05-986c-4df8-9bca-b875e6700340 None None] MFA Rules not processed for user `398ce93f4bf24b2ea1d86fc5405fbe0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:57.390326 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-79d1bf05-986c-4df8-9bca-b875e6700340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:57.409014 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:57.469094 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 888/1790] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:57 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:57.470546 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d28c7-6404-439d-b142-3e930f43da3d None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:57.470829 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d28c7-6404-439d-b142-3e930f43da3d None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:57.471113 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d28c7-6404-439d-b142-3e930f43da3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:57.522946 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-923d28c7-6404-439d-b142-3e930f43da3d None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:57.527390 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-923d28c7-6404-439d-b142-3e930f43da3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:57.546522 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30570ef4-02cd-4b18-b2f9-7915f277462e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:57.547245 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30570ef4-02cd-4b18-b2f9-7915f277462e admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:57.547572 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30570ef4-02cd-4b18-b2f9-7915f277462e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:57.547853 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30570ef4-02cd-4b18-b2f9-7915f277462e admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:57.548507 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30570ef4-02cd-4b18-b2f9-7915f277462e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:57.550210 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30570ef4-02cd-4b18-b2f9-7915f277462e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:57.569144 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 903/1791] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:57.570083 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30570ef4-02cd-4b18-b2f9-7915f277462e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:57.572221 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-30570ef4-02cd-4b18-b2f9-7915f277462e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:57.611472 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 889/1792] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:57.612846 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d28c7-6404-439d-b142-3e930f43da3d None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:57.614289 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-923d28c7-6404-439d-b142-3e930f43da3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:57.629184 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d28c7-6404-439d-b142-3e930f43da3d None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:57.635395 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a5cb9-4a98-4a14-b9c6-fcd3c166c992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:57.636018 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a5cb9-4a98-4a14-b9c6-fcd3c166c992 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:57.636296 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a5cb9-4a98-4a14-b9c6-fcd3c166c992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:57.637079 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a5cb9-4a98-4a14-b9c6-fcd3c166c992 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:57.637286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a5cb9-4a98-4a14-b9c6-fcd3c166c992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:57.639333 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a5cb9-4a98-4a14-b9c6-fcd3c166c992 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:57.650020 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30570ef4-02cd-4b18-b2f9-7915f277462e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:57.651911 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 890/1793] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:57.653023 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12189d47-3b59-425f-9a5b-1117f0e601d2 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:57.653412 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12189d47-3b59-425f-9a5b-1117f0e601d2 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:57.654852 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12189d47-3b59-425f-9a5b-1117f0e601d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:57.658097 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3c953-0282-45c4-85a7-16c3c9a7863f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:57.658727 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3c953-0282-45c4-85a7-16c3c9a7863f service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:57.659000 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3c953-0282-45c4-85a7-16c3c9a7863f service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:57.659730 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3c953-0282-45c4-85a7-16c3c9a7863f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:57.669561 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3c953-0282-45c4-85a7-16c3c9a7863f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:57.671354 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3c953-0282-45c4-85a7-16c3c9a7863f service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:57.688325 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-12189d47-3b59-425f-9a5b-1117f0e601d2 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:57.689851 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-12189d47-3b59-425f-9a5b-1117f0e601d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:57.693712 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 904/1794] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:57 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:25:57.694693 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3c953-0282-45c4-85a7-16c3c9a7863f service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:57.699576 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 891/1795] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:57.704511 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12189d47-3b59-425f-9a5b-1117f0e601d2 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:57.707571 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3c953-0282-45c4-85a7-16c3c9a7863f service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:57.712546 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e145b96-3d04-4199-bffb-6b79155b6314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:57.713207 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e145b96-3d04-4199-bffb-6b79155b6314 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:57.713478 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e145b96-3d04-4199-bffb-6b79155b6314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:57.713791 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e145b96-3d04-4199-bffb-6b79155b6314 admin admin] PATH_INFO: `/v3/projects/bbe59abb1eff4aa99649025e125a6d4f/users/c1376ddb0b624bf681ddd80cc7375707/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:57.714417 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12189d47-3b59-425f-9a5b-1117f0e601d2 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:57.719428 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee60c1-4231-429d-b753-bd03ccb9fecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:57.720047 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee60c1-4231-429d-b753-bd03ccb9fecd admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:57.720310 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee60c1-4231-429d-b753-bd03ccb9fecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:57.720583 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee60c1-4231-429d-b753-bd03ccb9fecd admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:57.721251 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee60c1-4231-429d-b753-bd03ccb9fecd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:25:57.721612 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee60c1-4231-429d-b753-bd03ccb9fecd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:57.723379 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee60c1-4231-429d-b753-bd03ccb9fecd admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:57.731916 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e145b96-3d04-4199-bffb-6b79155b6314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbe59abb1eff4aa99649025e125a6d4f, user_id=c1376ddb0b624bf681ddd80cc7375707, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:57.734603 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e145b96-3d04-4199-bffb-6b79155b6314 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:57.763706 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 892/1796] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:25:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:25:57.763796 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 905/1797] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:57 2022] PUT /identity/v3/projects/bbe59abb1eff4aa99649025e125a6d4f/users/c1376ddb0b624bf681ddd80cc7375707/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:57.766482 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf86cf-eb6c-4dbd-9bcb-a18d9b90e188 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:57.766764 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf86cf-eb6c-4dbd-9bcb-a18d9b90e188 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:57.767039 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf86cf-eb6c-4dbd-9bcb-a18d9b90e188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:57.771726 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e145b96-3d04-4199-bffb-6b79155b6314 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:57.816509 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-dfbf86cf-eb6c-4dbd-9bcb-a18d9b90e188 None None] MFA Rules not processed for user `c1376ddb0b624bf681ddd80cc7375707`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:57.818198 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-dfbf86cf-eb6c-4dbd-9bcb-a18d9b90e188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:57.828661 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:57.861678 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e145b96-3d04-4199-bffb-6b79155b6314 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:57.869583 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba5834-87f5-4d71-b512-adf6b496bb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:57.870460 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba5834-87f5-4d71-b512-adf6b496bb74 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:57.871042 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba5834-87f5-4d71-b512-adf6b496bb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:57.871490 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba5834-87f5-4d71-b512-adf6b496bb74 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:57.872740 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba5834-87f5-4d71-b512-adf6b496bb74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:57.874946 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba5834-87f5-4d71-b512-adf6b496bb74 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:57.930993 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 906/1798] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:25:57 2022] POST /identity/v3/projects => generated 373 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:57.932350 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01653bf-6981-40fc-9738-184986f1fbaa None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:57.932683 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01653bf-6981-40fc-9738-184986f1fbaa None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:57.932973 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01653bf-6981-40fc-9738-184986f1fbaa None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:57.935535 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 907/1799] 10.222.0.52 () {54 vars in 921 bytes} [Thu Oct 27 13:25:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:25:57.936409 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01653bf-6981-40fc-9738-184986f1fbaa None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:57.938434 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c01653bf-6981-40fc-9738-184986f1fbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:57.946044 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 893/1800] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:57.951217 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf86cf-eb6c-4dbd-9bcb-a18d9b90e188 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:57.974149 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf86cf-eb6c-4dbd-9bcb-a18d9b90e188 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:57.978254 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:58.058502 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0f8e0-4fb2-481e-88a9-ad768fce07ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:58.059794 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0f8e0-4fb2-481e-88a9-ad768fce07ac admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:58.060606 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0f8e0-4fb2-481e-88a9-ad768fce07ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:58.060885 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0f8e0-4fb2-481e-88a9-ad768fce07ac admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:58.061812 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e0f8e0-4fb2-481e-88a9-ad768fce07ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:58.064205 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e0f8e0-4fb2-481e-88a9-ad768fce07ac admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:58.066106 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01653bf-6981-40fc-9738-184986f1fbaa None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:58.076748 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e4a75-a872-4394-a377-fb659c253142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:58.077768 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e4a75-a872-4394-a377-fb659c253142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:58.078144 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e4a75-a872-4394-a377-fb659c253142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:58.078514 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e4a75-a872-4394-a377-fb659c253142 admin admin] PATH_INFO: `/v3/users/6b715ce1b1b2441c968102cadb1dea50` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:58.079843 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e4a75-a872-4394-a377-fb659c253142 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b715ce1b1b2441c968102cadb1dea50)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:58.082222 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e4a75-a872-4394-a377-fb659c253142 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:58.110149 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 894/1801] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:25:57 2022] POST /identity/v3/users => generated 287 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:58.117837 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef33775-7f7c-4fff-b05b-54c7fcce5add None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:58.118206 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef33775-7f7c-4fff-b05b-54c7fcce5add None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:58.118599 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef33775-7f7c-4fff-b05b-54c7fcce5add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:58.165642 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-6ef33775-7f7c-4fff-b05b-54c7fcce5add None None] MFA Rules not processed for user `cbcd6da4e42248a3b38101104fbc03cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:58.167007 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6ef33775-7f7c-4fff-b05b-54c7fcce5add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:58.175262 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-047e4a75-a872-4394-a377-fb659c253142 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b715ce1b1b2441c968102cadb1dea50'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:58.176219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-047e4a75-a872-4394-a377-fb659c253142 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b715ce1b1b2441c968102cadb1dea50'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:58.190657 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-047e4a75-a872-4394-a377-fb659c253142 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b715ce1b1b2441c968102cadb1dea50'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:58.209309 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-047e4a75-a872-4394-a377-fb659c253142 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b715ce1b1b2441c968102cadb1dea50'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:58.210159 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-047e4a75-a872-4394-a377-fb659c253142 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b715ce1b1b2441c968102cadb1dea50'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:58.249895 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 908/1802] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:25:57 2022] DELETE /identity/v3/users/6b715ce1b1b2441c968102cadb1dea50 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:58.250660 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e4a75-a872-4394-a377-fb659c253142 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:58.252717 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-047e4a75-a872-4394-a377-fb659c253142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:58.277298 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 895/1803] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Oct 27 13:25:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:58.278307 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef33775-7f7c-4fff-b05b-54c7fcce5add None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:58.280175 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6ef33775-7f7c-4fff-b05b-54c7fcce5add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:58.295889 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef33775-7f7c-4fff-b05b-54c7fcce5add None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:58.338950 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:58.340620 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e4a75-a872-4394-a377-fb659c253142 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:58.345578 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db15521-1964-4f03-99b4-8a457de2002f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2298dbfcf7b74668902781401f77215e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:58.346468 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db15521-1964-4f03-99b4-8a457de2002f service glance] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:58.346781 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db15521-1964-4f03-99b4-8a457de2002f service glance] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:58.347105 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db15521-1964-4f03-99b4-8a457de2002f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:58.349218 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0db15521-1964-4f03-99b4-8a457de2002f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:58.385652 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585a47a-d8aa-489c-87d0-b7a2a26b2c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:58.386934 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585a47a-d8aa-489c-87d0-b7a2a26b2c72 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:58.387338 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585a47a-d8aa-489c-87d0-b7a2a26b2c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:58.387721 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585a47a-d8aa-489c-87d0-b7a2a26b2c72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:58.388457 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585a47a-d8aa-489c-87d0-b7a2a26b2c72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:58.390784 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585a47a-d8aa-489c-87d0-b7a2a26b2c72 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:58.414763 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 896/1804] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:58.415832 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585a47a-d8aa-489c-87d0-b7a2a26b2c72 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:58.418706 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a585a47a-d8aa-489c-87d0-b7a2a26b2c72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:58.434076 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:58.460042 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db15521-1964-4f03-99b4-8a457de2002f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:58.461790 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db15521-1964-4f03-99b4-8a457de2002f service glance] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:58.471777 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 909/1805] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:25:58.472614 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db15521-1964-4f03-99b4-8a457de2002f service glance] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:58.486271 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db15521-1964-4f03-99b4-8a457de2002f service glance] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:58.495285 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19bb47b-c023-4af7-b150-c7f2c6751008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:58.495915 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19bb47b-c023-4af7-b150-c7f2c6751008 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:58.496327 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19bb47b-c023-4af7-b150-c7f2c6751008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:58.496598 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19bb47b-c023-4af7-b150-c7f2c6751008 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:58.497243 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19bb47b-c023-4af7-b150-c7f2c6751008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:58.498903 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19bb47b-c023-4af7-b150-c7f2c6751008 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:58.523331 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 910/1806] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:58.523331 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19bb47b-c023-4af7-b150-c7f2c6751008 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:58.532882 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c19bb47b-c023-4af7-b150-c7f2c6751008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:58.562950 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585a47a-d8aa-489c-87d0-b7a2a26b2c72 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:58.565083 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19bb47b-c023-4af7-b150-c7f2c6751008 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:58.574539 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042bac2-7fcb-414e-acd8-d1a32536ce86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:58.575585 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72599432-65c8-4790-8f08-f8ae8f66a059 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbcd6da4e42248a3b38101104fbc03cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:58.576643 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042bac2-7fcb-414e-acd8-d1a32536ce86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:58.576925 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042bac2-7fcb-414e-acd8-d1a32536ce86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:58.577202 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042bac2-7fcb-414e-acd8-d1a32536ce86 admin admin] PATH_INFO: `/v3/projects/4a4af039772a41b0956859f911975613` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:58.577694 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72599432-65c8-4790-8f08-f8ae8f66a059 service placement] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:58.577976 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72599432-65c8-4790-8f08-f8ae8f66a059 service placement] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:58.578242 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72599432-65c8-4790-8f08-f8ae8f66a059 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:58.579894 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042bac2-7fcb-414e-acd8-d1a32536ce86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a4af039772a41b0956859f911975613)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:58.584062 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042bac2-7fcb-414e-acd8-d1a32536ce86 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:58.590772 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72599432-65c8-4790-8f08-f8ae8f66a059 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:58.592746 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72599432-65c8-4790-8f08-f8ae8f66a059 service placement] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:58.607490 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 897/1807] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:25:58.609369 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72599432-65c8-4790-8f08-f8ae8f66a059 service placement] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:58.622695 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72599432-65c8-4790-8f08-f8ae8f66a059 service placement] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:58.635146 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe08da-148d-46aa-b57c-2c82450827f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:58.636841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe08da-148d-46aa-b57c-2c82450827f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:58.637430 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe08da-148d-46aa-b57c-2c82450827f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:58.637866 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe08da-148d-46aa-b57c-2c82450827f4 admin admin] PATH_INFO: `/v3/projects/5e4e2bea68114530a9c02ca47da9f83f/users/0534584e51cd4cbf9309ba101cc88b27/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:58.669050 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe08da-148d-46aa-b57c-2c82450827f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e4e2bea68114530a9c02ca47da9f83f, user_id=0534584e51cd4cbf9309ba101cc88b27, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:58.672457 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe08da-148d-46aa-b57c-2c82450827f4 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:58.691883 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2042bac2-7fcb-414e-acd8-d1a32536ce86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a4af039772a41b0956859f911975613', 'request_id': 'req-2042bac2-7fcb-414e-acd8-d1a32536ce86'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:58.706856 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2042bac2-7fcb-414e-acd8-d1a32536ce86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a4af039772a41b0956859f911975613', 'request_id': 'req-2042bac2-7fcb-414e-acd8-d1a32536ce86'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:58.717050 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 898/1808] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:58 2022] PUT /identity/v3/projects/5e4e2bea68114530a9c02ca47da9f83f/users/0534584e51cd4cbf9309ba101cc88b27/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:58.717836 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2042bac2-7fcb-414e-acd8-d1a32536ce86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a4af039772a41b0956859f911975613', 'request_id': 'req-2042bac2-7fcb-414e-acd8-d1a32536ce86'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:58.718943 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa8e39-bfb3-420c-ab6a-e1ed160a9da7 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:58.719359 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa8e39-bfb3-420c-ab6a-e1ed160a9da7 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:58.719646 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa8e39-bfb3-420c-ab6a-e1ed160a9da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:58.749644 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2042bac2-7fcb-414e-acd8-d1a32536ce86 admin admin] The token cache is being invalidate because project 4a4af039772a41b0956859f911975613 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:25:58.749942 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2042bac2-7fcb-414e-acd8-d1a32536ce86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:58.753101 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2042bac2-7fcb-414e-acd8-d1a32536ce86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:25:58.758775 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 911/1809] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:25:58 2022] DELETE /identity/v3/projects/4a4af039772a41b0956859f911975613 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:25:58.764326 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf8bbd-75ca-4fa5-9117-84211531aff8 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:58.764601 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf8bbd-75ca-4fa5-9117-84211531aff8 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:58.764874 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf8bbd-75ca-4fa5-9117-84211531aff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:58.772614 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-7afa8e39-bfb3-420c-ab6a-e1ed160a9da7 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:58.776173 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7afa8e39-bfb3-420c-ab6a-e1ed160a9da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:58.815379 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-6fdf8bbd-75ca-4fa5-9117-84211531aff8 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:58.816593 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6fdf8bbd-75ca-4fa5-9117-84211531aff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:58.927965 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 912/1810] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:58.933475 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 899/1811] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:58.939906 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67715c1d-82c2-4050-bcbe-1c21a9c35d4c None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:58.940335 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67715c1d-82c2-4050-bcbe-1c21a9c35d4c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:58.940616 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67715c1d-82c2-4050-bcbe-1c21a9c35d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:58.953836 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa8e39-bfb3-420c-ab6a-e1ed160a9da7 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:58.955730 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7afa8e39-bfb3-420c-ab6a-e1ed160a9da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:58.998590 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-67715c1d-82c2-4050-bcbe-1c21a9c35d4c None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:59.001812 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-67715c1d-82c2-4050-bcbe-1c21a9c35d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:59.022201 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 913/1812] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:59.027855 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67715c1d-82c2-4050-bcbe-1c21a9c35d4c None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:59.036406 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:59.049229 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67715c1d-82c2-4050-bcbe-1c21a9c35d4c None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:59.065354 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e3580-5a84-4abe-9784-eee6fcc02eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:59.067798 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e3580-5a84-4abe-9784-eee6fcc02eca admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:59.068721 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e3580-5a84-4abe-9784-eee6fcc02eca admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:59.069120 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e3580-5a84-4abe-9784-eee6fcc02eca admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:59.070060 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329e3580-5a84-4abe-9784-eee6fcc02eca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:25:59.070403 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329e3580-5a84-4abe-9784-eee6fcc02eca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:59.072180 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329e3580-5a84-4abe-9784-eee6fcc02eca admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:59.099022 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 914/1813] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:25:59.100087 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa8e39-bfb3-420c-ab6a-e1ed160a9da7 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:59.103270 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e3580-5a84-4abe-9784-eee6fcc02eca admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:59.107080 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857ebdb-6d42-464e-9eba-c0dfd8f6cdce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:59.107988 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857ebdb-6d42-464e-9eba-c0dfd8f6cdce service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:59.108342 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857ebdb-6d42-464e-9eba-c0dfd8f6cdce service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:59.108681 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857ebdb-6d42-464e-9eba-c0dfd8f6cdce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:59.119789 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9857ebdb-6d42-464e-9eba-c0dfd8f6cdce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:59.121449 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9857ebdb-6d42-464e-9eba-c0dfd8f6cdce service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:59.128137 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e3580-5a84-4abe-9784-eee6fcc02eca admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:59.136464 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 900/1814] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:25:59.147285 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671718e-4c8e-4d81-ba41-868325e7caff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:59.148009 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671718e-4c8e-4d81-ba41-868325e7caff admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:59.148201 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671718e-4c8e-4d81-ba41-868325e7caff admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:59.148831 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671718e-4c8e-4d81-ba41-868325e7caff admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:59.149695 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671718e-4c8e-4d81-ba41-868325e7caff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:59.151744 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671718e-4c8e-4d81-ba41-868325e7caff admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:59.194647 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857ebdb-6d42-464e-9eba-c0dfd8f6cdce service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:59.195444 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 915/1815] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:25:59 2022] POST /identity/v3/projects => generated 373 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:59.210835 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857ebdb-6d42-464e-9eba-c0dfd8f6cdce service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:59.326544 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4d733-2560-437c-98f4-1f328f1dc6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:59.328831 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4d733-2560-437c-98f4-1f328f1dc6dc admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:59.329913 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4d733-2560-437c-98f4-1f328f1dc6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:59.329913 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4d733-2560-437c-98f4-1f328f1dc6dc admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:59.331196 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea4d733-2560-437c-98f4-1f328f1dc6dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:59.336616 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea4d733-2560-437c-98f4-1f328f1dc6dc admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:59.373104 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 901/1816] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:25:59 2022] POST /identity/v3/users => generated 287 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:59.377828 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671718e-4c8e-4d81-ba41-868325e7caff admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:59.390236 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671718e-4c8e-4d81-ba41-868325e7caff admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:59.396912 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f65242f-503a-467d-b685-08d06eb348a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:59.397806 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f65242f-503a-467d-b685-08d06eb348a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:59.398242 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f65242f-503a-467d-b685-08d06eb348a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:59.399009 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f65242f-503a-467d-b685-08d06eb348a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:59.400499 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f65242f-503a-467d-b685-08d06eb348a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:59.402326 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f65242f-503a-467d-b685-08d06eb348a4 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:59.417156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 916/1817] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 13:25:59.421276 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4d733-2560-437c-98f4-1f328f1dc6dc admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:59.433294 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4d733-2560-437c-98f4-1f328f1dc6dc admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:59.441018 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89d2bc-93bb-4109-9e3f-23b44149d501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:59.441930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89d2bc-93bb-4109-9e3f-23b44149d501 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:59.442355 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89d2bc-93bb-4109-9e3f-23b44149d501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:59.442799 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89d2bc-93bb-4109-9e3f-23b44149d501 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:59.443625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd89d2bc-93bb-4109-9e3f-23b44149d501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:59.446262 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd89d2bc-93bb-4109-9e3f-23b44149d501 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:59.459692 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 902/1818] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:25:59.464590 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f65242f-503a-467d-b685-08d06eb348a4 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:59.480456 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f65242f-503a-467d-b685-08d06eb348a4 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:59.490314 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56868383-33f4-4ae9-8cc7-817f2620704e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:59.491541 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56868383-33f4-4ae9-8cc7-817f2620704e admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:59.492046 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56868383-33f4-4ae9-8cc7-817f2620704e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:59.492516 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56868383-33f4-4ae9-8cc7-817f2620704e admin admin] PATH_INFO: `/v3/projects/a1a61a242be0445790a6cfb58ce8eeb4/users/ad0a877278d94614a3761736037bb8ed/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:59.509710 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:59.522096 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56868383-33f4-4ae9-8cc7-817f2620704e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1a61a242be0445790a6cfb58ce8eeb4, user_id=ad0a877278d94614a3761736037bb8ed, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:59.525923 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56868383-33f4-4ae9-8cc7-817f2620704e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:59.556110 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 917/1819] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:25:59 2022] PUT /identity/v3/projects/a1a61a242be0445790a6cfb58ce8eeb4/users/ad0a877278d94614a3761736037bb8ed/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:25:59.568605 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611086fe-b0c1-46ed-aef7-302b4a4d0302 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:59.569053 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611086fe-b0c1-46ed-aef7-302b4a4d0302 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:59.569400 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611086fe-b0c1-46ed-aef7-302b4a4d0302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:59.616010 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-611086fe-b0c1-46ed-aef7-302b4a4d0302 None None] MFA Rules not processed for user `ad0a877278d94614a3761736037bb8ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:59.618638 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-611086fe-b0c1-46ed-aef7-302b4a4d0302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:59.807180 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616efd37-afac-47d4-ada6-7489afcd261d None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:59.807639 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616efd37-afac-47d4-ada6-7489afcd261d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:59.807713 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616efd37-afac-47d4-ada6-7489afcd261d None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:59.809780 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 918/1820] 10.222.0.52 () {54 vars in 921 bytes} [Thu Oct 27 13:25:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 13:25:59.819685 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ce8f5-9489-4711-ba58-cdf0ebb3e4b7 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:59.821030 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ce8f5-9489-4711-ba58-cdf0ebb3e4b7 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:59.821378 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ce8f5-9489-4711-ba58-cdf0ebb3e4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:59.827877 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 903/1821] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:25:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:59.834898 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611086fe-b0c1-46ed-aef7-302b4a4d0302 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:59.848809 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-931ce8f5-9489-4711-ba58-cdf0ebb3e4b7 None None] MFA Rules not processed for user `cbcd6da4e42248a3b38101104fbc03cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:25:59.850773 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-931ce8f5-9489-4711-ba58-cdf0ebb3e4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:59.913844 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:59.934165 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611086fe-b0c1-46ed-aef7-302b4a4d0302 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:25:59.941569 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd62201-4778-4433-8615-af3fad0f5c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:25:59.942194 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd62201-4778-4433-8615-af3fad0f5c3e admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:25:59.942472 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd62201-4778-4433-8615-af3fad0f5c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:25:59.942744 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd62201-4778-4433-8615-af3fad0f5c3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:25:59.943385 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd62201-4778-4433-8615-af3fad0f5c3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:25:59.945320 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd62201-4778-4433-8615-af3fad0f5c3e admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:25:59.959970 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 919/1822] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Oct 27 13:25:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:25:59.961070 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ce8f5-9489-4711-ba58-cdf0ebb3e4b7 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:59.965354 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-931ce8f5-9489-4711-ba58-cdf0ebb3e4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:59.983764 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 904/1823] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:25:59 2022] POST /identity/v3/projects => generated 371 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:25:59.985038 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd62201-4778-4433-8615-af3fad0f5c3e admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:25:59.987220 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-dfd62201-4778-4433-8615-af3fad0f5c3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:25:59.989220 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ce8f5-9489-4711-ba58-cdf0ebb3e4b7 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:00.077481 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eecb9f7-b709-4a1e-af81-4db4782c0937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:00.078527 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eecb9f7-b709-4a1e-af81-4db4782c0937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:00.079092 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eecb9f7-b709-4a1e-af81-4db4782c0937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:00.079426 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eecb9f7-b709-4a1e-af81-4db4782c0937 admin admin] PATH_INFO: `/v3/users/228922913cf1492a8d12a1a19bf7fd09` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:00.080897 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eecb9f7-b709-4a1e-af81-4db4782c0937 admin admin] RBAC: Authorizing `identity:delete_user(user_id=228922913cf1492a8d12a1a19bf7fd09)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:00.082979 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eecb9f7-b709-4a1e-af81-4db4782c0937 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:00.096875 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd62201-4778-4433-8615-af3fad0f5c3e admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:00.110913 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a0a7d-dc9f-4b44-b952-6b89fbc2c8b6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbcd6da4e42248a3b38101104fbc03cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:00.112309 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a0a7d-dc9f-4b44-b952-6b89fbc2c8b6 service placement] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:00.112594 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a0a7d-dc9f-4b44-b952-6b89fbc2c8b6 service placement] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:00.114665 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a0a7d-dc9f-4b44-b952-6b89fbc2c8b6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:00.131610 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a0a7d-dc9f-4b44-b952-6b89fbc2c8b6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:00.133209 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a0a7d-dc9f-4b44-b952-6b89fbc2c8b6 service placement] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:00.170237 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 905/1824] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:25:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:26:00.173690 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a0a7d-dc9f-4b44-b952-6b89fbc2c8b6 service placement] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:00.199968 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9eecb9f7-b709-4a1e-af81-4db4782c0937 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '228922913cf1492a8d12a1a19bf7fd09'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:00.202379 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a0a7d-dc9f-4b44-b952-6b89fbc2c8b6 service placement] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:00.203104 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9eecb9f7-b709-4a1e-af81-4db4782c0937 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '228922913cf1492a8d12a1a19bf7fd09'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:00.220249 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ff901-82d2-441a-9a5b-2ab7b8d52488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:00.224046 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ff901-82d2-441a-9a5b-2ab7b8d52488 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:00.224214 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ff901-82d2-441a-9a5b-2ab7b8d52488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:00.225501 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ff901-82d2-441a-9a5b-2ab7b8d52488 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:00.226127 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ff901-82d2-441a-9a5b-2ab7b8d52488 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:00.229893 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ff901-82d2-441a-9a5b-2ab7b8d52488 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:00.234712 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9eecb9f7-b709-4a1e-af81-4db4782c0937 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '228922913cf1492a8d12a1a19bf7fd09'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:00.274695 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9eecb9f7-b709-4a1e-af81-4db4782c0937 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '228922913cf1492a8d12a1a19bf7fd09'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:00.275525 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9eecb9f7-b709-4a1e-af81-4db4782c0937 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '228922913cf1492a8d12a1a19bf7fd09'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:00.286731 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 906/1825] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:26:00 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:26:00.290830 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ff901-82d2-441a-9a5b-2ab7b8d52488 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:00.294191 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-910ff901-82d2-441a-9a5b-2ab7b8d52488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:00.317181 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 920/1826] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:25:59 2022] DELETE /identity/v3/users/228922913cf1492a8d12a1a19bf7fd09 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:26:00.320069 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ff901-82d2-441a-9a5b-2ab7b8d52488 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:00.444466 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9513a-9891-4a70-ac30-23cc89cff4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:00.445415 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9513a-9891-4a70-ac30-23cc89cff4a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:00.446239 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9513a-9891-4a70-ac30-23cc89cff4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:00.447938 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9513a-9891-4a70-ac30-23cc89cff4a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:00.448712 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f9513a-9891-4a70-ac30-23cc89cff4a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:00.451941 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f9513a-9891-4a70-ac30-23cc89cff4a0 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:00.473153 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 907/1827] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:26:00.474995 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eecb9f7-b709-4a1e-af81-4db4782c0937 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:00.482033 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:00.489142 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eecb9f7-b709-4a1e-af81-4db4782c0937 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:00.495078 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3e1ac-3be3-4a25-a8cc-54fa29dbc12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:00.496138 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3e1ac-3be3-4a25-a8cc-54fa29dbc12a admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:00.496713 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3e1ac-3be3-4a25-a8cc-54fa29dbc12a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:00.497455 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3e1ac-3be3-4a25-a8cc-54fa29dbc12a admin admin] PATH_INFO: `/v3/projects/46f88de654aa4ecc84c02597a786f203/users/048fadf85fbe4e58ad1d4366d383b0d4/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:00.518586 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3e1ac-3be3-4a25-a8cc-54fa29dbc12a admin admin] RBAC: Authorizing `identity:create_grant(project_id=46f88de654aa4ecc84c02597a786f203, user_id=048fadf85fbe4e58ad1d4366d383b0d4, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:00.521453 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3e1ac-3be3-4a25-a8cc-54fa29dbc12a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:00.544916 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 921/1828] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:26:00 2022] PUT /identity/v3/projects/46f88de654aa4ecc84c02597a786f203/users/048fadf85fbe4e58ad1d4366d383b0d4/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:26:00.549187 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9513a-9891-4a70-ac30-23cc89cff4a0 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:00.564324 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9513a-9891-4a70-ac30-23cc89cff4a0 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:00.620255 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:00.646871 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ae61d-9628-47d5-9b07-b24dc9b00041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:00.647501 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ae61d-9628-47d5-9b07-b24dc9b00041 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:00.647788 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ae61d-9628-47d5-9b07-b24dc9b00041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:00.648035 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ae61d-9628-47d5-9b07-b24dc9b00041 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:00.649042 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ae61d-9628-47d5-9b07-b24dc9b00041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:00.650825 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ae61d-9628-47d5-9b07-b24dc9b00041 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:00.666002 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 908/1829] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:26:00.667290 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3e1ac-3be3-4a25-a8cc-54fa29dbc12a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:00.700672 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3e1ac-3be3-4a25-a8cc-54fa29dbc12a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:00.718891 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033641a-1e34-465e-8599-e75de0773ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:00.719678 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033641a-1e34-465e-8599-e75de0773ca6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:00.719907 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033641a-1e34-465e-8599-e75de0773ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:00.722131 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033641a-1e34-465e-8599-e75de0773ca6 admin admin] PATH_INFO: `/v3/projects/46f88de654aa4ecc84c02597a786f203/users/048fadf85fbe4e58ad1d4366d383b0d4/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:00.729908 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d033641a-1e34-465e-8599-e75de0773ca6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46f88de654aa4ecc84c02597a786f203, user_id=048fadf85fbe4e58ad1d4366d383b0d4, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:00.740511 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d033641a-1e34-465e-8599-e75de0773ca6 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:00.749059 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ae61d-9628-47d5-9b07-b24dc9b00041 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:00.751174 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-708ae61d-9628-47d5-9b07-b24dc9b00041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:00.772315 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 922/1830] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:26:00 2022] PUT /identity/v3/projects/46f88de654aa4ecc84c02597a786f203/users/048fadf85fbe4e58ad1d4366d383b0d4/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:26:00.781211 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ae61d-9628-47d5-9b07-b24dc9b00041 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:00.782998 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28780157-514e-401c-84e4-d7ddb750866f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:00.783286 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28780157-514e-401c-84e4-d7ddb750866f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:00.783564 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28780157-514e-401c-84e4-d7ddb750866f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:00.824204 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-28780157-514e-401c-84e4-d7ddb750866f None None] MFA Rules not processed for user `048fadf85fbe4e58ad1d4366d383b0d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:00.826366 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-28780157-514e-401c-84e4-d7ddb750866f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:00.928261 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 923/1831] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:26:00 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:26:00.941842 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28780157-514e-401c-84e4-d7ddb750866f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:00.944154 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-28780157-514e-401c-84e4-d7ddb750866f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:00.949166 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bebc4c-3d62-41fc-a2f5-f5437c85e148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:00.952058 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bebc4c-3d62-41fc-a2f5-f5437c85e148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:00.952570 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bebc4c-3d62-41fc-a2f5-f5437c85e148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:00.952853 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bebc4c-3d62-41fc-a2f5-f5437c85e148 admin admin] PATH_INFO: `/v3/projects/45228b637385460f9521067cfb01a509` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:00.954358 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bebc4c-3d62-41fc-a2f5-f5437c85e148 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45228b637385460f9521067cfb01a509)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:00.956750 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bebc4c-3d62-41fc-a2f5-f5437c85e148 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:01.033877 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-22bebc4c-3d62-41fc-a2f5-f5437c85e148 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45228b637385460f9521067cfb01a509', 'request_id': 'req-22bebc4c-3d62-41fc-a2f5-f5437c85e148'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:01.035271 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28780157-514e-401c-84e4-d7ddb750866f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:01.053274 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-22bebc4c-3d62-41fc-a2f5-f5437c85e148 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45228b637385460f9521067cfb01a509', 'request_id': 'req-22bebc4c-3d62-41fc-a2f5-f5437c85e148'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:01.060951 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-22bebc4c-3d62-41fc-a2f5-f5437c85e148 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45228b637385460f9521067cfb01a509', 'request_id': 'req-22bebc4c-3d62-41fc-a2f5-f5437c85e148'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:01.078551 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-22bebc4c-3d62-41fc-a2f5-f5437c85e148 admin admin] The token cache is being invalidate because project 45228b637385460f9521067cfb01a509 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:26:01.078848 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-22bebc4c-3d62-41fc-a2f5-f5437c85e148 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:01.079644 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-22bebc4c-3d62-41fc-a2f5-f5437c85e148 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:01.085291 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 909/1832] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:26:00 2022] DELETE /identity/v3/projects/45228b637385460f9521067cfb01a509 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:26:01.086422 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bebc4c-3d62-41fc-a2f5-f5437c85e148 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:01.088882 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-22bebc4c-3d62-41fc-a2f5-f5437c85e148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:01.129058 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f6967-9507-4d1c-8fbb-fd34944ea422 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:01.129924 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f6967-9507-4d1c-8fbb-fd34944ea422 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:01.130712 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f6967-9507-4d1c-8fbb-fd34944ea422 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:01.131000 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f6967-9507-4d1c-8fbb-fd34944ea422 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:01.132926 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a55f6967-9507-4d1c-8fbb-fd34944ea422 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:01.173764 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:01.190414 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bebc4c-3d62-41fc-a2f5-f5437c85e148 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:01.195494 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe9455-8173-4eb4-bf29-e3ae5625bca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:01.197029 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe9455-8173-4eb4-bf29-e3ae5625bca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:01.197029 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe9455-8173-4eb4-bf29-e3ae5625bca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:01.197029 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe9455-8173-4eb4-bf29-e3ae5625bca0 admin admin] PATH_INFO: `/v3/users/21ca09a8686743269edc4aa47f1ada13` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:01.198618 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebe9455-8173-4eb4-bf29-e3ae5625bca0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21ca09a8686743269edc4aa47f1ada13)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:01.200295 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebe9455-8173-4eb4-bf29-e3ae5625bca0 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:01.208200 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:01.234796 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f6967-9507-4d1c-8fbb-fd34944ea422 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:01.236293 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f6967-9507-4d1c-8fbb-fd34944ea422 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:01.247284 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 924/1833] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:26:00 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:26:01.364362 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5ebe9455-8173-4eb4-bf29-e3ae5625bca0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21ca09a8686743269edc4aa47f1ada13'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:01.365039 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5ebe9455-8173-4eb4-bf29-e3ae5625bca0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21ca09a8686743269edc4aa47f1ada13'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:01.374735 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5ebe9455-8173-4eb4-bf29-e3ae5625bca0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21ca09a8686743269edc4aa47f1ada13'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:01.405757 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5ebe9455-8173-4eb4-bf29-e3ae5625bca0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21ca09a8686743269edc4aa47f1ada13'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:01.406547 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5ebe9455-8173-4eb4-bf29-e3ae5625bca0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21ca09a8686743269edc4aa47f1ada13'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:01.419618 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f6967-9507-4d1c-8fbb-fd34944ea422 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:01.421590 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a55f6967-9507-4d1c-8fbb-fd34944ea422 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:01.440486 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f6967-9507-4d1c-8fbb-fd34944ea422 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:01.445217 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2754f8-3026-4a9b-9a49-03c870e46147 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:01.446724 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2754f8-3026-4a9b-9a49-03c870e46147 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:01.446947 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2754f8-3026-4a9b-9a49-03c870e46147 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:01.447230 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2754f8-3026-4a9b-9a49-03c870e46147 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:01.451194 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ea2754f8-3026-4a9b-9a49-03c870e46147 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:01.473782 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 910/1834] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:26:01 2022] DELETE /identity/v3/users/21ca09a8686743269edc4aa47f1ada13 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:26:01.605094 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2754f8-3026-4a9b-9a49-03c870e46147 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:01.606825 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2754f8-3026-4a9b-9a49-03c870e46147 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:01.616847 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 925/1835] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:26:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:26:01.976277 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe9455-8173-4eb4-bf29-e3ae5625bca0 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:01.977407 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5ebe9455-8173-4eb4-bf29-e3ae5625bca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:02.137054 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe9455-8173-4eb4-bf29-e3ae5625bca0 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:02.151585 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9761cec9-b62f-417f-8471-a66ec00bf8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:02.152258 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761cec9-b62f-417f-8471-a66ec00bf8a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:02.152544 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761cec9-b62f-417f-8471-a66ec00bf8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:02.152821 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761cec9-b62f-417f-8471-a66ec00bf8a1 admin admin] PATH_INFO: `/v3/projects/2dae1c8352cb49a5b290cece5b08a016` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:02.156864 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9761cec9-b62f-417f-8471-a66ec00bf8a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dae1c8352cb49a5b290cece5b08a016)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:02.158859 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9761cec9-b62f-417f-8471-a66ec00bf8a1 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:02.232548 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9761cec9-b62f-417f-8471-a66ec00bf8a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dae1c8352cb49a5b290cece5b08a016', 'request_id': 'req-9761cec9-b62f-417f-8471-a66ec00bf8a1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:02.249796 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9761cec9-b62f-417f-8471-a66ec00bf8a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dae1c8352cb49a5b290cece5b08a016', 'request_id': 'req-9761cec9-b62f-417f-8471-a66ec00bf8a1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:02.259848 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9761cec9-b62f-417f-8471-a66ec00bf8a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dae1c8352cb49a5b290cece5b08a016', 'request_id': 'req-9761cec9-b62f-417f-8471-a66ec00bf8a1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:02.281619 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9761cec9-b62f-417f-8471-a66ec00bf8a1 admin admin] The token cache is being invalidate because project 2dae1c8352cb49a5b290cece5b08a016 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:26:02.282096 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9761cec9-b62f-417f-8471-a66ec00bf8a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:02.282852 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9761cec9-b62f-417f-8471-a66ec00bf8a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:02.285971 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 911/1836] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:26:01 2022] DELETE /identity/v3/projects/2dae1c8352cb49a5b290cece5b08a016 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:26:02.292327 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83f1ce-8990-4197-b5fc-d6a71f408782 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:02.292840 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83f1ce-8990-4197-b5fc-d6a71f408782 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:02.293191 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83f1ce-8990-4197-b5fc-d6a71f408782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:02.315455 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-3f83f1ce-8990-4197-b5fc-d6a71f408782 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:02.317039 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3f83f1ce-8990-4197-b5fc-d6a71f408782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:02.430235 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 926/1837] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:26:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:26:02.438260 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd0ca5-8fc4-4adf-a260-1597ad4c7d2c None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:02.438616 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd0ca5-8fc4-4adf-a260-1597ad4c7d2c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:02.438994 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd0ca5-8fc4-4adf-a260-1597ad4c7d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:02.469129 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-28bd0ca5-8fc4-4adf-a260-1597ad4c7d2c None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:02.470852 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-28bd0ca5-8fc4-4adf-a260-1597ad4c7d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:02.483115 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 912/1838] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:26:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:26:02.487176 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f83f1ce-8990-4197-b5fc-d6a71f408782 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:02.498182 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f83f1ce-8990-4197-b5fc-d6a71f408782 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:02.503862 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55613fb9-7307-4c73-9811-18dd7bce43e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:02.504977 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55613fb9-7307-4c73-9811-18dd7bce43e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:02.505343 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55613fb9-7307-4c73-9811-18dd7bce43e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:02.505789 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55613fb9-7307-4c73-9811-18dd7bce43e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:02.506555 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55613fb9-7307-4c73-9811-18dd7bce43e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:26:02.507190 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55613fb9-7307-4c73-9811-18dd7bce43e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:02.509206 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55613fb9-7307-4c73-9811-18dd7bce43e2 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:02.522770 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 927/1839] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:26:02.530149 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd0ca5-8fc4-4adf-a260-1597ad4c7d2c None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:02.539695 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd0ca5-8fc4-4adf-a260-1597ad4c7d2c None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:02.546317 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded03a0-0372-4a15-9259-12c167009c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:02.547535 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded03a0-0372-4a15-9259-12c167009c19 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:02.547922 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded03a0-0372-4a15-9259-12c167009c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:02.548250 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded03a0-0372-4a15-9259-12c167009c19 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:02.550849 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded03a0-0372-4a15-9259-12c167009c19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:02.553584 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded03a0-0372-4a15-9259-12c167009c19 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:02.564031 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:02.612657 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 913/1840] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:26:02 2022] POST /identity/v3/projects => generated 371 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:26:02.616737 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55613fb9-7307-4c73-9811-18dd7bce43e2 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:02.627037 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55613fb9-7307-4c73-9811-18dd7bce43e2 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:02.671599 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:02.689550 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d15eda-86d9-432e-938b-fb5d6d1f1ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:02.690175 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d15eda-86d9-432e-938b-fb5d6d1f1ad4 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:02.690450 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d15eda-86d9-432e-938b-fb5d6d1f1ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:02.690720 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d15eda-86d9-432e-938b-fb5d6d1f1ad4 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:02.691355 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d15eda-86d9-432e-938b-fb5d6d1f1ad4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:02.694984 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d15eda-86d9-432e-938b-fb5d6d1f1ad4 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:02.735163 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 928/1841] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:26:02 2022] POST /identity/v3/users => generated 286 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:26:02.741064 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded03a0-0372-4a15-9259-12c167009c19 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:02.751977 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded03a0-0372-4a15-9259-12c167009c19 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:02.756943 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4ee34e-9884-413b-9e12-29eef4ea8a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:02.757628 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ee34e-9884-413b-9e12-29eef4ea8a35 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:02.757970 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ee34e-9884-413b-9e12-29eef4ea8a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:02.758601 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ee34e-9884-413b-9e12-29eef4ea8a35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:02.759505 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4ee34e-9884-413b-9e12-29eef4ea8a35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:02.761422 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4ee34e-9884-413b-9e12-29eef4ea8a35 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:02.783257 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d15eda-86d9-432e-938b-fb5d6d1f1ad4 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:02.794421 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 914/1842] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 13:26:02.794769 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d15eda-86d9-432e-938b-fb5d6d1f1ad4 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:02.800636 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646d42d-f0bf-4c60-a7ca-a642b457b823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:02.801275 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646d42d-f0bf-4c60-a7ca-a642b457b823 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:02.801585 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646d42d-f0bf-4c60-a7ca-a642b457b823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:02.802304 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646d42d-f0bf-4c60-a7ca-a642b457b823 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:02.802975 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0646d42d-f0bf-4c60-a7ca-a642b457b823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:02.805462 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0646d42d-f0bf-4c60-a7ca-a642b457b823 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:02.860307 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 929/1843] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:26:02.865070 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4ee34e-9884-413b-9e12-29eef4ea8a35 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:02.878251 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4ee34e-9884-413b-9e12-29eef4ea8a35 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:02.907093 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059647f2-23fe-4fe5-918b-92fea027be47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:02.908229 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059647f2-23fe-4fe5-918b-92fea027be47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:02.908819 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059647f2-23fe-4fe5-918b-92fea027be47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:02.910873 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059647f2-23fe-4fe5-918b-92fea027be47 admin admin] PATH_INFO: `/v3/projects/a5b859c561174c568a09ed135661c2f7/users/c85bf6fba2d64e0ea079e84430ca5f42/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:02.952249 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059647f2-23fe-4fe5-918b-92fea027be47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5b859c561174c568a09ed135661c2f7, user_id=c85bf6fba2d64e0ea079e84430ca5f42, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:02.956973 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059647f2-23fe-4fe5-918b-92fea027be47 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:02.994930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 915/1844] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:26:02 2022] PUT /identity/v3/projects/a5b859c561174c568a09ed135661c2f7/users/c85bf6fba2d64e0ea079e84430ca5f42/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:26:02.997936 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42160b1-5e20-46af-9807-5cd5978acb61 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:02.998222 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42160b1-5e20-46af-9807-5cd5978acb61 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:02.998501 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42160b1-5e20-46af-9807-5cd5978acb61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:03.045644 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e42160b1-5e20-46af-9807-5cd5978acb61 None None] MFA Rules not processed for user `c85bf6fba2d64e0ea079e84430ca5f42`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:03.047371 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e42160b1-5e20-46af-9807-5cd5978acb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:03.142132 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 930/1845] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:26:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:26:03.142936 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059647f2-23fe-4fe5-918b-92fea027be47 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:03.254324 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059647f2-23fe-4fe5-918b-92fea027be47 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:03.261012 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9b703-1a26-4328-9af2-6f48c7dbe58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:03.262050 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9b703-1a26-4328-9af2-6f48c7dbe58f admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:03.262492 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9b703-1a26-4328-9af2-6f48c7dbe58f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:03.262980 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9b703-1a26-4328-9af2-6f48c7dbe58f admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:03.263865 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac9b703-1a26-4328-9af2-6f48c7dbe58f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:03.266507 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac9b703-1a26-4328-9af2-6f48c7dbe58f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:03.319412 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 916/1846] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:26:03 2022] POST /identity/v3/projects => generated 373 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:26:03.324481 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42160b1-5e20-46af-9807-5cd5978acb61 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:03.351201 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42160b1-5e20-46af-9807-5cd5978acb61 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:03.495496 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e38f704-43dd-4868-8b63-dc07e3254b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:03.496128 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38f704-43dd-4868-8b63-dc07e3254b4e admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:03.496407 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38f704-43dd-4868-8b63-dc07e3254b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:03.496677 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38f704-43dd-4868-8b63-dc07e3254b4e admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:03.497324 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e38f704-43dd-4868-8b63-dc07e3254b4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:03.499292 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e38f704-43dd-4868-8b63-dc07e3254b4e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:03.560532 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 931/1847] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:26:03 2022] POST /identity/v3/users => generated 293 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:26:03.564068 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9b703-1a26-4328-9af2-6f48c7dbe58f admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:03.594341 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9b703-1a26-4328-9af2-6f48c7dbe58f admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:03.626658 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fcd1c0-3be5-47fd-b17c-56f653bf2fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:03.627316 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fcd1c0-3be5-47fd-b17c-56f653bf2fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:03.627602 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fcd1c0-3be5-47fd-b17c-56f653bf2fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:03.636278 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fcd1c0-3be5-47fd-b17c-56f653bf2fe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:03.636915 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fcd1c0-3be5-47fd-b17c-56f653bf2fe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:03.638601 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fcd1c0-3be5-47fd-b17c-56f653bf2fe4 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:03.666496 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 917/1848] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:26:03.670819 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e38f704-43dd-4868-8b63-dc07e3254b4e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:03.697421 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e38f704-43dd-4868-8b63-dc07e3254b4e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:03.714874 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68342a-a73c-428c-aac4-821b665a786e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:03.715727 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68342a-a73c-428c-aac4-821b665a786e admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:03.716105 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68342a-a73c-428c-aac4-821b665a786e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:03.716608 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68342a-a73c-428c-aac4-821b665a786e admin admin] PATH_INFO: `/v3/projects/94b22343188946a68301aa2bd835b9c7/users/40da3246b22b48dd8d3b3bcbe0a587f8/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:03.748660 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc68342a-a73c-428c-aac4-821b665a786e admin admin] RBAC: Authorizing `identity:create_grant(project_id=94b22343188946a68301aa2bd835b9c7, user_id=40da3246b22b48dd8d3b3bcbe0a587f8, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:03.752034 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc68342a-a73c-428c-aac4-821b665a786e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:03.785790 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 932/1849] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:26:03 2022] PUT /identity/v3/projects/94b22343188946a68301aa2bd835b9c7/users/40da3246b22b48dd8d3b3bcbe0a587f8/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:26:03.787477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fcd1c0-3be5-47fd-b17c-56f653bf2fe4 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:03.813063 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fcd1c0-3be5-47fd-b17c-56f653bf2fe4 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:03.934003 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c5a65-e1d7-411c-98c9-64e762d3106a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:03.934765 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c5a65-e1d7-411c-98c9-64e762d3106a admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:03.935054 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c5a65-e1d7-411c-98c9-64e762d3106a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:03.935637 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c5a65-e1d7-411c-98c9-64e762d3106a admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:03.939820 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c5a65-e1d7-411c-98c9-64e762d3106a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:03.939820 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c5a65-e1d7-411c-98c9-64e762d3106a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:03.975368 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 918/1850] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:26:03.978145 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68342a-a73c-428c-aac4-821b665a786e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:03.993593 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68342a-a73c-428c-aac4-821b665a786e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:04.002958 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97024b0b-691c-4627-82d8-9490e1bce879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:04.003868 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97024b0b-691c-4627-82d8-9490e1bce879 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:04.004335 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97024b0b-691c-4627-82d8-9490e1bce879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:04.004853 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97024b0b-691c-4627-82d8-9490e1bce879 admin admin] PATH_INFO: `/v3/projects/94b22343188946a68301aa2bd835b9c7/users/40da3246b22b48dd8d3b3bcbe0a587f8/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:04.007392 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97024b0b-691c-4627-82d8-9490e1bce879 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94b22343188946a68301aa2bd835b9c7, user_id=40da3246b22b48dd8d3b3bcbe0a587f8, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:04.010663 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97024b0b-691c-4627-82d8-9490e1bce879 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:04.026365 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 933/1851] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:26:03 2022] PUT /identity/v3/projects/94b22343188946a68301aa2bd835b9c7/users/40da3246b22b48dd8d3b3bcbe0a587f8/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:26:04.044577 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e5805-9f6f-47de-8f00-2df1eb788485 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:04.044953 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e5805-9f6f-47de-8f00-2df1eb788485 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:04.045225 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e5805-9f6f-47de-8f00-2df1eb788485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:04.109627 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-606e5805-9f6f-47de-8f00-2df1eb788485 None None] MFA Rules not processed for user `40da3246b22b48dd8d3b3bcbe0a587f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:04.111785 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-606e5805-9f6f-47de-8f00-2df1eb788485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:04.164272 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:04.306852 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 919/1852] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:26:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:26:04.324305 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97024b0b-691c-4627-82d8-9490e1bce879 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:04.327568 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-97024b0b-691c-4627-82d8-9490e1bce879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:04.334919 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:04.429893 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97024b0b-691c-4627-82d8-9490e1bce879 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:04.435933 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029b97f-dd21-4523-a4c5-41bc4704310a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:04.436670 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029b97f-dd21-4523-a4c5-41bc4704310a service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:04.437073 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029b97f-dd21-4523-a4c5-41bc4704310a service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:04.439799 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029b97f-dd21-4523-a4c5-41bc4704310a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:04.548914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029b97f-dd21-4523-a4c5-41bc4704310a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:04.550668 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029b97f-dd21-4523-a4c5-41bc4704310a service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:04.578916 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 934/1853] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:26:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:26:06.018259 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd86ff7-976b-42db-a4eb-0d122315a1e1 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:06.018811 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd86ff7-976b-42db-a4eb-0d122315a1e1 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:06.018921 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd86ff7-976b-42db-a4eb-0d122315a1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:06.085941 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-4bd86ff7-976b-42db-a4eb-0d122315a1e1 None None] MFA Rules not processed for user `0534584e51cd4cbf9309ba101cc88b27`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:06.087800 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-4bd86ff7-976b-42db-a4eb-0d122315a1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:06.169920 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 920/1854] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:26:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:26:06.174245 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029b97f-dd21-4523-a4c5-41bc4704310a service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:06.175921 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e029b97f-dd21-4523-a4c5-41bc4704310a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:06.269237 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029b97f-dd21-4523-a4c5-41bc4704310a service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:06.284112 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf111e-b791-4dda-addf-e2a5a3801ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:06.285023 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf111e-b791-4dda-addf-e2a5a3801ee7 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:06.285370 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf111e-b791-4dda-addf-e2a5a3801ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:06.285743 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf111e-b791-4dda-addf-e2a5a3801ee7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:06.286668 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf111e-b791-4dda-addf-e2a5a3801ee7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:06.289073 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf111e-b791-4dda-addf-e2a5a3801ee7 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:06.351353 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 935/1855] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:26:06 2022] POST /identity/v3/projects => generated 371 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:26:06.355209 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd86ff7-976b-42db-a4eb-0d122315a1e1 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:06.371178 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd86ff7-976b-42db-a4eb-0d122315a1e1 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:06.517353 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683de0c-c05d-46ee-aab5-2cadff45e3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:06.518243 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683de0c-c05d-46ee-aab5-2cadff45e3c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:06.518373 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683de0c-c05d-46ee-aab5-2cadff45e3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:06.518802 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683de0c-c05d-46ee-aab5-2cadff45e3c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:06.519468 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d683de0c-c05d-46ee-aab5-2cadff45e3c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:06.522096 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d683de0c-c05d-46ee-aab5-2cadff45e3c9 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:06.551196 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 921/1856] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:26:06 2022] POST /identity/v3/users => generated 292 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:26:06.556818 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf111e-b791-4dda-addf-e2a5a3801ee7 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:06.582290 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf111e-b791-4dda-addf-e2a5a3801ee7 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:06.603850 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01a9a4-5df2-4ed7-a2b1-38058a09aa78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:06.606211 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01a9a4-5df2-4ed7-a2b1-38058a09aa78 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:06.606564 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01a9a4-5df2-4ed7-a2b1-38058a09aa78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:06.606843 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01a9a4-5df2-4ed7-a2b1-38058a09aa78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:06.607956 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f01a9a4-5df2-4ed7-a2b1-38058a09aa78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:06.610955 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f01a9a4-5df2-4ed7-a2b1-38058a09aa78 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:06.667473 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 936/1857] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 13:26:06.668947 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683de0c-c05d-46ee-aab5-2cadff45e3c9 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:06.679767 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683de0c-c05d-46ee-aab5-2cadff45e3c9 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:06.700297 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121cba9d-c5ba-4167-9b03-b1c7af554df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:06.701005 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121cba9d-c5ba-4167-9b03-b1c7af554df7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:06.701285 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121cba9d-c5ba-4167-9b03-b1c7af554df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:06.701574 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121cba9d-c5ba-4167-9b03-b1c7af554df7 admin admin] PATH_INFO: `/v3/projects/8120cc98ca5a46e2a9680e30f734e07f/users/de0c3c9db41e4de89de792d3bd38ac74/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:06.736484 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121cba9d-c5ba-4167-9b03-b1c7af554df7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8120cc98ca5a46e2a9680e30f734e07f, user_id=de0c3c9db41e4de89de792d3bd38ac74, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:06.740672 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121cba9d-c5ba-4167-9b03-b1c7af554df7 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:06.767720 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01a9a4-5df2-4ed7-a2b1-38058a09aa78 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:06.768365 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 922/1858] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:26:06 2022] PUT /identity/v3/projects/8120cc98ca5a46e2a9680e30f734e07f/users/de0c3c9db41e4de89de792d3bd38ac74/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:26:06.779822 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01a9a4-5df2-4ed7-a2b1-38058a09aa78 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:06.841777 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:06.883468 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f24a14-9ac3-4b85-8340-0c3f06585951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:06.884198 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f24a14-9ac3-4b85-8340-0c3f06585951 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:06.884721 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f24a14-9ac3-4b85-8340-0c3f06585951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:06.885190 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f24a14-9ac3-4b85-8340-0c3f06585951 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:06.885959 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f24a14-9ac3-4b85-8340-0c3f06585951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:06.895863 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f24a14-9ac3-4b85-8340-0c3f06585951 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:06.907873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 937/1859] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:26:06.912003 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121cba9d-c5ba-4167-9b03-b1c7af554df7 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:06.919678 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:06.927454 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121cba9d-c5ba-4167-9b03-b1c7af554df7 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:06.942172 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e250b8-a48d-46ad-bd63-3882535a51f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:06.942850 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e250b8-a48d-46ad-bd63-3882535a51f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:06.943118 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e250b8-a48d-46ad-bd63-3882535a51f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:06.943390 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e250b8-a48d-46ad-bd63-3882535a51f6 admin admin] PATH_INFO: `/v3/projects/8120cc98ca5a46e2a9680e30f734e07f/users/de0c3c9db41e4de89de792d3bd38ac74/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:06.945422 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e250b8-a48d-46ad-bd63-3882535a51f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8120cc98ca5a46e2a9680e30f734e07f, user_id=de0c3c9db41e4de89de792d3bd38ac74, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:06.948139 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e250b8-a48d-46ad-bd63-3882535a51f6 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:06.959847 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 923/1860] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:26:06 2022] PUT /identity/v3/projects/8120cc98ca5a46e2a9680e30f734e07f/users/de0c3c9db41e4de89de792d3bd38ac74/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:26:07.740291 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f24a14-9ac3-4b85-8340-0c3f06585951 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:07.747727 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f24a14-9ac3-4b85-8340-0c3f06585951 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:07.856702 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef61b66-4766-4f15-99da-86bf024008fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:07.857431 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef61b66-4766-4f15-99da-86bf024008fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:07.863560 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef61b66-4766-4f15-99da-86bf024008fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:07.863560 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef61b66-4766-4f15-99da-86bf024008fe admin admin] PATH_INFO: `/v3/users/c85bf6fba2d64e0ea079e84430ca5f42` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:07.863560 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef61b66-4766-4f15-99da-86bf024008fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=c85bf6fba2d64e0ea079e84430ca5f42)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:07.863560 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef61b66-4766-4f15-99da-86bf024008fe admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:07.925808 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bef61b66-4766-4f15-99da-86bf024008fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c85bf6fba2d64e0ea079e84430ca5f42'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:07.926505 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bef61b66-4766-4f15-99da-86bf024008fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c85bf6fba2d64e0ea079e84430ca5f42'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:07.935760 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bef61b66-4766-4f15-99da-86bf024008fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c85bf6fba2d64e0ea079e84430ca5f42'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:07.957597 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bef61b66-4766-4f15-99da-86bf024008fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c85bf6fba2d64e0ea079e84430ca5f42'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:07.958355 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bef61b66-4766-4f15-99da-86bf024008fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c85bf6fba2d64e0ea079e84430ca5f42'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:07.977736 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 938/1861] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:26:07 2022] DELETE /identity/v3/users/c85bf6fba2d64e0ea079e84430ca5f42 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:26:07.982235 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa50469-1839-4050-b3ee-50e88c3ddcb7 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:07.982734 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa50469-1839-4050-b3ee-50e88c3ddcb7 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:07.982832 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa50469-1839-4050-b3ee-50e88c3ddcb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:08.007772 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-2fa50469-1839-4050-b3ee-50e88c3ddcb7 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:08.010119 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2fa50469-1839-4050-b3ee-50e88c3ddcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:08.099044 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 924/1862] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:26:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:26:08.108024 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef61b66-4766-4f15-99da-86bf024008fe admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:08.109810 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-bef61b66-4766-4f15-99da-86bf024008fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:08.192500 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:08.203683 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef61b66-4766-4f15-99da-86bf024008fe admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:08.216338 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb724d-4a0e-49b5-adfc-8d27b315eeeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:08.217251 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb724d-4a0e-49b5-adfc-8d27b315eeeb service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:08.217653 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb724d-4a0e-49b5-adfc-8d27b315eeeb service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:08.218159 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb724d-4a0e-49b5-adfc-8d27b315eeeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:08.233677 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb724d-4a0e-49b5-adfc-8d27b315eeeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:08.235307 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb724d-4a0e-49b5-adfc-8d27b315eeeb service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:08.263028 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 939/1863] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:26:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:26:08.746570 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa50469-1839-4050-b3ee-50e88c3ddcb7 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:08.748448 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2fa50469-1839-4050-b3ee-50e88c3ddcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:08.762289 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa50469-1839-4050-b3ee-50e88c3ddcb7 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:08.769353 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55cafd3-e849-4bdb-9512-a7c4df29f71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:08.770476 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cafd3-e849-4bdb-9512-a7c4df29f71f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:08.770926 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cafd3-e849-4bdb-9512-a7c4df29f71f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:08.771351 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cafd3-e849-4bdb-9512-a7c4df29f71f admin admin] PATH_INFO: `/v3/projects/a5b859c561174c568a09ed135661c2f7` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:08.773477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55cafd3-e849-4bdb-9512-a7c4df29f71f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5b859c561174c568a09ed135661c2f7)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:08.777083 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55cafd3-e849-4bdb-9512-a7c4df29f71f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:08.948506 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d55cafd3-e849-4bdb-9512-a7c4df29f71f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5b859c561174c568a09ed135661c2f7', 'request_id': 'req-d55cafd3-e849-4bdb-9512-a7c4df29f71f'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:08.958835 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d55cafd3-e849-4bdb-9512-a7c4df29f71f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5b859c561174c568a09ed135661c2f7', 'request_id': 'req-d55cafd3-e849-4bdb-9512-a7c4df29f71f'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:08.972615 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d55cafd3-e849-4bdb-9512-a7c4df29f71f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5b859c561174c568a09ed135661c2f7', 'request_id': 'req-d55cafd3-e849-4bdb-9512-a7c4df29f71f'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:09.023598 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d55cafd3-e849-4bdb-9512-a7c4df29f71f admin admin] The token cache is being invalidate because project a5b859c561174c568a09ed135661c2f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:26:09.024332 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d55cafd3-e849-4bdb-9512-a7c4df29f71f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:09.026471 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d55cafd3-e849-4bdb-9512-a7c4df29f71f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:09.030218 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 925/1864] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:26:08 2022] DELETE /identity/v3/projects/a5b859c561174c568a09ed135661c2f7 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:26:09.035247 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb724d-4a0e-49b5-adfc-8d27b315eeeb service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:09.055336 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb724d-4a0e-49b5-adfc-8d27b315eeeb service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:09.236339 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c7079-4aef-433a-9fb5-a5d69df43246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:09.238878 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c7079-4aef-433a-9fb5-a5d69df43246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:09.239509 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c7079-4aef-433a-9fb5-a5d69df43246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:09.239965 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c7079-4aef-433a-9fb5-a5d69df43246 admin admin] PATH_INFO: `/v3/users/40da3246b22b48dd8d3b3bcbe0a587f8` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:09.247498 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c7079-4aef-433a-9fb5-a5d69df43246 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40da3246b22b48dd8d3b3bcbe0a587f8)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:09.250037 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c7079-4aef-433a-9fb5-a5d69df43246 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:09.380229 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ca2c7079-4aef-433a-9fb5-a5d69df43246 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40da3246b22b48dd8d3b3bcbe0a587f8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:09.381956 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ca2c7079-4aef-433a-9fb5-a5d69df43246 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40da3246b22b48dd8d3b3bcbe0a587f8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:09.408681 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ca2c7079-4aef-433a-9fb5-a5d69df43246 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40da3246b22b48dd8d3b3bcbe0a587f8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:09.453063 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ca2c7079-4aef-433a-9fb5-a5d69df43246 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40da3246b22b48dd8d3b3bcbe0a587f8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:09.455776 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ca2c7079-4aef-433a-9fb5-a5d69df43246 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40da3246b22b48dd8d3b3bcbe0a587f8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:09.490123 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 940/1865] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:26:09 2022] DELETE /identity/v3/users/40da3246b22b48dd8d3b3bcbe0a587f8 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:26:10.101207 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55cafd3-e849-4bdb-9512-a7c4df29f71f admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:10.102868 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d55cafd3-e849-4bdb-9512-a7c4df29f71f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:10.126446 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55cafd3-e849-4bdb-9512-a7c4df29f71f admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:10.267168 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c7079-4aef-433a-9fb5-a5d69df43246 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:10.286270 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ca2c7079-4aef-433a-9fb5-a5d69df43246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:10.296786 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376e802-7ee1-4b15-9e53-81622a90a010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:10.297642 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376e802-7ee1-4b15-9e53-81622a90a010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:10.297979 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376e802-7ee1-4b15-9e53-81622a90a010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:10.298311 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376e802-7ee1-4b15-9e53-81622a90a010 admin admin] PATH_INFO: `/v3/projects/94b22343188946a68301aa2bd835b9c7` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:10.305115 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5376e802-7ee1-4b15-9e53-81622a90a010 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94b22343188946a68301aa2bd835b9c7)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:10.307953 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5376e802-7ee1-4b15-9e53-81622a90a010 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:10.309321 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c7079-4aef-433a-9fb5-a5d69df43246 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:10.322750 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c8966-2bb9-4c97-a0bb-cec2e68e3fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:10.323531 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c8966-2bb9-4c97-a0bb-cec2e68e3fd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:10.323907 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c8966-2bb9-4c97-a0bb-cec2e68e3fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:10.324424 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c8966-2bb9-4c97-a0bb-cec2e68e3fd8 admin admin] PATH_INFO: `/v3/users/398ce93f4bf24b2ea1d86fc5405fbe0a` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:10.325798 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c8966-2bb9-4c97-a0bb-cec2e68e3fd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=398ce93f4bf24b2ea1d86fc5405fbe0a)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:10.328433 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c8966-2bb9-4c97-a0bb-cec2e68e3fd8 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:10.367339 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:10.473841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5376e802-7ee1-4b15-9e53-81622a90a010 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94b22343188946a68301aa2bd835b9c7', 'request_id': 'req-5376e802-7ee1-4b15-9e53-81622a90a010'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:10.476532 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-722c8966-2bb9-4c97-a0bb-cec2e68e3fd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '398ce93f4bf24b2ea1d86fc5405fbe0a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:10.482338 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-722c8966-2bb9-4c97-a0bb-cec2e68e3fd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '398ce93f4bf24b2ea1d86fc5405fbe0a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:10.492344 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5376e802-7ee1-4b15-9e53-81622a90a010 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94b22343188946a68301aa2bd835b9c7', 'request_id': 'req-5376e802-7ee1-4b15-9e53-81622a90a010'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:10.498111 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-722c8966-2bb9-4c97-a0bb-cec2e68e3fd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '398ce93f4bf24b2ea1d86fc5405fbe0a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:10.508145 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5376e802-7ee1-4b15-9e53-81622a90a010 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94b22343188946a68301aa2bd835b9c7', 'request_id': 'req-5376e802-7ee1-4b15-9e53-81622a90a010'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:10.520431 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:10.537388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-722c8966-2bb9-4c97-a0bb-cec2e68e3fd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '398ce93f4bf24b2ea1d86fc5405fbe0a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:10.540083 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-722c8966-2bb9-4c97-a0bb-cec2e68e3fd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '398ce93f4bf24b2ea1d86fc5405fbe0a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:10.559376 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5376e802-7ee1-4b15-9e53-81622a90a010 admin admin] The token cache is being invalidate because project 94b22343188946a68301aa2bd835b9c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:26:10.560037 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5376e802-7ee1-4b15-9e53-81622a90a010 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:10.563316 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5376e802-7ee1-4b15-9e53-81622a90a010 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:10.567091 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 941/1866] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:26:10 2022] DELETE /identity/v3/users/398ce93f4bf24b2ea1d86fc5405fbe0a => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:26:10.577024 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee48c9-255a-4015-a4ee-a0172e44e046 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:10.577348 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee48c9-255a-4015-a4ee-a0172e44e046 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:10.581426 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 926/1867] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:26:10 2022] DELETE /identity/v3/projects/94b22343188946a68301aa2bd835b9c7 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:26:10.583098 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75518c4f-6557-4f4e-b087-903c708c7f33 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:10.583519 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee48c9-255a-4015-a4ee-a0172e44e046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:10.585582 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75518c4f-6557-4f4e-b087-903c708c7f33 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:10.586220 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75518c4f-6557-4f4e-b087-903c708c7f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:10.625226 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-b0ee48c9-255a-4015-a4ee-a0172e44e046 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:10.627085 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b0ee48c9-255a-4015-a4ee-a0172e44e046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:10.641732 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-75518c4f-6557-4f4e-b087-903c708c7f33 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:10.644099 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-75518c4f-6557-4f4e-b087-903c708c7f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:10.828843 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 927/1868] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:26:10.837270 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91b022-f663-42e5-94fa-ab98133cd0a4 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:10.837644 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91b022-f663-42e5-94fa-ab98133cd0a4 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:10.838507 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91b022-f663-42e5-94fa-ab98133cd0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:10.849185 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 942/1869] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:26:10.865400 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee48c9-255a-4015-a4ee-a0172e44e046 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:10.869526 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b0ee48c9-255a-4015-a4ee-a0172e44e046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:10.890055 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-4a91b022-f663-42e5-94fa-ab98133cd0a4 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:10.895632 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-4a91b022-f663-42e5-94fa-ab98133cd0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:10.921122 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 928/1870] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:26:10.925135 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91b022-f663-42e5-94fa-ab98133cd0a4 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:10.943722 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91b022-f663-42e5-94fa-ab98133cd0a4 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:10.962027 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391cd16a-c916-42a4-87e7-f9d98aced4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:10.962706 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391cd16a-c916-42a4-87e7-f9d98aced4dd admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:10.962991 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391cd16a-c916-42a4-87e7-f9d98aced4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:10.963268 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391cd16a-c916-42a4-87e7-f9d98aced4dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:10.975143 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391cd16a-c916-42a4-87e7-f9d98aced4dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:26:10.975526 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391cd16a-c916-42a4-87e7-f9d98aced4dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:10.980377 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391cd16a-c916-42a4-87e7-f9d98aced4dd admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:11.026102 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 929/1871] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:26:11.030757 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391cd16a-c916-42a4-87e7-f9d98aced4dd admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:11.043831 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee48c9-255a-4015-a4ee-a0172e44e046 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:11.060108 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090d29c-f6d7-41f4-a120-384448aa7df4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:11.061078 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090d29c-f6d7-41f4-a120-384448aa7df4 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:11.061428 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090d29c-f6d7-41f4-a120-384448aa7df4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:11.061669 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391cd16a-c916-42a4-87e7-f9d98aced4dd admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:11.062092 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090d29c-f6d7-41f4-a120-384448aa7df4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:11.081795 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab73e9-e594-45c4-b904-d36681477705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:11.081795 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab73e9-e594-45c4-b904-d36681477705 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:11.081795 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab73e9-e594-45c4-b904-d36681477705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:11.081795 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab73e9-e594-45c4-b904-d36681477705 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:11.082212 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab73e9-e594-45c4-b904-d36681477705 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:11.086268 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab73e9-e594-45c4-b904-d36681477705 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:11.113350 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090d29c-f6d7-41f4-a120-384448aa7df4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:11.115709 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090d29c-f6d7-41f4-a120-384448aa7df4 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:11.143229 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 943/1872] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:26:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:26:11.176755 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 930/1873] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:26:11 2022] POST /identity/v3/projects => generated 377 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:26:11.178832 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090d29c-f6d7-41f4-a120-384448aa7df4 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:11.195789 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090d29c-f6d7-41f4-a120-384448aa7df4 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:11.339312 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f079c-a92b-41b3-99e2-14de13448f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:11.339991 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f079c-a92b-41b3-99e2-14de13448f2f admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:11.340424 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f079c-a92b-41b3-99e2-14de13448f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:11.340792 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f079c-a92b-41b3-99e2-14de13448f2f admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:11.341503 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f079c-a92b-41b3-99e2-14de13448f2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:11.343739 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f079c-a92b-41b3-99e2-14de13448f2f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:11.377236 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 944/1874] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:26:11 2022] POST /identity/v3/users => generated 289 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:26:11.378912 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab73e9-e594-45c4-b904-d36681477705 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:11.401779 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab73e9-e594-45c4-b904-d36681477705 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:11.407372 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc80d2-4ac3-4209-9e09-5de5c389c58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:11.408002 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc80d2-4ac3-4209-9e09-5de5c389c58b admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:11.408282 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc80d2-4ac3-4209-9e09-5de5c389c58b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:11.408560 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc80d2-4ac3-4209-9e09-5de5c389c58b admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:11.409371 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc80d2-4ac3-4209-9e09-5de5c389c58b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:11.411069 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc80d2-4ac3-4209-9e09-5de5c389c58b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:11.426644 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 931/1875] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:26:11.432107 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f079c-a92b-41b3-99e2-14de13448f2f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:11.453178 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f079c-a92b-41b3-99e2-14de13448f2f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:11.460873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1abca43-74e3-40f9-b597-2c308b351a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:11.461674 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abca43-74e3-40f9-b597-2c308b351a44 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:11.461971 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abca43-74e3-40f9-b597-2c308b351a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:11.462964 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abca43-74e3-40f9-b597-2c308b351a44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:11.463773 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1abca43-74e3-40f9-b597-2c308b351a44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:11.465400 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1abca43-74e3-40f9-b597-2c308b351a44 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:11.487113 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc80d2-4ac3-4209-9e09-5de5c389c58b admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:11.487354 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 945/1876] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 13:26:11.504817 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc80d2-4ac3-4209-9e09-5de5c389c58b admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:11.515916 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a1daa-3173-4eb9-9401-c75b575c3e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:11.517188 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a1daa-3173-4eb9-9401-c75b575c3e7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:11.517765 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a1daa-3173-4eb9-9401-c75b575c3e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:11.518250 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a1daa-3173-4eb9-9401-c75b575c3e7f admin admin] PATH_INFO: `/v3/projects/91e6d132f4e947848603ff9744836263/users/7b95baedc82145a1a3945076a584523d/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:11.569326 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50a1daa-3173-4eb9-9401-c75b575c3e7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=91e6d132f4e947848603ff9744836263, user_id=7b95baedc82145a1a3945076a584523d, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:11.572532 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50a1daa-3173-4eb9-9401-c75b575c3e7f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:11.604247 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 932/1877] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:26:11 2022] PUT /identity/v3/projects/91e6d132f4e947848603ff9744836263/users/7b95baedc82145a1a3945076a584523d/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:26:11.615953 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8bf4e-6144-45c8-8a0c-2ddbed53f29e None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:11.616294 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8bf4e-6144-45c8-8a0c-2ddbed53f29e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:11.616665 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8bf4e-6144-45c8-8a0c-2ddbed53f29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:11.629428 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:11.700911 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-cbd8bf4e-6144-45c8-8a0c-2ddbed53f29e None None] MFA Rules not processed for user `7b95baedc82145a1a3945076a584523d`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:11.702304 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cbd8bf4e-6144-45c8-8a0c-2ddbed53f29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:11.859568 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 946/1878] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:26:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:26:11.872506 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a1daa-3173-4eb9-9401-c75b575c3e7f admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:11.875188 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b50a1daa-3173-4eb9-9401-c75b575c3e7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:11.916289 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:11.968860 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8bf4e-6144-45c8-8a0c-2ddbed53f29e None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:11.970978 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cbd8bf4e-6144-45c8-8a0c-2ddbed53f29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:12.033231 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a1daa-3173-4eb9-9401-c75b575c3e7f admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:12.047689 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b364a9-1d15-4ddb-a10a-a638f0f06ba4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:12.048409 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b364a9-1d15-4ddb-a10a-a638f0f06ba4 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:12.048605 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b364a9-1d15-4ddb-a10a-a638f0f06ba4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:12.048884 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b364a9-1d15-4ddb-a10a-a638f0f06ba4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:12.067203 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b364a9-1d15-4ddb-a10a-a638f0f06ba4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:12.068604 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b364a9-1d15-4ddb-a10a-a638f0f06ba4 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:12.088250 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 933/1879] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:26:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:26:12.182991 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8bf4e-6144-45c8-8a0c-2ddbed53f29e None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:12.189474 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e912fd7-73d6-455b-9781-3525c936eb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:12.190378 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e912fd7-73d6-455b-9781-3525c936eb54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:12.190899 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e912fd7-73d6-455b-9781-3525c936eb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:12.191257 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e912fd7-73d6-455b-9781-3525c936eb54 admin admin] PATH_INFO: `/v3/projects/20fc3b9c6d2249469814c038b64b2663` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:12.193140 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e912fd7-73d6-455b-9781-3525c936eb54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20fc3b9c6d2249469814c038b64b2663)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:12.195601 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e912fd7-73d6-455b-9781-3525c936eb54 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:12.373797 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-8e912fd7-73d6-455b-9781-3525c936eb54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20fc3b9c6d2249469814c038b64b2663', 'request_id': 'req-8e912fd7-73d6-455b-9781-3525c936eb54'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:12.390080 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-8e912fd7-73d6-455b-9781-3525c936eb54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20fc3b9c6d2249469814c038b64b2663', 'request_id': 'req-8e912fd7-73d6-455b-9781-3525c936eb54'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:12.427867 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-8e912fd7-73d6-455b-9781-3525c936eb54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20fc3b9c6d2249469814c038b64b2663', 'request_id': 'req-8e912fd7-73d6-455b-9781-3525c936eb54'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:12.477209 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-8e912fd7-73d6-455b-9781-3525c936eb54 admin admin] The token cache is being invalidate because project 20fc3b9c6d2249469814c038b64b2663 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:26:12.477604 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-8e912fd7-73d6-455b-9781-3525c936eb54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:12.480594 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-8e912fd7-73d6-455b-9781-3525c936eb54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:12.486567 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 947/1880] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:26:11 2022] DELETE /identity/v3/projects/20fc3b9c6d2249469814c038b64b2663 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:26:14.137856 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d88c2a-f815-4b75-91fb-ac235c794d97 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:14.138394 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d88c2a-f815-4b75-91fb-ac235c794d97 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:14.138712 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d88c2a-f815-4b75-91fb-ac235c794d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:14.189595 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-29d88c2a-f815-4b75-91fb-ac235c794d97 None None] MFA Rules not processed for user `de0c3c9db41e4de89de792d3bd38ac74`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:14.192200 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-29d88c2a-f815-4b75-91fb-ac235c794d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:14.352438 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 934/1881] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:26:14 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:26:14.368795 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e912fd7-73d6-455b-9781-3525c936eb54 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:14.371611 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8e912fd7-73d6-455b-9781-3525c936eb54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:14.410197 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:14.481158 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e912fd7-73d6-455b-9781-3525c936eb54 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:14.489848 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e40c7-8584-4277-98e3-2095b54f1534 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719e4bf834d6490b96066e55a26fb159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:14.490582 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e40c7-8584-4277-98e3-2095b54f1534 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:14.491113 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e40c7-8584-4277-98e3-2095b54f1534 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:14.491771 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e40c7-8584-4277-98e3-2095b54f1534 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:14.494459 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-925e40c7-8584-4277-98e3-2095b54f1534 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:14.572063 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e40c7-8584-4277-98e3-2095b54f1534 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:14.573746 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e40c7-8584-4277-98e3-2095b54f1534 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:14.583456 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 948/1882] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:26:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:26:15.929253 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc4bcf-460f-4601-980b-feeca35a1a10 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:15.929808 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc4bcf-460f-4601-980b-feeca35a1a10 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:15.929924 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc4bcf-460f-4601-980b-feeca35a1a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:15.952856 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-38fc4bcf-460f-4601-980b-feeca35a1a10 None None] MFA Rules not processed for user `0534584e51cd4cbf9309ba101cc88b27`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:15.954148 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-38fc4bcf-460f-4601-980b-feeca35a1a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:15.962037 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 935/1883] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:26:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:26:24.578922 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=46 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:25.947112 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=51 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:28.966255 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e40c7-8584-4277-98e3-2095b54f1534 service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:28.967810 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-925e40c7-8584-4277-98e3-2095b54f1534 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:29.036530 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc4bcf-460f-4601-980b-feeca35a1a10 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:29.038131 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-38fc4bcf-460f-4601-980b-feeca35a1a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:29.039104 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e40c7-8584-4277-98e3-2095b54f1534 service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:29.043878 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf310ef-a01c-4441-8d1a-8693329cbc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:29.044514 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf310ef-a01c-4441-8d1a-8693329cbc1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:29.044789 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf310ef-a01c-4441-8d1a-8693329cbc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:29.045046 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf310ef-a01c-4441-8d1a-8693329cbc1b admin admin] PATH_INFO: `/v3/users/7b95baedc82145a1a3945076a584523d` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:29.046186 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf310ef-a01c-4441-8d1a-8693329cbc1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b95baedc82145a1a3945076a584523d)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:29.048125 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf310ef-a01c-4441-8d1a-8693329cbc1b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:29.053283 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc4bcf-460f-4601-980b-feeca35a1a10 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:29.059776 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fdff7c-0e1c-4bb5-9520-93f966410de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:29.060673 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdff7c-0e1c-4bb5-9520-93f966410de3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:29.060980 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdff7c-0e1c-4bb5-9520-93f966410de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:29.061252 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdff7c-0e1c-4bb5-9520-93f966410de3 admin admin] PATH_INFO: `/v3/users/c1376ddb0b624bf681ddd80cc7375707` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:29.062435 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fdff7c-0e1c-4bb5-9520-93f966410de3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1376ddb0b624bf681ddd80cc7375707)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:29.064470 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fdff7c-0e1c-4bb5-9520-93f966410de3 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:29.102303 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1bf310ef-a01c-4441-8d1a-8693329cbc1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b95baedc82145a1a3945076a584523d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:29.102983 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1bf310ef-a01c-4441-8d1a-8693329cbc1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b95baedc82145a1a3945076a584523d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:29.111227 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1bf310ef-a01c-4441-8d1a-8693329cbc1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b95baedc82145a1a3945076a584523d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:29.116030 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-26fdff7c-0e1c-4bb5-9520-93f966410de3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1376ddb0b624bf681ddd80cc7375707'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:29.117121 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-26fdff7c-0e1c-4bb5-9520-93f966410de3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1376ddb0b624bf681ddd80cc7375707'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:29.125750 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1bf310ef-a01c-4441-8d1a-8693329cbc1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b95baedc82145a1a3945076a584523d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:29.126485 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1bf310ef-a01c-4441-8d1a-8693329cbc1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b95baedc82145a1a3945076a584523d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:29.127683 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-26fdff7c-0e1c-4bb5-9520-93f966410de3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1376ddb0b624bf681ddd80cc7375707'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:29.141617 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 949/1884] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:26:28 2022] DELETE /identity/v3/users/7b95baedc82145a1a3945076a584523d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:26:29.146578 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-26fdff7c-0e1c-4bb5-9520-93f966410de3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1376ddb0b624bf681ddd80cc7375707'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:29.147293 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-26fdff7c-0e1c-4bb5-9520-93f966410de3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1376ddb0b624bf681ddd80cc7375707'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:29.147620 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26e828-4377-4644-ba24-063f3875220d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:29.148163 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26e828-4377-4644-ba24-063f3875220d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:29.148436 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26e828-4377-4644-ba24-063f3875220d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:29.162610 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 936/1885] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:26:29 2022] DELETE /identity/v3/users/c1376ddb0b624bf681ddd80cc7375707 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:26:29.172294 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134eda69-b7b8-462b-a6c5-079a713521c7 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:29.172703 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134eda69-b7b8-462b-a6c5-079a713521c7 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:29.173079 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134eda69-b7b8-462b-a6c5-079a713521c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:29.189498 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-df26e828-4377-4644-ba24-063f3875220d None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:29.190652 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-df26e828-4377-4644-ba24-063f3875220d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:29.196381 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-134eda69-b7b8-462b-a6c5-079a713521c7 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:29.197761 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-134eda69-b7b8-462b-a6c5-079a713521c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:29.272904 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 937/1886] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:26:29.279544 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134eda69-b7b8-462b-a6c5-079a713521c7 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:29.282891 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-134eda69-b7b8-462b-a6c5-079a713521c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:29.311584 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 950/1887] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:26:29.321107 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26e828-4377-4644-ba24-063f3875220d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:29.322647 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-df26e828-4377-4644-ba24-063f3875220d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:29.350053 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:29.360233 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134eda69-b7b8-462b-a6c5-079a713521c7 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:29.365395 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14760274-a7fa-49da-9088-7bb74a6a1b12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:29.368621 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14760274-a7fa-49da-9088-7bb74a6a1b12 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:29.368893 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14760274-a7fa-49da-9088-7bb74a6a1b12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:29.369158 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14760274-a7fa-49da-9088-7bb74a6a1b12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:29.385329 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14760274-a7fa-49da-9088-7bb74a6a1b12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:29.387376 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14760274-a7fa-49da-9088-7bb74a6a1b12 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:29.396367 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26e828-4377-4644-ba24-063f3875220d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:29.400104 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5873d13-005b-4d6c-a6bc-de09d790d706 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:29.400714 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5873d13-005b-4d6c-a6bc-de09d790d706 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:29.400989 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5873d13-005b-4d6c-a6bc-de09d790d706 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:29.401251 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5873d13-005b-4d6c-a6bc-de09d790d706 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:29.401906 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 938/1888] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:26:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:26:29.412717 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5873d13-005b-4d6c-a6bc-de09d790d706 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:29.414568 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5873d13-005b-4d6c-a6bc-de09d790d706 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:29.425507 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 951/1889] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:26:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:26:29.822371 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14760274-a7fa-49da-9088-7bb74a6a1b12 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:29.829176 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-14760274-a7fa-49da-9088-7bb74a6a1b12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:29.832319 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5873d13-005b-4d6c-a6bc-de09d790d706 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:29.834740 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a5873d13-005b-4d6c-a6bc-de09d790d706 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:29.856889 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5873d13-005b-4d6c-a6bc-de09d790d706 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:29.863088 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717c3a5-5762-4d98-9e6f-10b460f597fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:29.863988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717c3a5-5762-4d98-9e6f-10b460f597fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:29.864093 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14760274-a7fa-49da-9088-7bb74a6a1b12 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:29.864416 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717c3a5-5762-4d98-9e6f-10b460f597fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:29.864859 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717c3a5-5762-4d98-9e6f-10b460f597fa admin admin] PATH_INFO: `/v3/projects/91e6d132f4e947848603ff9744836263` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:29.866466 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f717c3a5-5762-4d98-9e6f-10b460f597fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=91e6d132f4e947848603ff9744836263)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:29.868588 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f717c3a5-5762-4d98-9e6f-10b460f597fa admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:29.878282 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f6e95-4d13-41b2-8335-d86655c97a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:29.878589 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f6e95-4d13-41b2-8335-d86655c97a95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:29.878865 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f6e95-4d13-41b2-8335-d86655c97a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:29.879131 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f6e95-4d13-41b2-8335-d86655c97a95 admin admin] PATH_INFO: `/v3/projects/bbe59abb1eff4aa99649025e125a6d4f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:29.882912 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f6e95-4d13-41b2-8335-d86655c97a95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbe59abb1eff4aa99649025e125a6d4f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:29.883966 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f6e95-4d13-41b2-8335-d86655c97a95 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:29.903900 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:29.949906 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f717c3a5-5762-4d98-9e6f-10b460f597fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91e6d132f4e947848603ff9744836263', 'request_id': 'req-f717c3a5-5762-4d98-9e6f-10b460f597fa'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:29.954681 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-7d8f6e95-4d13-41b2-8335-d86655c97a95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbe59abb1eff4aa99649025e125a6d4f', 'request_id': 'req-7d8f6e95-4d13-41b2-8335-d86655c97a95'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:29.956612 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f717c3a5-5762-4d98-9e6f-10b460f597fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91e6d132f4e947848603ff9744836263', 'request_id': 'req-f717c3a5-5762-4d98-9e6f-10b460f597fa'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:29.963167 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-7d8f6e95-4d13-41b2-8335-d86655c97a95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbe59abb1eff4aa99649025e125a6d4f', 'request_id': 'req-7d8f6e95-4d13-41b2-8335-d86655c97a95'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:29.963647 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f717c3a5-5762-4d98-9e6f-10b460f597fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91e6d132f4e947848603ff9744836263', 'request_id': 'req-f717c3a5-5762-4d98-9e6f-10b460f597fa'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:29.971810 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-7d8f6e95-4d13-41b2-8335-d86655c97a95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbe59abb1eff4aa99649025e125a6d4f', 'request_id': 'req-7d8f6e95-4d13-41b2-8335-d86655c97a95'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:29.980332 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f717c3a5-5762-4d98-9e6f-10b460f597fa admin admin] The token cache is being invalidate because project 91e6d132f4e947848603ff9744836263 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:26:29.980862 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f717c3a5-5762-4d98-9e6f-10b460f597fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:29.981441 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f717c3a5-5762-4d98-9e6f-10b460f597fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:29.983233 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 952/1890] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:26:29 2022] DELETE /identity/v3/projects/91e6d132f4e947848603ff9744836263 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:26:29.983450 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-7d8f6e95-4d13-41b2-8335-d86655c97a95 admin admin] The token cache is being invalidate because project bbe59abb1eff4aa99649025e125a6d4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:26:29.983741 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-7d8f6e95-4d13-41b2-8335-d86655c97a95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:29.984376 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-7d8f6e95-4d13-41b2-8335-d86655c97a95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:29.986000 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 939/1891] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:26:29 2022] DELETE /identity/v3/projects/bbe59abb1eff4aa99649025e125a6d4f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:26:29.988204 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2af818-38c2-4b42-8881-ab65f788ed6e None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:29.988488 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2af818-38c2-4b42-8881-ab65f788ed6e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:29.988794 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2af818-38c2-4b42-8881-ab65f788ed6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:29.990899 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73469a-2a49-428e-ac76-b0cb17c7ea66 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:29.991181 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73469a-2a49-428e-ac76-b0cb17c7ea66 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:29.991455 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73469a-2a49-428e-ac76-b0cb17c7ea66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:30.010403 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-2a2af818-38c2-4b42-8881-ab65f788ed6e None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:30.011663 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-ce73469a-2a49-428e-ac76-b0cb17c7ea66 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:30.011861 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2a2af818-38c2-4b42-8881-ab65f788ed6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:30.012821 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ce73469a-2a49-428e-ac76-b0cb17c7ea66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:30.073942 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 953/1892] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:26:30.079863 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 940/1893] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:26:30.083139 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f767a-28c3-456c-8215-07cdf42d6066 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:30.083424 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f767a-28c3-456c-8215-07cdf42d6066 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:30.083695 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f767a-28c3-456c-8215-07cdf42d6066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:30.087168 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56b1e1-61af-45ff-8a5e-f19d859963fc None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:30.087454 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56b1e1-61af-45ff-8a5e-f19d859963fc None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:30.087726 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56b1e1-61af-45ff-8a5e-f19d859963fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:30.103278 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-a51f767a-28c3-456c-8215-07cdf42d6066 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:30.104493 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a51f767a-28c3-456c-8215-07cdf42d6066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:30.107358 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-9e56b1e1-61af-45ff-8a5e-f19d859963fc None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:30.108516 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-9e56b1e1-61af-45ff-8a5e-f19d859963fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:30.112690 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 954/1894] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:26:30.116673 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 941/1895] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:26:30.118014 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f767a-28c3-456c-8215-07cdf42d6066 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:30.120709 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56b1e1-61af-45ff-8a5e-f19d859963fc None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:30.127414 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f767a-28c3-456c-8215-07cdf42d6066 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:30.130224 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56b1e1-61af-45ff-8a5e-f19d859963fc None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:30.131994 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e9a60-4dc6-4ed8-9851-92342f053da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:30.132614 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e9a60-4dc6-4ed8-9851-92342f053da8 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:30.132890 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e9a60-4dc6-4ed8-9851-92342f053da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:30.133160 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e9a60-4dc6-4ed8-9851-92342f053da8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:30.133853 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e9a60-4dc6-4ed8-9851-92342f053da8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:26:30.134271 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e9a60-4dc6-4ed8-9851-92342f053da8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:30.135306 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc12e09-55cc-4e1e-abe7-03d1c8b9cf16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:30.135886 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e9a60-4dc6-4ed8-9851-92342f053da8 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:30.135985 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc12e09-55cc-4e1e-abe7-03d1c8b9cf16 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:30.136219 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc12e09-55cc-4e1e-abe7-03d1c8b9cf16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:30.136480 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc12e09-55cc-4e1e-abe7-03d1c8b9cf16 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:30.137238 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc12e09-55cc-4e1e-abe7-03d1c8b9cf16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:26:30.137521 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc12e09-55cc-4e1e-abe7-03d1c8b9cf16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:30.139217 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc12e09-55cc-4e1e-abe7-03d1c8b9cf16 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:30.151005 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 955/1896] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:26:30.151161 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 942/1897] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:26:30.152856 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e9a60-4dc6-4ed8-9851-92342f053da8 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:30.154991 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc12e09-55cc-4e1e-abe7-03d1c8b9cf16 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:30.162822 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e9a60-4dc6-4ed8-9851-92342f053da8 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:30.164607 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc12e09-55cc-4e1e-abe7-03d1c8b9cf16 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:30.167484 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41bf54-48d3-440e-9fdf-60c93c7f701a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:30.167986 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41bf54-48d3-440e-9fdf-60c93c7f701a admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:30.168259 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41bf54-48d3-440e-9fdf-60c93c7f701a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:30.168524 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41bf54-48d3-440e-9fdf-60c93c7f701a admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:30.169182 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb41bf54-48d3-440e-9fdf-60c93c7f701a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:30.169289 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602eccf-ada1-4d31-bea5-788bd4802cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:30.169832 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602eccf-ada1-4d31-bea5-788bd4802cd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:30.170111 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602eccf-ada1-4d31-bea5-788bd4802cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:30.170381 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602eccf-ada1-4d31-bea5-788bd4802cd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:30.171008 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602eccf-ada1-4d31-bea5-788bd4802cd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:30.171138 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb41bf54-48d3-440e-9fdf-60c93c7f701a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:30.172929 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602eccf-ada1-4d31-bea5-788bd4802cd2 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:30.206622 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 956/1898] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:26:30 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:26:30.207633 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41bf54-48d3-440e-9fdf-60c93c7f701a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:30.210660 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 943/1899] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:26:30 2022] POST /identity/v3/projects => generated 397 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:26:30.214607 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602eccf-ada1-4d31-bea5-788bd4802cd2 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:30.216955 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:30.278327 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41bf54-48d3-440e-9fdf-60c93c7f701a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:30.286115 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:30.291358 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602eccf-ada1-4d31-bea5-788bd4802cd2 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:30.298245 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f597d-826e-4cd3-9309-59ad337e0ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:30.299446 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f597d-826e-4cd3-9309-59ad337e0ec5 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:30.299863 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f597d-826e-4cd3-9309-59ad337e0ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:30.300370 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f597d-826e-4cd3-9309-59ad337e0ec5 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:30.301056 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f597d-826e-4cd3-9309-59ad337e0ec5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:30.303060 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f597d-826e-4cd3-9309-59ad337e0ec5 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:30.329120 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 944/1900] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:26:30 2022] POST /identity/v3/users => generated 299 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:26:30.333910 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f597d-826e-4cd3-9309-59ad337e0ec5 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:30.344035 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb43e5-f79c-4b1b-b314-ee5cb065885e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:30.344694 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb43e5-f79c-4b1b-b314-ee5cb065885e admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:30.344979 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb43e5-f79c-4b1b-b314-ee5cb065885e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:30.345254 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb43e5-f79c-4b1b-b314-ee5cb065885e admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:30.345704 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f597d-826e-4cd3-9309-59ad337e0ec5 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:30.345933 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb43e5-f79c-4b1b-b314-ee5cb065885e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:30.347962 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb43e5-f79c-4b1b-b314-ee5cb065885e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:30.350384 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d28b7-606f-4ea7-9541-97a4060a4051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:30.351059 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d28b7-606f-4ea7-9541-97a4060a4051 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:30.351246 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d28b7-606f-4ea7-9541-97a4060a4051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:30.351511 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d28b7-606f-4ea7-9541-97a4060a4051 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:30.352266 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d28b7-606f-4ea7-9541-97a4060a4051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:30.353999 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d28b7-606f-4ea7-9541-97a4060a4051 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:30.370249 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 957/1901] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:26:30 2022] POST /identity/v3/users => generated 286 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:26:30.371133 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 945/1902] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:26:30.374700 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb43e5-f79c-4b1b-b314-ee5cb065885e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:30.374835 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d28b7-606f-4ea7-9541-97a4060a4051 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:30.384351 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d28b7-606f-4ea7-9541-97a4060a4051 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:30.384490 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb43e5-f79c-4b1b-b314-ee5cb065885e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:30.388860 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2bfc6a-1eb1-48ff-b0d3-df43852b0e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:30.389128 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf1176-22da-4b16-9181-499a294f64ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:30.389443 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2bfc6a-1eb1-48ff-b0d3-df43852b0e1e admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:30.389748 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf1176-22da-4b16-9181-499a294f64ef admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:30.389845 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2bfc6a-1eb1-48ff-b0d3-df43852b0e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:30.390029 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2bfc6a-1eb1-48ff-b0d3-df43852b0e1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:30.390132 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf1176-22da-4b16-9181-499a294f64ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:30.390295 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf1176-22da-4b16-9181-499a294f64ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:30.390751 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2bfc6a-1eb1-48ff-b0d3-df43852b0e1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:30.390934 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf1176-22da-4b16-9181-499a294f64ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:30.392341 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2bfc6a-1eb1-48ff-b0d3-df43852b0e1e admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:30.392526 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf1176-22da-4b16-9181-499a294f64ef admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:30.405994 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 958/1903] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:26:30.406170 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 946/1904] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 13:26:30.407344 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf1176-22da-4b16-9181-499a294f64ef admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:30.408421 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2bfc6a-1eb1-48ff-b0d3-df43852b0e1e admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:30.417005 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf1176-22da-4b16-9181-499a294f64ef admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:30.418778 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2bfc6a-1eb1-48ff-b0d3-df43852b0e1e admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:30.422126 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4dca3-046e-48ae-a262-c80fd3cfc9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:30.422722 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4dca3-046e-48ae-a262-c80fd3cfc9f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:30.422989 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4dca3-046e-48ae-a262-c80fd3cfc9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:30.423282 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4dca3-046e-48ae-a262-c80fd3cfc9f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:30.423699 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c54f71-2a9d-4373-ab39-f6009ef1b95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:30.423923 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e4dca3-046e-48ae-a262-c80fd3cfc9f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:30.424337 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c54f71-2a9d-4373-ab39-f6009ef1b95e admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:30.424609 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c54f71-2a9d-4373-ab39-f6009ef1b95e admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:30.424900 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c54f71-2a9d-4373-ab39-f6009ef1b95e admin admin] PATH_INFO: `/v3/projects/50250bae4c3449af818d0bce223e10a9/users/9a93f99bb5044590b25c53f8c74418b2/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:30.425506 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e4dca3-046e-48ae-a262-c80fd3cfc9f4 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:30.441066 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 959/1905] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 13:26:30.441256 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c54f71-2a9d-4373-ab39-f6009ef1b95e admin admin] RBAC: Authorizing `identity:create_grant(project_id=50250bae4c3449af818d0bce223e10a9, user_id=9a93f99bb5044590b25c53f8c74418b2, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:30.442139 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4dca3-046e-48ae-a262-c80fd3cfc9f4 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:30.444037 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c54f71-2a9d-4373-ab39-f6009ef1b95e admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:30.452510 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4dca3-046e-48ae-a262-c80fd3cfc9f4 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:30.459487 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 947/1906] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:26:30 2022] PUT /identity/v3/projects/50250bae4c3449af818d0bce223e10a9/users/9a93f99bb5044590b25c53f8c74418b2/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:26:30.471184 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1e38d-e8be-46e1-b1c7-a62a217d8c5a None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:30.471464 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1e38d-e8be-46e1-b1c7-a62a217d8c5a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:30.471731 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1e38d-e8be-46e1-b1c7-a62a217d8c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:30.508717 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-e4d1e38d-e8be-46e1-b1c7-a62a217d8c5a None None] MFA Rules not processed for user `9a93f99bb5044590b25c53f8c74418b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:30.510081 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e4d1e38d-e8be-46e1-b1c7-a62a217d8c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:30.521799 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82a866-e3a5-4d79-8c7f-ae754cfc9f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:30.522739 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82a866-e3a5-4d79-8c7f-ae754cfc9f5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:30.523139 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82a866-e3a5-4d79-8c7f-ae754cfc9f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:30.523413 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82a866-e3a5-4d79-8c7f-ae754cfc9f5a admin admin] PATH_INFO: `/v3/projects/44fc05f7153f43e6b24ff16c25245352/users/cf8036325bea4fa3b125ef12f9d4fba6/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:30.539185 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d82a866-e3a5-4d79-8c7f-ae754cfc9f5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=44fc05f7153f43e6b24ff16c25245352, user_id=cf8036325bea4fa3b125ef12f9d4fba6, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:30.541879 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d82a866-e3a5-4d79-8c7f-ae754cfc9f5a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:30.558359 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 960/1907] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:26:30 2022] PUT /identity/v3/projects/44fc05f7153f43e6b24ff16c25245352/users/cf8036325bea4fa3b125ef12f9d4fba6/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:26:30.568468 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5eff6-d9e1-4016-bd9d-e587b39d25aa None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:30.568845 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5eff6-d9e1-4016-bd9d-e587b39d25aa None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:30.569083 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5eff6-d9e1-4016-bd9d-e587b39d25aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:30.578723 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:30.596945 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 948/1908] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:26:30 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:26:30.610166 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1e38d-e8be-46e1-b1c7-a62a217d8c5a None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:30.611278 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-78d5eff6-d9e1-4016-bd9d-e587b39d25aa None None] MFA Rules not processed for user `cf8036325bea4fa3b125ef12f9d4fba6`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:30.611751 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e4d1e38d-e8be-46e1-b1c7-a62a217d8c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:30.612458 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-78d5eff6-d9e1-4016-bd9d-e587b39d25aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:30.674818 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1e38d-e8be-46e1-b1c7-a62a217d8c5a None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:30.698037 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 961/1909] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:26:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:26:30.708742 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5eff6-d9e1-4016-bd9d-e587b39d25aa None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:30.710596 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-78d5eff6-d9e1-4016-bd9d-e587b39d25aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:30.737310 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:30.746259 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afeb4b0-4d89-482c-8843-ac2ad85bef03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:30.747226 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afeb4b0-4d89-482c-8843-ac2ad85bef03 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:30.747829 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afeb4b0-4d89-482c-8843-ac2ad85bef03 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:30.748456 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afeb4b0-4d89-482c-8843-ac2ad85bef03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:30.787393 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5eff6-d9e1-4016-bd9d-e587b39d25aa None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:30.792410 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce059069-d7de-4b7f-8d54-a86a8bbf7525 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:30.793628 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce059069-d7de-4b7f-8d54-a86a8bbf7525 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:30.793915 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce059069-d7de-4b7f-8d54-a86a8bbf7525 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:30.794192 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce059069-d7de-4b7f-8d54-a86a8bbf7525 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:30.805468 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce059069-d7de-4b7f-8d54-a86a8bbf7525 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:30.806962 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce059069-d7de-4b7f-8d54-a86a8bbf7525 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:30.817319 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 962/1910] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:26:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:26:30.823874 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afeb4b0-4d89-482c-8843-ac2ad85bef03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:30.825772 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afeb4b0-4d89-482c-8843-ac2ad85bef03 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:30.842560 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce059069-d7de-4b7f-8d54-a86a8bbf7525 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:30.842981 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 949/1911] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:26:30 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:26:30.941405 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce059069-d7de-4b7f-8d54-a86a8bbf7525 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:30.947559 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30fe67-2c5a-40d0-95f3-9c8b8a1226c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:30.948203 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30fe67-2c5a-40d0-95f3-9c8b8a1226c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:30.948478 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30fe67-2c5a-40d0-95f3-9c8b8a1226c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:30.948873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30fe67-2c5a-40d0-95f3-9c8b8a1226c8 admin admin] PATH_INFO: `/v3/users/cf8036325bea4fa3b125ef12f9d4fba6` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:30.951109 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae30fe67-2c5a-40d0-95f3-9c8b8a1226c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf8036325bea4fa3b125ef12f9d4fba6)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:30.952547 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae30fe67-2c5a-40d0-95f3-9c8b8a1226c8 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:31.036203 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:31.053578 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ae30fe67-2c5a-40d0-95f3-9c8b8a1226c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf8036325bea4fa3b125ef12f9d4fba6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:31.054265 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ae30fe67-2c5a-40d0-95f3-9c8b8a1226c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf8036325bea4fa3b125ef12f9d4fba6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:31.064056 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ae30fe67-2c5a-40d0-95f3-9c8b8a1226c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf8036325bea4fa3b125ef12f9d4fba6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:31.079389 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ae30fe67-2c5a-40d0-95f3-9c8b8a1226c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf8036325bea4fa3b125ef12f9d4fba6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:31.080397 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ae30fe67-2c5a-40d0-95f3-9c8b8a1226c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf8036325bea4fa3b125ef12f9d4fba6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:31.097656 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 963/1912] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:26:30 2022] DELETE /identity/v3/users/cf8036325bea4fa3b125ef12f9d4fba6 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:26:31.102782 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fea807-706e-442a-94cb-5d4544a8b7f8 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:31.103337 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fea807-706e-442a-94cb-5d4544a8b7f8 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:31.103637 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fea807-706e-442a-94cb-5d4544a8b7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:31.142302 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-d7fea807-706e-442a-94cb-5d4544a8b7f8 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:31.143962 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d7fea807-706e-442a-94cb-5d4544a8b7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:31.261064 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 950/1913] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:26:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:26:31.273191 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30fe67-2c5a-40d0-95f3-9c8b8a1226c8 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:31.275699 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ae30fe67-2c5a-40d0-95f3-9c8b8a1226c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:31.376837 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30fe67-2c5a-40d0-95f3-9c8b8a1226c8 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:31.383402 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4edea0-c9f8-4930-ae24-3af62cfa40bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:31.384152 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4edea0-c9f8-4930-ae24-3af62cfa40bf service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:31.384296 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4edea0-c9f8-4930-ae24-3af62cfa40bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:31.384568 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4edea0-c9f8-4930-ae24-3af62cfa40bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:31.417692 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4edea0-c9f8-4930-ae24-3af62cfa40bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:31.419624 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4edea0-c9f8-4930-ae24-3af62cfa40bf service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:31.444708 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 964/1914] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:26:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:26:31.897515 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fea807-706e-442a-94cb-5d4544a8b7f8 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:31.899108 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d7fea807-706e-442a-94cb-5d4544a8b7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:31.926058 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fea807-706e-442a-94cb-5d4544a8b7f8 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:31.936109 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44199fb2-1afe-4465-92c2-035ef652f676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:31.937676 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44199fb2-1afe-4465-92c2-035ef652f676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:31.938195 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44199fb2-1afe-4465-92c2-035ef652f676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:31.938473 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44199fb2-1afe-4465-92c2-035ef652f676 admin admin] PATH_INFO: `/v3/projects/44fc05f7153f43e6b24ff16c25245352` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:31.939899 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44199fb2-1afe-4465-92c2-035ef652f676 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44fc05f7153f43e6b24ff16c25245352)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:31.944022 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44199fb2-1afe-4465-92c2-035ef652f676 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:32.012197 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-44199fb2-1afe-4465-92c2-035ef652f676 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44fc05f7153f43e6b24ff16c25245352', 'request_id': 'req-44199fb2-1afe-4465-92c2-035ef652f676'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:32.019784 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-44199fb2-1afe-4465-92c2-035ef652f676 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44fc05f7153f43e6b24ff16c25245352', 'request_id': 'req-44199fb2-1afe-4465-92c2-035ef652f676'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:32.026455 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-44199fb2-1afe-4465-92c2-035ef652f676 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44fc05f7153f43e6b24ff16c25245352', 'request_id': 'req-44199fb2-1afe-4465-92c2-035ef652f676'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:32.039258 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-44199fb2-1afe-4465-92c2-035ef652f676 admin admin] The token cache is being invalidate because project 44fc05f7153f43e6b24ff16c25245352 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:26:32.039515 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-44199fb2-1afe-4465-92c2-035ef652f676 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:32.040286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-44199fb2-1afe-4465-92c2-035ef652f676 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:32.041934 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 951/1915] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:26:31 2022] DELETE /identity/v3/projects/44fc05f7153f43e6b24ff16c25245352 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:26:32.047062 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f25f8-d20d-4c76-a5ee-a2518b630c24 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:32.047550 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f25f8-d20d-4c76-a5ee-a2518b630c24 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:32.047750 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f25f8-d20d-4c76-a5ee-a2518b630c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:32.068167 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-911f25f8-d20d-4c76-a5ee-a2518b630c24 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:32.069561 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-911f25f8-d20d-4c76-a5ee-a2518b630c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:32.134542 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 965/1916] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:26:32.143801 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418d862-a7ba-495e-a37f-4cf3e3a946f3 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:32.144290 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418d862-a7ba-495e-a37f-4cf3e3a946f3 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:32.144382 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418d862-a7ba-495e-a37f-4cf3e3a946f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:32.164793 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-3418d862-a7ba-495e-a37f-4cf3e3a946f3 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:32.166249 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3418d862-a7ba-495e-a37f-4cf3e3a946f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:32.174154 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 952/1917] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:26:32.178388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f25f8-d20d-4c76-a5ee-a2518b630c24 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:32.188993 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f25f8-d20d-4c76-a5ee-a2518b630c24 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:32.194099 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34149c0a-a845-4e9a-b9af-c8bc75640a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:32.194706 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34149c0a-a845-4e9a-b9af-c8bc75640a7b admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:32.194980 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34149c0a-a845-4e9a-b9af-c8bc75640a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:32.195272 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34149c0a-a845-4e9a-b9af-c8bc75640a7b admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:32.195911 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34149c0a-a845-4e9a-b9af-c8bc75640a7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:26:32.196213 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34149c0a-a845-4e9a-b9af-c8bc75640a7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:32.197836 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34149c0a-a845-4e9a-b9af-c8bc75640a7b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:32.210089 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 966/1918] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:26:32.214423 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418d862-a7ba-495e-a37f-4cf3e3a946f3 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:32.223877 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418d862-a7ba-495e-a37f-4cf3e3a946f3 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:32.228987 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a2845-23e1-4d33-92a2-ea92813a57e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:32.229593 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a2845-23e1-4d33-92a2-ea92813a57e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:32.229939 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a2845-23e1-4d33-92a2-ea92813a57e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:32.230207 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a2845-23e1-4d33-92a2-ea92813a57e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:32.230911 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a2845-23e1-4d33-92a2-ea92813a57e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:32.232834 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a2845-23e1-4d33-92a2-ea92813a57e5 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:32.249563 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:32.263630 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 953/1919] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:26:32 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:26:32.268821 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34149c0a-a845-4e9a-b9af-c8bc75640a7b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:32.279639 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34149c0a-a845-4e9a-b9af-c8bc75640a7b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:32.325845 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:32.343032 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233893e-8f13-4bfa-bf61-41e3bb119947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:32.343656 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233893e-8f13-4bfa-bf61-41e3bb119947 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:32.343929 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233893e-8f13-4bfa-bf61-41e3bb119947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:32.344193 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233893e-8f13-4bfa-bf61-41e3bb119947 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:32.344840 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f233893e-8f13-4bfa-bf61-41e3bb119947 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:32.346781 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f233893e-8f13-4bfa-bf61-41e3bb119947 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:32.369620 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 967/1920] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:26:32 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:26:32.374081 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a2845-23e1-4d33-92a2-ea92813a57e5 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:32.384960 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a2845-23e1-4d33-92a2-ea92813a57e5 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:32.390632 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff07518b-1b6b-43b2-b51b-c97b8c06bb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:32.391368 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07518b-1b6b-43b2-b51b-c97b8c06bb4e admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:32.391650 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07518b-1b6b-43b2-b51b-c97b8c06bb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:32.391918 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07518b-1b6b-43b2-b51b-c97b8c06bb4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:32.392842 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff07518b-1b6b-43b2-b51b-c97b8c06bb4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:32.394210 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff07518b-1b6b-43b2-b51b-c97b8c06bb4e admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:32.407835 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 954/1921] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:26:32.409053 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233893e-8f13-4bfa-bf61-41e3bb119947 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:32.420903 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233893e-8f13-4bfa-bf61-41e3bb119947 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:32.426342 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0e4e1-b340-44bf-ac5a-807feda1a5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:32.426753 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0e4e1-b340-44bf-ac5a-807feda1a5ab admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:32.427082 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0e4e1-b340-44bf-ac5a-807feda1a5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:32.427357 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0e4e1-b340-44bf-ac5a-807feda1a5ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:32.428030 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0e4e1-b340-44bf-ac5a-807feda1a5ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:32.429688 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0e4e1-b340-44bf-ac5a-807feda1a5ab admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:32.443407 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 968/1922] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:26:32.447519 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff07518b-1b6b-43b2-b51b-c97b8c06bb4e admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:32.458564 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff07518b-1b6b-43b2-b51b-c97b8c06bb4e admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:32.463265 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e5591-f0b7-4235-aeac-b81e1462b417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:32.463914 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e5591-f0b7-4235-aeac-b81e1462b417 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:32.464299 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e5591-f0b7-4235-aeac-b81e1462b417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:32.464570 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e5591-f0b7-4235-aeac-b81e1462b417 admin admin] PATH_INFO: `/v3/projects/7d97b01a08d04a7387eacb4807c0f3f8/users/eba314c4d44b496a81b3c05201726760/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:32.483185 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e5591-f0b7-4235-aeac-b81e1462b417 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d97b01a08d04a7387eacb4807c0f3f8, user_id=eba314c4d44b496a81b3c05201726760, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:32.485944 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e5591-f0b7-4235-aeac-b81e1462b417 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:32.500600 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 955/1923] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:26:32 2022] PUT /identity/v3/projects/7d97b01a08d04a7387eacb4807c0f3f8/users/eba314c4d44b496a81b3c05201726760/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:26:32.570928 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7def98-624d-4e46-b64a-2c7321437f29 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:32.571413 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7def98-624d-4e46-b64a-2c7321437f29 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:32.571757 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7def98-624d-4e46-b64a-2c7321437f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:32.604942 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-0a7def98-624d-4e46-b64a-2c7321437f29 None None] MFA Rules not processed for user `eba314c4d44b496a81b3c05201726760`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:32.606704 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0a7def98-624d-4e46-b64a-2c7321437f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:32.705857 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 969/1924] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:26:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:26:32.741105 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e5591-f0b7-4235-aeac-b81e1462b417 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:32.743121 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-390e5591-f0b7-4235-aeac-b81e1462b417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:32.805815 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e5591-f0b7-4235-aeac-b81e1462b417 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:32.809924 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca743dc7-3736-46fc-8bfe-cfcb51237680 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:32.810913 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca743dc7-3736-46fc-8bfe-cfcb51237680 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:32.811189 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca743dc7-3736-46fc-8bfe-cfcb51237680 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:32.811457 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca743dc7-3736-46fc-8bfe-cfcb51237680 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:32.820960 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca743dc7-3736-46fc-8bfe-cfcb51237680 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:32.822521 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca743dc7-3736-46fc-8bfe-cfcb51237680 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:32.832571 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 956/1925] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:26:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:26:34.301954 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f2019-4ff8-450b-9836-bf7caecabe36 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:34.302517 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f2019-4ff8-450b-9836-bf7caecabe36 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:34.302517 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f2019-4ff8-450b-9836-bf7caecabe36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:34.324722 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-b04f2019-4ff8-450b-9836-bf7caecabe36 None None] MFA Rules not processed for user `eba314c4d44b496a81b3c05201726760`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:34.325946 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b04f2019-4ff8-450b-9836-bf7caecabe36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:34.333203 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 970/1926] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:26:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:26:35.417651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42424caf-0236-4362-ba51-5b1bd8713e5a None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:35.418191 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42424caf-0236-4362-ba51-5b1bd8713e5a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:35.418272 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42424caf-0236-4362-ba51-5b1bd8713e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:35.439713 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-42424caf-0236-4362-ba51-5b1bd8713e5a None None] MFA Rules not processed for user `946833c2a74f46528ec7c12cfef4e1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:35.441033 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-42424caf-0236-4362-ba51-5b1bd8713e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:35.503017 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 957/1927] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:26:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:26:37.197117 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f2019-4ff8-450b-9836-bf7caecabe36 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:37.199125 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b04f2019-4ff8-450b-9836-bf7caecabe36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:37.309488 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f2019-4ff8-450b-9836-bf7caecabe36 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:37.315445 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f87e3-6b2d-4cfe-b43d-86c0386ca524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:37.316186 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f87e3-6b2d-4cfe-b43d-86c0386ca524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:37.316535 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f87e3-6b2d-4cfe-b43d-86c0386ca524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:37.316880 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f87e3-6b2d-4cfe-b43d-86c0386ca524 admin admin] PATH_INFO: `/v3/users/9a93f99bb5044590b25c53f8c74418b2` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:37.318779 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537f87e3-6b2d-4cfe-b43d-86c0386ca524 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a93f99bb5044590b25c53f8c74418b2)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:37.320877 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537f87e3-6b2d-4cfe-b43d-86c0386ca524 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:37.439483 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-537f87e3-6b2d-4cfe-b43d-86c0386ca524 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a93f99bb5044590b25c53f8c74418b2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:37.440835 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-537f87e3-6b2d-4cfe-b43d-86c0386ca524 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a93f99bb5044590b25c53f8c74418b2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:37.444635 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:37.457508 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-537f87e3-6b2d-4cfe-b43d-86c0386ca524 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a93f99bb5044590b25c53f8c74418b2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:37.476141 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-537f87e3-6b2d-4cfe-b43d-86c0386ca524 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a93f99bb5044590b25c53f8c74418b2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:37.476888 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-537f87e3-6b2d-4cfe-b43d-86c0386ca524 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a93f99bb5044590b25c53f8c74418b2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:37.518529 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 971/1928] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:26:37 2022] DELETE /identity/v3/users/9a93f99bb5044590b25c53f8c74418b2 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:26:37.523003 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d6e43-721a-49e6-abed-5d2919abb7b6 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:37.523881 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d6e43-721a-49e6-abed-5d2919abb7b6 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:37.524378 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d6e43-721a-49e6-abed-5d2919abb7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:37.584926 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-634d6e43-721a-49e6-abed-5d2919abb7b6 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:37.588116 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-634d6e43-721a-49e6-abed-5d2919abb7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:37.695696 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 958/1929] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:26:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:26:37.720683 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f87e3-6b2d-4cfe-b43d-86c0386ca524 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:37.723946 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-537f87e3-6b2d-4cfe-b43d-86c0386ca524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:37.816769 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f87e3-6b2d-4cfe-b43d-86c0386ca524 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:37.852999 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1514d6de-d965-4f34-9833-dda29793937e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:37.853934 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514d6de-d965-4f34-9833-dda29793937e service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:37.854562 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514d6de-d965-4f34-9833-dda29793937e service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:37.855052 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514d6de-d965-4f34-9833-dda29793937e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:37.875570 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1514d6de-d965-4f34-9833-dda29793937e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:37.877252 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1514d6de-d965-4f34-9833-dda29793937e service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:37.898801 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 972/1930] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:26:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:26:38.376394 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d6e43-721a-49e6-abed-5d2919abb7b6 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:38.377850 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-634d6e43-721a-49e6-abed-5d2919abb7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:38.404081 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d6e43-721a-49e6-abed-5d2919abb7b6 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:38.410786 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21d4a1-879c-4784-b6ec-2412256faaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:38.411638 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21d4a1-879c-4784-b6ec-2412256faaa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:38.412073 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21d4a1-879c-4784-b6ec-2412256faaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:38.412497 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21d4a1-879c-4784-b6ec-2412256faaa5 admin admin] PATH_INFO: `/v3/users/ad0a877278d94614a3761736037bb8ed` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:38.422493 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa21d4a1-879c-4784-b6ec-2412256faaa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad0a877278d94614a3761736037bb8ed)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:38.425358 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa21d4a1-879c-4784-b6ec-2412256faaa5 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:38.429808 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:38.494673 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-aa21d4a1-879c-4784-b6ec-2412256faaa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad0a877278d94614a3761736037bb8ed'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:38.495900 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-aa21d4a1-879c-4784-b6ec-2412256faaa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad0a877278d94614a3761736037bb8ed'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:38.504590 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-aa21d4a1-879c-4784-b6ec-2412256faaa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad0a877278d94614a3761736037bb8ed'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:38.547323 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-aa21d4a1-879c-4784-b6ec-2412256faaa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad0a877278d94614a3761736037bb8ed'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:38.548607 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-aa21d4a1-879c-4784-b6ec-2412256faaa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad0a877278d94614a3761736037bb8ed'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:38.568682 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 959/1931] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:26:38 2022] DELETE /identity/v3/users/ad0a877278d94614a3761736037bb8ed => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:26:38.573364 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07281707-c7db-4453-bf06-cfd286041525 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:38.573981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07281707-c7db-4453-bf06-cfd286041525 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:38.573981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07281707-c7db-4453-bf06-cfd286041525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:38.605461 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-07281707-c7db-4453-bf06-cfd286041525 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:38.606654 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-07281707-c7db-4453-bf06-cfd286041525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:38.674765 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 973/1932] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:26:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:26:38.694430 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21d4a1-879c-4784-b6ec-2412256faaa5 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:38.696513 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-aa21d4a1-879c-4784-b6ec-2412256faaa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:38.774473 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21d4a1-879c-4784-b6ec-2412256faaa5 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:38.778780 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d80fb3-fb53-4fee-a605-537e84ef918e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:38.779485 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d80fb3-fb53-4fee-a605-537e84ef918e service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:38.779864 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d80fb3-fb53-4fee-a605-537e84ef918e service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:38.780202 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d80fb3-fb53-4fee-a605-537e84ef918e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:38.791866 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d80fb3-fb53-4fee-a605-537e84ef918e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:38.793705 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d80fb3-fb53-4fee-a605-537e84ef918e service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:38.807671 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 960/1933] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:26:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:26:39.404507 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07281707-c7db-4453-bf06-cfd286041525 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:39.406299 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-07281707-c7db-4453-bf06-cfd286041525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:39.437992 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07281707-c7db-4453-bf06-cfd286041525 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:39.445071 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616e45b-4368-477c-9b22-5ca011db5869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:39.446384 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616e45b-4368-477c-9b22-5ca011db5869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:39.446925 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616e45b-4368-477c-9b22-5ca011db5869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:39.447418 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616e45b-4368-477c-9b22-5ca011db5869 admin admin] PATH_INFO: `/v3/projects/50250bae4c3449af818d0bce223e10a9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:39.451673 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616e45b-4368-477c-9b22-5ca011db5869 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50250bae4c3449af818d0bce223e10a9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:39.454381 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616e45b-4368-477c-9b22-5ca011db5869 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:39.699147 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c616e45b-4368-477c-9b22-5ca011db5869 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50250bae4c3449af818d0bce223e10a9', 'request_id': 'req-c616e45b-4368-477c-9b22-5ca011db5869'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:39.712721 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c616e45b-4368-477c-9b22-5ca011db5869 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50250bae4c3449af818d0bce223e10a9', 'request_id': 'req-c616e45b-4368-477c-9b22-5ca011db5869'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:39.758233 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c616e45b-4368-477c-9b22-5ca011db5869 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50250bae4c3449af818d0bce223e10a9', 'request_id': 'req-c616e45b-4368-477c-9b22-5ca011db5869'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:39.762692 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:39.791008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c616e45b-4368-477c-9b22-5ca011db5869 admin admin] The token cache is being invalidate because project 50250bae4c3449af818d0bce223e10a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:26:39.791903 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c616e45b-4368-477c-9b22-5ca011db5869 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:39.792896 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c616e45b-4368-477c-9b22-5ca011db5869 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:39.795384 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 974/1934] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:26:39 2022] DELETE /identity/v3/projects/50250bae4c3449af818d0bce223e10a9 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:26:39.840398 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d80fb3-fb53-4fee-a605-537e84ef918e service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:39.842530 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b6d80fb3-fb53-4fee-a605-537e84ef918e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:39.876084 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d80fb3-fb53-4fee-a605-537e84ef918e service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:40.042103 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0bf95-3aa6-4e0f-9e91-2eb2c997b86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:40.043071 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0bf95-3aa6-4e0f-9e91-2eb2c997b86f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:40.043708 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0bf95-3aa6-4e0f-9e91-2eb2c997b86f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:40.044134 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0bf95-3aa6-4e0f-9e91-2eb2c997b86f admin admin] PATH_INFO: `/v3/projects/a1a61a242be0445790a6cfb58ce8eeb4` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:40.046475 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c0bf95-3aa6-4e0f-9e91-2eb2c997b86f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1a61a242be0445790a6cfb58ce8eeb4)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:40.048631 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c0bf95-3aa6-4e0f-9e91-2eb2c997b86f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:40.125265 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:40.154791 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f3c0bf95-3aa6-4e0f-9e91-2eb2c997b86f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1a61a242be0445790a6cfb58ce8eeb4', 'request_id': 'req-f3c0bf95-3aa6-4e0f-9e91-2eb2c997b86f'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:40.168274 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f3c0bf95-3aa6-4e0f-9e91-2eb2c997b86f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1a61a242be0445790a6cfb58ce8eeb4', 'request_id': 'req-f3c0bf95-3aa6-4e0f-9e91-2eb2c997b86f'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:40.182126 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f3c0bf95-3aa6-4e0f-9e91-2eb2c997b86f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1a61a242be0445790a6cfb58ce8eeb4', 'request_id': 'req-f3c0bf95-3aa6-4e0f-9e91-2eb2c997b86f'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:40.223774 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f3c0bf95-3aa6-4e0f-9e91-2eb2c997b86f admin admin] The token cache is being invalidate because project a1a61a242be0445790a6cfb58ce8eeb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:26:40.224070 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f3c0bf95-3aa6-4e0f-9e91-2eb2c997b86f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:40.225370 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f3c0bf95-3aa6-4e0f-9e91-2eb2c997b86f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:40.235104 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 961/1935] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:26:39 2022] DELETE /identity/v3/projects/a1a61a242be0445790a6cfb58ce8eeb4 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:26:40.236384 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616e45b-4368-477c-9b22-5ca011db5869 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:40.237874 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c616e45b-4368-477c-9b22-5ca011db5869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:40.254962 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616e45b-4368-477c-9b22-5ca011db5869 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:40.398050 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf0a92-3d33-4459-a563-5cc33a2550aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:40.404157 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf0a92-3d33-4459-a563-5cc33a2550aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:40.404548 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf0a92-3d33-4459-a563-5cc33a2550aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:40.405039 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf0a92-3d33-4459-a563-5cc33a2550aa admin admin] PATH_INFO: `/v3/users/048fadf85fbe4e58ad1d4366d383b0d4` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:40.410410 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf0a92-3d33-4459-a563-5cc33a2550aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=048fadf85fbe4e58ad1d4366d383b0d4)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:40.412422 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf0a92-3d33-4459-a563-5cc33a2550aa admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:40.497790 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0fbf0a92-3d33-4459-a563-5cc33a2550aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '048fadf85fbe4e58ad1d4366d383b0d4'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:40.498674 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0fbf0a92-3d33-4459-a563-5cc33a2550aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '048fadf85fbe4e58ad1d4366d383b0d4'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:40.509320 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0fbf0a92-3d33-4459-a563-5cc33a2550aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '048fadf85fbe4e58ad1d4366d383b0d4'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:40.553897 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0fbf0a92-3d33-4459-a563-5cc33a2550aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '048fadf85fbe4e58ad1d4366d383b0d4'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:40.554795 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0fbf0a92-3d33-4459-a563-5cc33a2550aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '048fadf85fbe4e58ad1d4366d383b0d4'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:40.575900 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 975/1936] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:26:40 2022] DELETE /identity/v3/users/048fadf85fbe4e58ad1d4366d383b0d4 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:26:41.078473 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0bf95-3aa6-4e0f-9e91-2eb2c997b86f admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:41.080800 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f3c0bf95-3aa6-4e0f-9e91-2eb2c997b86f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:41.102951 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0bf95-3aa6-4e0f-9e91-2eb2c997b86f admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:41.216733 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53aad3f-9194-4e9c-a1c5-a319a45e730a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:41.217421 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53aad3f-9194-4e9c-a1c5-a319a45e730a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:41.217745 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53aad3f-9194-4e9c-a1c5-a319a45e730a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:41.218022 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53aad3f-9194-4e9c-a1c5-a319a45e730a admin admin] PATH_INFO: `/v3/projects/46f88de654aa4ecc84c02597a786f203` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:41.219209 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53aad3f-9194-4e9c-a1c5-a319a45e730a admin admin] RBAC: Authorizing `identity:delete_project(project_id=46f88de654aa4ecc84c02597a786f203)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:41.221216 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53aad3f-9194-4e9c-a1c5-a319a45e730a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:41.284843 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d53aad3f-9194-4e9c-a1c5-a319a45e730a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46f88de654aa4ecc84c02597a786f203', 'request_id': 'req-d53aad3f-9194-4e9c-a1c5-a319a45e730a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:41.297342 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d53aad3f-9194-4e9c-a1c5-a319a45e730a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46f88de654aa4ecc84c02597a786f203', 'request_id': 'req-d53aad3f-9194-4e9c-a1c5-a319a45e730a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:41.307565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d53aad3f-9194-4e9c-a1c5-a319a45e730a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46f88de654aa4ecc84c02597a786f203', 'request_id': 'req-d53aad3f-9194-4e9c-a1c5-a319a45e730a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:41.331128 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d53aad3f-9194-4e9c-a1c5-a319a45e730a admin admin] The token cache is being invalidate because project 46f88de654aa4ecc84c02597a786f203 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:26:41.331686 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d53aad3f-9194-4e9c-a1c5-a319a45e730a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:41.332707 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d53aad3f-9194-4e9c-a1c5-a319a45e730a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:41.334895 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 962/1937] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:26:41 2022] DELETE /identity/v3/projects/46f88de654aa4ecc84c02597a786f203 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:26:41.339633 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57a3da-131f-46a7-9c6a-1a468f25834a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:41.340225 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57a3da-131f-46a7-9c6a-1a468f25834a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:41.340225 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57a3da-131f-46a7-9c6a-1a468f25834a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:41.366457 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-9a57a3da-131f-46a7-9c6a-1a468f25834a None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:41.368990 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9a57a3da-131f-46a7-9c6a-1a468f25834a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:41.463201 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 976/1938] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:26:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:26:41.473184 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6a1ee-b2d0-437a-ae8b-dfe05f5fc8ff None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:41.473578 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6a1ee-b2d0-437a-ae8b-dfe05f5fc8ff None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:41.473924 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6a1ee-b2d0-437a-ae8b-dfe05f5fc8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:41.502198 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-d9e6a1ee-b2d0-437a-ae8b-dfe05f5fc8ff None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:41.503756 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d9e6a1ee-b2d0-437a-ae8b-dfe05f5fc8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:41.512157 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 963/1939] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:26:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:26:41.517127 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57a3da-131f-46a7-9c6a-1a468f25834a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:41.530530 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57a3da-131f-46a7-9c6a-1a468f25834a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:41.535705 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a1a4c-4422-42fc-bbc9-15498c712fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:41.536649 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a1a4c-4422-42fc-bbc9-15498c712fbd admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:41.536987 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a1a4c-4422-42fc-bbc9-15498c712fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:41.537522 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a1a4c-4422-42fc-bbc9-15498c712fbd admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:41.538799 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a1a4c-4422-42fc-bbc9-15498c712fbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:26:41.539183 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a1a4c-4422-42fc-bbc9-15498c712fbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:41.542956 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a1a4c-4422-42fc-bbc9-15498c712fbd admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:41.553055 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:41.561774 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 977/1940] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:26:41.567854 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6a1ee-b2d0-437a-ae8b-dfe05f5fc8ff None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:41.582758 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6a1ee-b2d0-437a-ae8b-dfe05f5fc8ff None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:41.599747 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa77e09-f1e3-48c2-9074-2b694f6cae7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:41.600985 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa77e09-f1e3-48c2-9074-2b694f6cae7d admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:41.601258 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa77e09-f1e3-48c2-9074-2b694f6cae7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:41.601554 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa77e09-f1e3-48c2-9074-2b694f6cae7d admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:41.604726 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa77e09-f1e3-48c2-9074-2b694f6cae7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:41.610376 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa77e09-f1e3-48c2-9074-2b694f6cae7d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:41.658311 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 964/1941] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:26:41 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:26:41.662920 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a1a4c-4422-42fc-bbc9-15498c712fbd admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:41.678330 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a1a4c-4422-42fc-bbc9-15498c712fbd admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:41.767033 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae064db-e9a8-4697-be51-8c62d1199e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:41.767663 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae064db-e9a8-4697-be51-8c62d1199e3a admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:41.767944 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae064db-e9a8-4697-be51-8c62d1199e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:41.768218 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae064db-e9a8-4697-be51-8c62d1199e3a admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:41.768856 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae064db-e9a8-4697-be51-8c62d1199e3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:41.779794 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae064db-e9a8-4697-be51-8c62d1199e3a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:41.829588 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 978/1942] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:26:41 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:26:41.833364 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa77e09-f1e3-48c2-9074-2b694f6cae7d admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:41.857251 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa77e09-f1e3-48c2-9074-2b694f6cae7d admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:41.877512 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec2ce1-c149-4605-8530-c7563dceca58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:41.878617 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec2ce1-c149-4605-8530-c7563dceca58 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:41.879090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec2ce1-c149-4605-8530-c7563dceca58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:41.879614 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec2ce1-c149-4605-8530-c7563dceca58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:41.880529 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec2ce1-c149-4605-8530-c7563dceca58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:41.884011 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec2ce1-c149-4605-8530-c7563dceca58 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:41.903613 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 965/1943] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:26:41.910044 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae064db-e9a8-4697-be51-8c62d1199e3a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:41.923069 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae064db-e9a8-4697-be51-8c62d1199e3a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:41.941574 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845185b9-fa0a-41a8-ab8f-8516831d037a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:41.942215 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845185b9-fa0a-41a8-ab8f-8516831d037a admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:41.942520 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845185b9-fa0a-41a8-ab8f-8516831d037a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:41.942855 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845185b9-fa0a-41a8-ab8f-8516831d037a admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:41.943513 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845185b9-fa0a-41a8-ab8f-8516831d037a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:41.945146 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845185b9-fa0a-41a8-ab8f-8516831d037a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:41.960512 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 979/1944] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:26:41.966025 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec2ce1-c149-4605-8530-c7563dceca58 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:41.973027 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:41.978242 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec2ce1-c149-4605-8530-c7563dceca58 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:41.985685 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6efd32-2e48-4324-8a3e-957aa203553a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:41.987136 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6efd32-2e48-4324-8a3e-957aa203553a admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:41.987784 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6efd32-2e48-4324-8a3e-957aa203553a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:41.988660 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6efd32-2e48-4324-8a3e-957aa203553a admin admin] PATH_INFO: `/v3/projects/afb7fa351189479fac9d3e2442a3072c/users/39ac59d5cbb94ad8a7173f1836272aa4/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:42.008554 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6efd32-2e48-4324-8a3e-957aa203553a admin admin] RBAC: Authorizing `identity:create_grant(project_id=afb7fa351189479fac9d3e2442a3072c, user_id=39ac59d5cbb94ad8a7173f1836272aa4, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:42.012173 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6efd32-2e48-4324-8a3e-957aa203553a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:42.032310 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 966/1945] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:26:41 2022] PUT /identity/v3/projects/afb7fa351189479fac9d3e2442a3072c/users/39ac59d5cbb94ad8a7173f1836272aa4/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:26:42.043628 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c76f7-c94c-4318-88fd-b22cf82de33c None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:42.043957 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c76f7-c94c-4318-88fd-b22cf82de33c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:42.044229 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c76f7-c94c-4318-88fd-b22cf82de33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:42.082784 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-b42c76f7-c94c-4318-88fd-b22cf82de33c None None] MFA Rules not processed for user `39ac59d5cbb94ad8a7173f1836272aa4`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:42.084491 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b42c76f7-c94c-4318-88fd-b22cf82de33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:42.177283 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6efd32-2e48-4324-8a3e-957aa203553a admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:42.178455 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 980/1946] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:26:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:26:42.274800 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6efd32-2e48-4324-8a3e-957aa203553a admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:42.280996 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3b6ef-314f-454d-b0a2-33a39287f285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:42.281604 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3b6ef-314f-454d-b0a2-33a39287f285 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:42.281886 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3b6ef-314f-454d-b0a2-33a39287f285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:42.282156 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3b6ef-314f-454d-b0a2-33a39287f285 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:42.282801 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf3b6ef-314f-454d-b0a2-33a39287f285 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:42.284860 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf3b6ef-314f-454d-b0a2-33a39287f285 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:42.318339 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 967/1947] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:26:42 2022] POST /identity/v3/projects => generated 387 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:26:42.322222 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c76f7-c94c-4318-88fd-b22cf82de33c None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:42.334460 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c76f7-c94c-4318-88fd-b22cf82de33c None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:42.404460 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bef591-c458-4911-a100-a115a933026a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:42.405187 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bef591-c458-4911-a100-a115a933026a admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:42.405346 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bef591-c458-4911-a100-a115a933026a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:42.405820 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bef591-c458-4911-a100-a115a933026a admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:42.406630 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bef591-c458-4911-a100-a115a933026a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:42.409442 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bef591-c458-4911-a100-a115a933026a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:42.422674 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:42.442145 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 981/1948] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:26:42 2022] POST /identity/v3/users => generated 300 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:26:42.443727 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3b6ef-314f-454d-b0a2-33a39287f285 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:42.459273 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3b6ef-314f-454d-b0a2-33a39287f285 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:42.474697 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930be65c-fa09-42e7-a4f5-b0d558e1e5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:42.487109 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930be65c-fa09-42e7-a4f5-b0d558e1e5c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:42.487632 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930be65c-fa09-42e7-a4f5-b0d558e1e5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:42.488108 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930be65c-fa09-42e7-a4f5-b0d558e1e5c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:42.491547 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930be65c-fa09-42e7-a4f5-b0d558e1e5c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:42.495999 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930be65c-fa09-42e7-a4f5-b0d558e1e5c9 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:42.543264 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 968/1949] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 13:26:42.544010 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bef591-c458-4911-a100-a115a933026a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:42.561068 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bef591-c458-4911-a100-a115a933026a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:42.570954 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2dc4c-42cb-49a7-a8fe-feaff2fe789a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:42.572584 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2dc4c-42cb-49a7-a8fe-feaff2fe789a admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:42.573211 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2dc4c-42cb-49a7-a8fe-feaff2fe789a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:42.573933 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2dc4c-42cb-49a7-a8fe-feaff2fe789a admin admin] PATH_INFO: `/v3/projects/6c5f3a84284c4e34a38f683dd621c45e/users/5b6e053b03e74b93b2809e4d8fc79aa0/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:42.626825 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce2dc4c-42cb-49a7-a8fe-feaff2fe789a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c5f3a84284c4e34a38f683dd621c45e, user_id=5b6e053b03e74b93b2809e4d8fc79aa0, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:42.631701 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce2dc4c-42cb-49a7-a8fe-feaff2fe789a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:42.663447 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 982/1950] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:26:42 2022] PUT /identity/v3/projects/6c5f3a84284c4e34a38f683dd621c45e/users/5b6e053b03e74b93b2809e4d8fc79aa0/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:26:42.666828 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930be65c-fa09-42e7-a4f5-b0d558e1e5c9 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:42.685848 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930be65c-fa09-42e7-a4f5-b0d558e1e5c9 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:42.834147 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eecd2ef-1e09-4b0e-b63a-5583259990fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:42.834823 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eecd2ef-1e09-4b0e-b63a-5583259990fc admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:42.835372 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eecd2ef-1e09-4b0e-b63a-5583259990fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:42.835372 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eecd2ef-1e09-4b0e-b63a-5583259990fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:42.836066 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eecd2ef-1e09-4b0e-b63a-5583259990fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:42.837874 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eecd2ef-1e09-4b0e-b63a-5583259990fc admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:42.870802 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 969/1951] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:26:42.872996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2dc4c-42cb-49a7-a8fe-feaff2fe789a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:42.917191 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2dc4c-42cb-49a7-a8fe-feaff2fe789a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:42.937903 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b943ef-9d3c-4549-85df-59fdbeb16dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:42.938582 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b943ef-9d3c-4549-85df-59fdbeb16dae admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:42.938978 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b943ef-9d3c-4549-85df-59fdbeb16dae admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:42.939251 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b943ef-9d3c-4549-85df-59fdbeb16dae admin admin] PATH_INFO: `/v3/projects/6c5f3a84284c4e34a38f683dd621c45e/users/5b6e053b03e74b93b2809e4d8fc79aa0/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:42.943880 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b943ef-9d3c-4549-85df-59fdbeb16dae admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c5f3a84284c4e34a38f683dd621c45e, user_id=5b6e053b03e74b93b2809e4d8fc79aa0, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:42.947070 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b943ef-9d3c-4549-85df-59fdbeb16dae admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:42.971762 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 983/1952] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:26:42 2022] PUT /identity/v3/projects/6c5f3a84284c4e34a38f683dd621c45e/users/5b6e053b03e74b93b2809e4d8fc79aa0/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:26:42.983798 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e7d3a-37ee-40e6-b5b8-2ed6a50abeea None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:42.984174 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e7d3a-37ee-40e6-b5b8-2ed6a50abeea None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:42.984453 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e7d3a-37ee-40e6-b5b8-2ed6a50abeea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:43.055904 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-8f7e7d3a-37ee-40e6-b5b8-2ed6a50abeea None None] MFA Rules not processed for user `5b6e053b03e74b93b2809e4d8fc79aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:43.057929 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8f7e7d3a-37ee-40e6-b5b8-2ed6a50abeea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:43.123294 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:43.229811 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 970/1953] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:26:42 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:26:43.243067 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b943ef-9d3c-4549-85df-59fdbeb16dae admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:43.246284 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c8b943ef-9d3c-4549-85df-59fdbeb16dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:43.411915 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b943ef-9d3c-4549-85df-59fdbeb16dae admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:43.417434 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e0d2f-7ae3-4027-b728-d8994f78450e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:43.418354 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e0d2f-7ae3-4027-b728-d8994f78450e service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:43.418861 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e0d2f-7ae3-4027-b728-d8994f78450e service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:43.419391 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e0d2f-7ae3-4027-b728-d8994f78450e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:43.430647 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40e0d2f-7ae3-4027-b728-d8994f78450e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:43.432085 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40e0d2f-7ae3-4027-b728-d8994f78450e service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:43.448853 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 984/1954] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:26:43 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:26:43.539864 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e7d3a-37ee-40e6-b5b8-2ed6a50abeea None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:43.620351 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e7d3a-37ee-40e6-b5b8-2ed6a50abeea None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:43.626645 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c1eec7-0d0a-4e9b-89c1-25cf72d4789b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:43.627625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1eec7-0d0a-4e9b-89c1-25cf72d4789b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:43.628161 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1eec7-0d0a-4e9b-89c1-25cf72d4789b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:43.628582 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1eec7-0d0a-4e9b-89c1-25cf72d4789b admin admin] PATH_INFO: `/v3/users/39ac59d5cbb94ad8a7173f1836272aa4` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:43.630217 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c1eec7-0d0a-4e9b-89c1-25cf72d4789b admin admin] RBAC: Authorizing `identity:delete_user(user_id=39ac59d5cbb94ad8a7173f1836272aa4)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:43.632547 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c1eec7-0d0a-4e9b-89c1-25cf72d4789b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:43.691121 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-03c1eec7-0d0a-4e9b-89c1-25cf72d4789b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39ac59d5cbb94ad8a7173f1836272aa4'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:43.691889 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-03c1eec7-0d0a-4e9b-89c1-25cf72d4789b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39ac59d5cbb94ad8a7173f1836272aa4'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:43.701758 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-03c1eec7-0d0a-4e9b-89c1-25cf72d4789b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39ac59d5cbb94ad8a7173f1836272aa4'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:43.719009 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-03c1eec7-0d0a-4e9b-89c1-25cf72d4789b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39ac59d5cbb94ad8a7173f1836272aa4'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:43.720630 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-03c1eec7-0d0a-4e9b-89c1-25cf72d4789b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39ac59d5cbb94ad8a7173f1836272aa4'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:43.741811 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 971/1955] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:26:43 2022] DELETE /identity/v3/users/39ac59d5cbb94ad8a7173f1836272aa4 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:26:43.743675 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800fdb5-2e82-43f0-b1e8-094a5bcb9c94 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:43.744180 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800fdb5-2e82-43f0-b1e8-094a5bcb9c94 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:43.744601 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800fdb5-2e82-43f0-b1e8-094a5bcb9c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:43.767173 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-3800fdb5-2e82-43f0-b1e8-094a5bcb9c94 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:43.768557 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3800fdb5-2e82-43f0-b1e8-094a5bcb9c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:43.846833 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 985/1956] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:26:43.869281 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c1eec7-0d0a-4e9b-89c1-25cf72d4789b admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:43.871946 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-03c1eec7-0d0a-4e9b-89c1-25cf72d4789b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:44.031331 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c1eec7-0d0a-4e9b-89c1-25cf72d4789b admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:44.062992 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe071ef2-8240-44ea-8ab5-72c09c4369d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:44.063644 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe071ef2-8240-44ea-8ab5-72c09c4369d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:44.066841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe071ef2-8240-44ea-8ab5-72c09c4369d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:44.067755 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe071ef2-8240-44ea-8ab5-72c09c4369d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:44.084550 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe071ef2-8240-44ea-8ab5-72c09c4369d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:44.095797 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe071ef2-8240-44ea-8ab5-72c09c4369d7 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:44.107381 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:44.137577 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 972/1957] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:26:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:26:45.078136 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d8177-d34a-4482-9bf0-4fc57793720d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:45.079394 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d8177-d34a-4482-9bf0-4fc57793720d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:45.080283 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d8177-d34a-4482-9bf0-4fc57793720d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:45.103837 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-c10d8177-d34a-4482-9bf0-4fc57793720d None None] MFA Rules not processed for user `cffe930429614615adc2e63e165b9c45`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:45.105253 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c10d8177-d34a-4482-9bf0-4fc57793720d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:45.206701 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 986/1958] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Oct 27 13:26:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:26:45.258915 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe071ef2-8240-44ea-8ab5-72c09c4369d7 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:45.261120 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-fe071ef2-8240-44ea-8ab5-72c09c4369d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:45.390861 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d8177-d34a-4482-9bf0-4fc57793720d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:45.392525 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c10d8177-d34a-4482-9bf0-4fc57793720d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:45.408040 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe071ef2-8240-44ea-8ab5-72c09c4369d7 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:45.423301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d8177-d34a-4482-9bf0-4fc57793720d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:45.427734 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf573d-4a85-4d5d-9264-16a1eef98a45 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62769acbfca242d6a0b0fe5a6b8bc108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:45.430663 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf573d-4a85-4d5d-9264-16a1eef98a45 service swift] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:45.431594 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf573d-4a85-4d5d-9264-16a1eef98a45 service swift] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:45.432449 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf573d-4a85-4d5d-9264-16a1eef98a45 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:45.436868 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92b122-1773-40a5-a647-510e02636077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:45.439087 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92b122-1773-40a5-a647-510e02636077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:45.439450 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92b122-1773-40a5-a647-510e02636077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:45.440620 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92b122-1773-40a5-a647-510e02636077 admin admin] PATH_INFO: `/v3/projects/afb7fa351189479fac9d3e2442a3072c` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:45.449907 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a92b122-1773-40a5-a647-510e02636077 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afb7fa351189479fac9d3e2442a3072c)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:45.452426 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a92b122-1773-40a5-a647-510e02636077 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:45.458644 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:45.460789 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf573d-4a85-4d5d-9264-16a1eef98a45 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:45.467165 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf573d-4a85-4d5d-9264-16a1eef98a45 service swift] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:45.499871 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 973/1959] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Oct 27 13:26:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 13:26:45.657120 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9a92b122-1773-40a5-a647-510e02636077 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afb7fa351189479fac9d3e2442a3072c', 'request_id': 'req-9a92b122-1773-40a5-a647-510e02636077'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:45.672995 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9a92b122-1773-40a5-a647-510e02636077 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afb7fa351189479fac9d3e2442a3072c', 'request_id': 'req-9a92b122-1773-40a5-a647-510e02636077'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:45.689361 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9a92b122-1773-40a5-a647-510e02636077 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afb7fa351189479fac9d3e2442a3072c', 'request_id': 'req-9a92b122-1773-40a5-a647-510e02636077'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:45.724649 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9a92b122-1773-40a5-a647-510e02636077 admin admin] The token cache is being invalidate because project afb7fa351189479fac9d3e2442a3072c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:26:45.724992 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9a92b122-1773-40a5-a647-510e02636077 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:45.725873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9a92b122-1773-40a5-a647-510e02636077 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:45.733903 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 987/1960] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:26:45 2022] DELETE /identity/v3/projects/afb7fa351189479fac9d3e2442a3072c => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:26:45.735055 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf573d-4a85-4d5d-9264-16a1eef98a45 service swift] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:45.758706 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf573d-4a85-4d5d-9264-16a1eef98a45 service swift] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:45.890814 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25ba4d-07b1-456d-a177-c560e50bfd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:45.891631 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25ba4d-07b1-456d-a177-c560e50bfd3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:45.892072 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25ba4d-07b1-456d-a177-c560e50bfd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:45.892617 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25ba4d-07b1-456d-a177-c560e50bfd3b admin admin] PATH_INFO: `/v3/users/5b6e053b03e74b93b2809e4d8fc79aa0` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:45.894098 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa25ba4d-07b1-456d-a177-c560e50bfd3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b6e053b03e74b93b2809e4d8fc79aa0)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:45.896364 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa25ba4d-07b1-456d-a177-c560e50bfd3b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:46.046955 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-aa25ba4d-07b1-456d-a177-c560e50bfd3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b6e053b03e74b93b2809e4d8fc79aa0'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:46.049947 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-aa25ba4d-07b1-456d-a177-c560e50bfd3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b6e053b03e74b93b2809e4d8fc79aa0'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:46.071709 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-aa25ba4d-07b1-456d-a177-c560e50bfd3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b6e053b03e74b93b2809e4d8fc79aa0'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:46.109281 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-aa25ba4d-07b1-456d-a177-c560e50bfd3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b6e053b03e74b93b2809e4d8fc79aa0'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:46.110210 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-aa25ba4d-07b1-456d-a177-c560e50bfd3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b6e053b03e74b93b2809e4d8fc79aa0'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:46.132630 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 974/1961] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:26:45 2022] DELETE /identity/v3/users/5b6e053b03e74b93b2809e4d8fc79aa0 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:26:46.575391 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10456372-a1b1-4bd8-ad8a-422fcbb940f2 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:46.576056 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10456372-a1b1-4bd8-ad8a-422fcbb940f2 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:46.576056 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10456372-a1b1-4bd8-ad8a-422fcbb940f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:46.617884 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-10456372-a1b1-4bd8-ad8a-422fcbb940f2 None None] MFA Rules not processed for user `cffe930429614615adc2e63e165b9c45`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:46.619127 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-10456372-a1b1-4bd8-ad8a-422fcbb940f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:46.761558 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 988/1962] 10.222.0.52 () {58 vars in 967 bytes} [Thu Oct 27 13:26:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:26:46.782869 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25ba4d-07b1-456d-a177-c560e50bfd3b admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:46.786282 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-aa25ba4d-07b1-456d-a177-c560e50bfd3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:46.811516 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:46.943520 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25ba4d-07b1-456d-a177-c560e50bfd3b admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:46.951257 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76f459-3dae-4a92-9728-a75a4b12274b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62769acbfca242d6a0b0fe5a6b8bc108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:46.951487 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76f459-3dae-4a92-9728-a75a4b12274b service swift] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:46.951765 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76f459-3dae-4a92-9728-a75a4b12274b service swift] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:46.962078 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76f459-3dae-4a92-9728-a75a4b12274b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:46.972982 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba76f459-3dae-4a92-9728-a75a4b12274b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:46.975432 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba76f459-3dae-4a92-9728-a75a4b12274b service swift] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:46.986687 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 975/1963] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Oct 27 13:26:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 13:26:47.360832 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01f279-b104-46df-aa63-b8cddca7dfc4 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:47.361368 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01f279-b104-46df-aa63-b8cddca7dfc4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:47.361844 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01f279-b104-46df-aa63-b8cddca7dfc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:47.398354 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-9f01f279-b104-46df-aa63-b8cddca7dfc4 None None] MFA Rules not processed for user `cffe930429614615adc2e63e165b9c45`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:47.399769 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9f01f279-b104-46df-aa63-b8cddca7dfc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:47.409095 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 989/1964] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Oct 27 13:26:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:26:47.422790 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76f459-3dae-4a92-9728-a75a4b12274b service swift] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:47.436905 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76f459-3dae-4a92-9728-a75a4b12274b service swift] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:47.447003 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad6ebd7-89cf-4310-94af-5393e9ca4936 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62769acbfca242d6a0b0fe5a6b8bc108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:47.447873 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6ebd7-89cf-4310-94af-5393e9ca4936 service swift] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:47.448935 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6ebd7-89cf-4310-94af-5393e9ca4936 service swift] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:47.449351 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6ebd7-89cf-4310-94af-5393e9ca4936 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:47.461716 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad6ebd7-89cf-4310-94af-5393e9ca4936 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:47.466360 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad6ebd7-89cf-4310-94af-5393e9ca4936 service swift] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:47.476159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 976/1965] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Oct 27 13:26:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 13:26:47.663855 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01f279-b104-46df-aa63-b8cddca7dfc4 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:47.665296 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9f01f279-b104-46df-aa63-b8cddca7dfc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:47.824688 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01f279-b104-46df-aa63-b8cddca7dfc4 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:47.834616 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c553ba-bb7b-486f-b809-60c3feb32a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:47.835283 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c553ba-bb7b-486f-b809-60c3feb32a71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:47.835706 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c553ba-bb7b-486f-b809-60c3feb32a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:47.835981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c553ba-bb7b-486f-b809-60c3feb32a71 admin admin] PATH_INFO: `/v3/projects/6c5f3a84284c4e34a38f683dd621c45e` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:47.837659 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c553ba-bb7b-486f-b809-60c3feb32a71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c5f3a84284c4e34a38f683dd621c45e)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:47.840445 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c553ba-bb7b-486f-b809-60c3feb32a71 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:47.902415 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:47.928879 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-26c553ba-bb7b-486f-b809-60c3feb32a71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c5f3a84284c4e34a38f683dd621c45e', 'request_id': 'req-26c553ba-bb7b-486f-b809-60c3feb32a71'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:47.937585 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-26c553ba-bb7b-486f-b809-60c3feb32a71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c5f3a84284c4e34a38f683dd621c45e', 'request_id': 'req-26c553ba-bb7b-486f-b809-60c3feb32a71'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:47.947892 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-26c553ba-bb7b-486f-b809-60c3feb32a71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c5f3a84284c4e34a38f683dd621c45e', 'request_id': 'req-26c553ba-bb7b-486f-b809-60c3feb32a71'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:47.967506 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e88eb4-129a-4dcb-814f-a1f6a92385dd None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:47.967906 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e88eb4-129a-4dcb-814f-a1f6a92385dd None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:47.968411 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e88eb4-129a-4dcb-814f-a1f6a92385dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:47.984918 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-26c553ba-bb7b-486f-b809-60c3feb32a71 admin admin] The token cache is being invalidate because project 6c5f3a84284c4e34a38f683dd621c45e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:26:47.985462 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-26c553ba-bb7b-486f-b809-60c3feb32a71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:47.986481 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-26c553ba-bb7b-486f-b809-60c3feb32a71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:47.989646 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 990/1966] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:26:47 2022] DELETE /identity/v3/projects/6c5f3a84284c4e34a38f683dd621c45e => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:26:47.994113 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedae363-5ff3-4d69-890a-d8014778d135 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:47.994617 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedae363-5ff3-4d69-890a-d8014778d135 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:47.995043 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedae363-5ff3-4d69-890a-d8014778d135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:48.011765 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-d7e88eb4-129a-4dcb-814f-a1f6a92385dd None None] MFA Rules not processed for user `cffe930429614615adc2e63e165b9c45`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:48.013350 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d7e88eb4-129a-4dcb-814f-a1f6a92385dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:48.037554 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-eedae363-5ff3-4d69-890a-d8014778d135 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:48.039206 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-eedae363-5ff3-4d69-890a-d8014778d135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:48.163327 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 991/1967] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:26:48.171854 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a11ae-3d64-4ec3-9eac-6ee7d2be2a77 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:48.172196 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a11ae-3d64-4ec3-9eac-6ee7d2be2a77 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:48.172415 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a11ae-3d64-4ec3-9eac-6ee7d2be2a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:48.214656 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 977/1968] 10.222.0.52 () {58 vars in 967 bytes} [Thu Oct 27 13:26:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:26:48.220598 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d87a11ae-3d64-4ec3-9eac-6ee7d2be2a77 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:48.222445 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d87a11ae-3d64-4ec3-9eac-6ee7d2be2a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:48.239790 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 992/1969] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:26:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:26:48.247306 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e88eb4-129a-4dcb-814f-a1f6a92385dd None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:48.265038 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87a11ae-3d64-4ec3-9eac-6ee7d2be2a77 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:48.272729 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d87a11ae-3d64-4ec3-9eac-6ee7d2be2a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:48.287187 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e88eb4-129a-4dcb-814f-a1f6a92385dd None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:48.310349 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3923c1-98e1-436b-843b-1e96728f36f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:48.315309 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3923c1-98e1-436b-843b-1e96728f36f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:48.318946 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3923c1-98e1-436b-843b-1e96728f36f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:48.319243 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3923c1-98e1-436b-843b-1e96728f36f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:48.319965 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3923c1-98e1-436b-843b-1e96728f36f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:26:48.320278 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3923c1-98e1-436b-843b-1e96728f36f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:48.321970 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3923c1-98e1-436b-843b-1e96728f36f2 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:48.373951 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 978/1970] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:26:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:26:48.383153 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3923c1-98e1-436b-843b-1e96728f36f2 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:48.401690 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3923c1-98e1-436b-843b-1e96728f36f2 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:48.423145 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d872b-a2c9-40ac-b0a3-af38ade8e6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:48.424012 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d872b-a2c9-40ac-b0a3-af38ade8e6be admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:48.424439 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d872b-a2c9-40ac-b0a3-af38ade8e6be admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:48.424857 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d872b-a2c9-40ac-b0a3-af38ade8e6be admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:48.425708 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d872b-a2c9-40ac-b0a3-af38ade8e6be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:48.427805 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d872b-a2c9-40ac-b0a3-af38ade8e6be admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:48.469703 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87a11ae-3d64-4ec3-9eac-6ee7d2be2a77 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:48.475368 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be42a6e-2d96-43db-acc3-cce3a8a6e8ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62769acbfca242d6a0b0fe5a6b8bc108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:48.476327 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be42a6e-2d96-43db-acc3-cce3a8a6e8ef service swift] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:48.476327 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be42a6e-2d96-43db-acc3-cce3a8a6e8ef service swift] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:48.476524 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be42a6e-2d96-43db-acc3-cce3a8a6e8ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:48.494284 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be42a6e-2d96-43db-acc3-cce3a8a6e8ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:48.499046 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be42a6e-2d96-43db-acc3-cce3a8a6e8ef service swift] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:48.506291 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 979/1971] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:26:48 2022] POST /identity/v3/projects => generated 387 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:26:48.510375 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d872b-a2c9-40ac-b0a3-af38ade8e6be admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:48.517973 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 993/1972] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Oct 27 13:26:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 13:26:48.626852 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:48.640351 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d872b-a2c9-40ac-b0a3-af38ade8e6be admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:48.644939 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e45bc6-e69d-4320-ac2b-4c407f5ffd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:48.645688 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e45bc6-e69d-4320-ac2b-4c407f5ffd67 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:48.646064 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e45bc6-e69d-4320-ac2b-4c407f5ffd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:48.646475 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e45bc6-e69d-4320-ac2b-4c407f5ffd67 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:48.647525 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e45bc6-e69d-4320-ac2b-4c407f5ffd67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:48.650200 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e45bc6-e69d-4320-ac2b-4c407f5ffd67 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:48.689428 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 980/1973] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:26:48 2022] POST /identity/v3/users => generated 294 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:26:48.690894 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be42a6e-2d96-43db-acc3-cce3a8a6e8ef service swift] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:48.710148 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be42a6e-2d96-43db-acc3-cce3a8a6e8ef service swift] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:48.716356 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c5d11-6768-48d0-8b7b-63b5a74f6e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:48.716983 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c5d11-6768-48d0-8b7b-63b5a74f6e52 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:48.717267 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c5d11-6768-48d0-8b7b-63b5a74f6e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:48.717682 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c5d11-6768-48d0-8b7b-63b5a74f6e52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:48.718337 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c5d11-6768-48d0-8b7b-63b5a74f6e52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:48.719953 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c5d11-6768-48d0-8b7b-63b5a74f6e52 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:48.756494 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 994/1974] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:26:48.759993 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e45bc6-e69d-4320-ac2b-4c407f5ffd67 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:48.772987 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e45bc6-e69d-4320-ac2b-4c407f5ffd67 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:48.779071 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef4dce-cb06-4810-8e85-8b987108911d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:48.779704 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef4dce-cb06-4810-8e85-8b987108911d admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:48.780121 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef4dce-cb06-4810-8e85-8b987108911d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:48.780395 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef4dce-cb06-4810-8e85-8b987108911d admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:48.782064 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef4dce-cb06-4810-8e85-8b987108911d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:48.783363 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef4dce-cb06-4810-8e85-8b987108911d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:48.809723 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 981/1975] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:26:48.816054 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c5d11-6768-48d0-8b7b-63b5a74f6e52 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:48.827902 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c5d11-6768-48d0-8b7b-63b5a74f6e52 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:48.833124 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e88ad1-4a85-4d67-8fbc-6f734935ecb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:48.834113 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e88ad1-4a85-4d67-8fbc-6f734935ecb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:48.834473 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e88ad1-4a85-4d67-8fbc-6f734935ecb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:48.834822 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e88ad1-4a85-4d67-8fbc-6f734935ecb8 admin admin] PATH_INFO: `/v3/projects/25680aa146824fd4944f3aefd9b02ce4/users/3308aefb992444a5b768c3336f76760c/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:48.855720 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e88ad1-4a85-4d67-8fbc-6f734935ecb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25680aa146824fd4944f3aefd9b02ce4, user_id=3308aefb992444a5b768c3336f76760c, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:48.858933 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e88ad1-4a85-4d67-8fbc-6f734935ecb8 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:48.880735 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 995/1976] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:26:48 2022] PUT /identity/v3/projects/25680aa146824fd4944f3aefd9b02ce4/users/3308aefb992444a5b768c3336f76760c/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:26:48.891647 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ca4e7-367f-4ee0-8d98-b26dcad3f0c1 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:48.891947 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ca4e7-367f-4ee0-8d98-b26dcad3f0c1 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:48.892205 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ca4e7-367f-4ee0-8d98-b26dcad3f0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:48.949314 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-5c8ca4e7-367f-4ee0-8d98-b26dcad3f0c1 None None] MFA Rules not processed for user `3308aefb992444a5b768c3336f76760c`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:48.950783 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5c8ca4e7-367f-4ee0-8d98-b26dcad3f0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:49.058725 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 982/1977] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:26:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:26:49.059664 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e88ad1-4a85-4d67-8fbc-6f734935ecb8 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:49.081971 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:49.164674 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e88ad1-4a85-4d67-8fbc-6f734935ecb8 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:49.169804 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541fef3a-dc06-4ca5-80d7-09f099a51e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:49.170426 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fef3a-dc06-4ca5-80d7-09f099a51e96 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:49.171661 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fef3a-dc06-4ca5-80d7-09f099a51e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:49.171991 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fef3a-dc06-4ca5-80d7-09f099a51e96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:49.172704 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541fef3a-dc06-4ca5-80d7-09f099a51e96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:49.174728 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541fef3a-dc06-4ca5-80d7-09f099a51e96 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:49.221631 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 996/1978] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:26:49 2022] POST /identity/v3/projects => generated 387 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:26:49.225852 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ca4e7-367f-4ee0-8d98-b26dcad3f0c1 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:49.239741 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ca4e7-367f-4ee0-8d98-b26dcad3f0c1 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:49.315381 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c3567-6b39-45f2-8cd0-5f3b87d393ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:49.316075 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c3567-6b39-45f2-8cd0-5f3b87d393ab admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:49.316533 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c3567-6b39-45f2-8cd0-5f3b87d393ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:49.316816 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c3567-6b39-45f2-8cd0-5f3b87d393ab admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:49.317453 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c3567-6b39-45f2-8cd0-5f3b87d393ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:49.319431 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c3567-6b39-45f2-8cd0-5f3b87d393ab admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:49.357319 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541fef3a-dc06-4ca5-80d7-09f099a51e96 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:49.357718 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 983/1979] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:26:49 2022] POST /identity/v3/users => generated 294 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:26:49.380188 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541fef3a-dc06-4ca5-80d7-09f099a51e96 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:49.388734 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64058117-a861-491f-9cab-9c0b203a5f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:49.389840 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64058117-a861-491f-9cab-9c0b203a5f1d admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:49.390233 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64058117-a861-491f-9cab-9c0b203a5f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:49.390729 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64058117-a861-491f-9cab-9c0b203a5f1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:49.391506 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64058117-a861-491f-9cab-9c0b203a5f1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:49.394126 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64058117-a861-491f-9cab-9c0b203a5f1d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:49.420340 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 997/1980] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 13:26:49.425110 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c3567-6b39-45f2-8cd0-5f3b87d393ab admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:49.437123 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c3567-6b39-45f2-8cd0-5f3b87d393ab admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:49.442605 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8d7da-ba57-4ce2-9159-8777ccde3b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:49.443541 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8d7da-ba57-4ce2-9159-8777ccde3b15 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:49.444111 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8d7da-ba57-4ce2-9159-8777ccde3b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:49.444663 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8d7da-ba57-4ce2-9159-8777ccde3b15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:49.445591 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8d7da-ba57-4ce2-9159-8777ccde3b15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:49.447602 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8d7da-ba57-4ce2-9159-8777ccde3b15 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:49.464357 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 984/1981] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:26:49.466309 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64058117-a861-491f-9cab-9c0b203a5f1d admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:49.479879 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64058117-a861-491f-9cab-9c0b203a5f1d admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:49.483946 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab7dcb-325f-426e-b277-57a4dcd8c6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:49.484892 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab7dcb-325f-426e-b277-57a4dcd8c6dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:49.485357 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab7dcb-325f-426e-b277-57a4dcd8c6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:49.485774 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab7dcb-325f-426e-b277-57a4dcd8c6dd admin admin] PATH_INFO: `/v3/projects/1952faff04e34e2aab075a7adb24baab/users/30204e81518e40a0a0c0dda5d1a580a5/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:49.505501 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab7dcb-325f-426e-b277-57a4dcd8c6dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1952faff04e34e2aab075a7adb24baab, user_id=30204e81518e40a0a0c0dda5d1a580a5, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:49.512494 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab7dcb-325f-426e-b277-57a4dcd8c6dd admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:49.537066 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 998/1982] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:26:49 2022] PUT /identity/v3/projects/1952faff04e34e2aab075a7adb24baab/users/30204e81518e40a0a0c0dda5d1a580a5/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:26:49.551527 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28c1f9-4d31-480e-baee-df44211fc2a7 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:49.551894 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28c1f9-4d31-480e-baee-df44211fc2a7 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:49.552253 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28c1f9-4d31-480e-baee-df44211fc2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:49.616757 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-ea28c1f9-4d31-480e-baee-df44211fc2a7 None None] MFA Rules not processed for user `30204e81518e40a0a0c0dda5d1a580a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:49.618048 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ea28c1f9-4d31-480e-baee-df44211fc2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:49.654258 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab7dcb-325f-426e-b277-57a4dcd8c6dd admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:49.659195 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-83ab7dcb-325f-426e-b277-57a4dcd8c6dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:49.692776 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:49.793761 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 985/1983] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:26:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:26:49.794732 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28c1f9-4d31-480e-baee-df44211fc2a7 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:49.850583 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab7dcb-325f-426e-b277-57a4dcd8c6dd admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:49.858980 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9aa20-ef52-4551-97b1-82096e4e7ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:49.859670 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9aa20-ef52-4551-97b1-82096e4e7ee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:49.859962 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9aa20-ef52-4551-97b1-82096e4e7ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:49.860338 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9aa20-ef52-4551-97b1-82096e4e7ee1 admin admin] PATH_INFO: `/v3/users/beaa55c832594b9a873b802efe381e97` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:49.861516 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc9aa20-ef52-4551-97b1-82096e4e7ee1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=beaa55c832594b9a873b802efe381e97)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:49.864782 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc9aa20-ef52-4551-97b1-82096e4e7ee1 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:49.900218 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28c1f9-4d31-480e-baee-df44211fc2a7 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:49.909757 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936df080-59d5-4419-8541-77b052ce034c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:49.910736 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936df080-59d5-4419-8541-77b052ce034c admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:49.911162 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936df080-59d5-4419-8541-77b052ce034c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:49.911437 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936df080-59d5-4419-8541-77b052ce034c admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:49.912223 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936df080-59d5-4419-8541-77b052ce034c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:49.914954 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936df080-59d5-4419-8541-77b052ce034c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:49.948491 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1bc9aa20-ef52-4551-97b1-82096e4e7ee1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beaa55c832594b9a873b802efe381e97'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:49.956413 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1bc9aa20-ef52-4551-97b1-82096e4e7ee1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beaa55c832594b9a873b802efe381e97'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:49.982279 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 986/1984] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:26:49 2022] POST /identity/v3/projects => generated 385 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:26:49.983396 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1bc9aa20-ef52-4551-97b1-82096e4e7ee1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beaa55c832594b9a873b802efe381e97'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:49.988530 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:49.988714 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936df080-59d5-4419-8541-77b052ce034c admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:49.992489 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-936df080-59d5-4419-8541-77b052ce034c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:50.037474 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1bc9aa20-ef52-4551-97b1-82096e4e7ee1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beaa55c832594b9a873b802efe381e97'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:50.052105 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1bc9aa20-ef52-4551-97b1-82096e4e7ee1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beaa55c832594b9a873b802efe381e97'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:50.091628 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 999/1985] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:26:49 2022] DELETE /identity/v3/users/beaa55c832594b9a873b802efe381e97 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:26:50.164433 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936df080-59d5-4419-8541-77b052ce034c admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:50.250366 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5721fd-fbab-4b49-9c70-e1fad29a4c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:50.251122 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5721fd-fbab-4b49-9c70-e1fad29a4c97 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:50.251462 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5721fd-fbab-4b49-9c70-e1fad29a4c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:50.251803 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5721fd-fbab-4b49-9c70-e1fad29a4c97 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:50.252514 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5721fd-fbab-4b49-9c70-e1fad29a4c97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:50.254640 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5721fd-fbab-4b49-9c70-e1fad29a4c97 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:50.265483 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:50.290453 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 987/1986] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:26:49 2022] POST /identity/v3/users => generated 299 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:26:50.294243 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9aa20-ef52-4551-97b1-82096e4e7ee1 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:50.309759 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9aa20-ef52-4551-97b1-82096e4e7ee1 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:50.320128 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ab3fb-fe9c-4dc0-b91e-a69a97b28061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:50.320364 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ab3fb-fe9c-4dc0-b91e-a69a97b28061 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:50.320656 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ab3fb-fe9c-4dc0-b91e-a69a97b28061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:50.321015 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ab3fb-fe9c-4dc0-b91e-a69a97b28061 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:50.321805 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ab3fb-fe9c-4dc0-b91e-a69a97b28061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:50.323714 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ab3fb-fe9c-4dc0-b91e-a69a97b28061 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:50.335335 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1000/1987] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:26:50.340997 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5721fd-fbab-4b49-9c70-e1fad29a4c97 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:50.357252 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5721fd-fbab-4b49-9c70-e1fad29a4c97 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:50.363497 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3480e9-4771-4756-b198-ef7941785724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:50.364518 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3480e9-4771-4756-b198-ef7941785724 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:50.364861 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3480e9-4771-4756-b198-ef7941785724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:50.365199 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3480e9-4771-4756-b198-ef7941785724 admin admin] PATH_INFO: `/v3/projects/81d871b49fda46f4aead62f4bd9fa528/users/54040ed76b1d4a469190021b1e308f89/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:50.386867 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3480e9-4771-4756-b198-ef7941785724 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81d871b49fda46f4aead62f4bd9fa528, user_id=54040ed76b1d4a469190021b1e308f89, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:50.389820 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3480e9-4771-4756-b198-ef7941785724 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:50.417726 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 988/1988] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:26:50 2022] PUT /identity/v3/projects/81d871b49fda46f4aead62f4bd9fa528/users/54040ed76b1d4a469190021b1e308f89/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:26:50.421515 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ab3fb-fe9c-4dc0-b91e-a69a97b28061 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:50.432003 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ab3fb-fe9c-4dc0-b91e-a69a97b28061 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:50.500076 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3480e9-4771-4756-b198-ef7941785724 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:50.501841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2a3480e9-4771-4756-b198-ef7941785724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:50.507659 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b8a5b2-e5f3-4a30-b7ef-158d4877ff71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:50.508287 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8a5b2-e5f3-4a30-b7ef-158d4877ff71 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:50.508568 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8a5b2-e5f3-4a30-b7ef-158d4877ff71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:50.508915 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8a5b2-e5f3-4a30-b7ef-158d4877ff71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:50.509481 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b8a5b2-e5f3-4a30-b7ef-158d4877ff71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:50.511205 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b8a5b2-e5f3-4a30-b7ef-158d4877ff71 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:50.533601 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1001/1989] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:26:50.535686 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b8a5b2-e5f3-4a30-b7ef-158d4877ff71 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:50.546445 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3480e9-4771-4756-b198-ef7941785724 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:50.553783 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b8a5b2-e5f3-4a30-b7ef-158d4877ff71 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:50.559435 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86155e4a-63be-422a-8b82-d7edc716d411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:50.560426 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86155e4a-63be-422a-8b82-d7edc716d411 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:50.561268 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86155e4a-63be-422a-8b82-d7edc716d411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:50.561826 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86155e4a-63be-422a-8b82-d7edc716d411 admin admin] PATH_INFO: `/v3/projects/81d871b49fda46f4aead62f4bd9fa528/users/54040ed76b1d4a469190021b1e308f89/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:50.565670 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86155e4a-63be-422a-8b82-d7edc716d411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81d871b49fda46f4aead62f4bd9fa528, user_id=54040ed76b1d4a469190021b1e308f89, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:50.569565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c23b4d4-534c-4e61-a42f-670abf565f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:50.570307 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23b4d4-534c-4e61-a42f-670abf565f4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:50.570664 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23b4d4-534c-4e61-a42f-670abf565f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:50.571076 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23b4d4-534c-4e61-a42f-670abf565f4c admin admin] PATH_INFO: `/v3/projects/62b96c940c24456abbcc0811f7b0507d` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:50.571359 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86155e4a-63be-422a-8b82-d7edc716d411 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:50.572770 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c23b4d4-534c-4e61-a42f-670abf565f4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=62b96c940c24456abbcc0811f7b0507d)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:50.575605 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c23b4d4-534c-4e61-a42f-670abf565f4c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:50.592966 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1002/1990] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:26:50 2022] PUT /identity/v3/projects/81d871b49fda46f4aead62f4bd9fa528/users/54040ed76b1d4a469190021b1e308f89/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:26:50.603911 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185516f-d5cb-40e1-bddb-f08c3ee5082d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:50.604195 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185516f-d5cb-40e1-bddb-f08c3ee5082d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:50.604576 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185516f-d5cb-40e1-bddb-f08c3ee5082d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:50.638173 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-a185516f-d5cb-40e1-bddb-f08c3ee5082d None None] MFA Rules not processed for user `54040ed76b1d4a469190021b1e308f89`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:50.639445 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a185516f-d5cb-40e1-bddb-f08c3ee5082d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:50.657872 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-8c23b4d4-534c-4e61-a42f-670abf565f4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62b96c940c24456abbcc0811f7b0507d', 'request_id': 'req-8c23b4d4-534c-4e61-a42f-670abf565f4c'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:50.668699 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-8c23b4d4-534c-4e61-a42f-670abf565f4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62b96c940c24456abbcc0811f7b0507d', 'request_id': 'req-8c23b4d4-534c-4e61-a42f-670abf565f4c'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:50.679822 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-8c23b4d4-534c-4e61-a42f-670abf565f4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62b96c940c24456abbcc0811f7b0507d', 'request_id': 'req-8c23b4d4-534c-4e61-a42f-670abf565f4c'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:50.697182 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-8c23b4d4-534c-4e61-a42f-670abf565f4c admin admin] The token cache is being invalidate because project 62b96c940c24456abbcc0811f7b0507d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:26:50.698463 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-8c23b4d4-534c-4e61-a42f-670abf565f4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:50.699514 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-8c23b4d4-534c-4e61-a42f-670abf565f4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:50.702318 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 989/1991] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:26:50 2022] DELETE /identity/v3/projects/62b96c940c24456abbcc0811f7b0507d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:26:50.710046 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a1381-5801-4698-a412-af10781cdec6 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:50.710627 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a1381-5801-4698-a412-af10781cdec6 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:50.711254 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a1381-5801-4698-a412-af10781cdec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:50.739285 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1003/1992] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:26:50 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:26:50.743009 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-124a1381-5801-4698-a412-af10781cdec6 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:50.745895 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-124a1381-5801-4698-a412-af10781cdec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:50.752513 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185516f-d5cb-40e1-bddb-f08c3ee5082d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:50.754284 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a185516f-d5cb-40e1-bddb-f08c3ee5082d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:50.831728 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:50.858799 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 990/1993] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:26:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:26:50.865875 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185516f-d5cb-40e1-bddb-f08c3ee5082d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:50.867614 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33b5fa-6f56-4ab7-b015-4d4a50bf12fc None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:50.868183 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33b5fa-6f56-4ab7-b015-4d4a50bf12fc None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:50.868669 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33b5fa-6f56-4ab7-b015-4d4a50bf12fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:50.871465 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb21a8-5aa6-49c6-b5cf-f82f27485a74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:50.872081 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb21a8-5aa6-49c6-b5cf-f82f27485a74 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:50.872362 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb21a8-5aa6-49c6-b5cf-f82f27485a74 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:50.872635 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb21a8-5aa6-49c6-b5cf-f82f27485a74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:50.885926 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fb21a8-5aa6-49c6-b5cf-f82f27485a74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:50.887643 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fb21a8-5aa6-49c6-b5cf-f82f27485a74 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:50.894501 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-2b33b5fa-6f56-4ab7-b015-4d4a50bf12fc None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:50.896483 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2b33b5fa-6f56-4ab7-b015-4d4a50bf12fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:50.899375 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1004/1994] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:26:50 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:26:50.917713 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 991/1995] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:26:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:26:50.920680 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb21a8-5aa6-49c6-b5cf-f82f27485a74 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:50.932738 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb21a8-5aa6-49c6-b5cf-f82f27485a74 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:50.939235 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef12113-8f21-42f8-ad9b-887c78413a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:50.940339 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef12113-8f21-42f8-ad9b-887c78413a58 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:50.940855 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef12113-8f21-42f8-ad9b-887c78413a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:50.941460 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef12113-8f21-42f8-ad9b-887c78413a58 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:50.941914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef12113-8f21-42f8-ad9b-887c78413a58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:26:50.942224 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef12113-8f21-42f8-ad9b-887c78413a58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:50.943887 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef12113-8f21-42f8-ad9b-887c78413a58 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:50.958617 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1005/1996] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:26:50.962856 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33b5fa-6f56-4ab7-b015-4d4a50bf12fc None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:50.973191 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33b5fa-6f56-4ab7-b015-4d4a50bf12fc None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:50.978358 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfae4d6-fc78-4bcc-bc1b-8a508e4bf39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:50.979059 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfae4d6-fc78-4bcc-bc1b-8a508e4bf39c admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:50.979490 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfae4d6-fc78-4bcc-bc1b-8a508e4bf39c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:50.979840 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfae4d6-fc78-4bcc-bc1b-8a508e4bf39c admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:50.980755 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfae4d6-fc78-4bcc-bc1b-8a508e4bf39c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:50.983033 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfae4d6-fc78-4bcc-bc1b-8a508e4bf39c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:51.024656 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 992/1997] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:26:50 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:26:51.025836 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef12113-8f21-42f8-ad9b-887c78413a58 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:51.037158 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef12113-8f21-42f8-ad9b-887c78413a58 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:51.150320 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59461c28-c12a-4a9e-b6dc-bb9a9a7a4d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:51.151089 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59461c28-c12a-4a9e-b6dc-bb9a9a7a4d99 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:51.151570 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59461c28-c12a-4a9e-b6dc-bb9a9a7a4d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:51.151853 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59461c28-c12a-4a9e-b6dc-bb9a9a7a4d99 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:51.152517 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59461c28-c12a-4a9e-b6dc-bb9a9a7a4d99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:51.154459 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59461c28-c12a-4a9e-b6dc-bb9a9a7a4d99 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:51.187877 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfae4d6-fc78-4bcc-bc1b-8a508e4bf39c admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:51.190249 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-9cfae4d6-fc78-4bcc-bc1b-8a508e4bf39c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:51.208984 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfae4d6-fc78-4bcc-bc1b-8a508e4bf39c admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:51.214002 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1006/1998] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:26:51 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:26:51.214838 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff1195-9748-41c2-b8c0-109363d111bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:51.215663 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff1195-9748-41c2-b8c0-109363d111bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:51.216072 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff1195-9748-41c2-b8c0-109363d111bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:51.216471 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff1195-9748-41c2-b8c0-109363d111bd admin admin] PATH_INFO: `/v3/users/eba314c4d44b496a81b3c05201726760` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:51.218198 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff1195-9748-41c2-b8c0-109363d111bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=eba314c4d44b496a81b3c05201726760)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:51.220422 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59461c28-c12a-4a9e-b6dc-bb9a9a7a4d99 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:51.222139 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff1195-9748-41c2-b8c0-109363d111bd admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:51.242663 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59461c28-c12a-4a9e-b6dc-bb9a9a7a4d99 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:51.251001 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731fb00f-32ef-452b-a625-8aba22d5a460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:51.252331 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731fb00f-32ef-452b-a625-8aba22d5a460 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:51.252864 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731fb00f-32ef-452b-a625-8aba22d5a460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:51.253142 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731fb00f-32ef-452b-a625-8aba22d5a460 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:51.253916 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731fb00f-32ef-452b-a625-8aba22d5a460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:51.257483 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731fb00f-32ef-452b-a625-8aba22d5a460 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:51.275883 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1007/1999] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:26:51.279296 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:INSERT=5,keystone:SELECT=87,keystone:DELETE=8 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:51.280913 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508d728-ae2d-459a-aea5-d415ef73a4c4 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:51.281409 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508d728-ae2d-459a-aea5-d415ef73a4c4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:51.282077 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508d728-ae2d-459a-aea5-d415ef73a4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:51.304283 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-0508d728-ae2d-459a-aea5-d415ef73a4c4 None None] MFA Rules not processed for user `946833c2a74f46528ec7c12cfef4e1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:51.305825 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0508d728-ae2d-459a-aea5-d415ef73a4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:51.337151 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-64ff1195-9748-41c2-b8c0-109363d111bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eba314c4d44b496a81b3c05201726760'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:51.338335 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-64ff1195-9748-41c2-b8c0-109363d111bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eba314c4d44b496a81b3c05201726760'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:51.348581 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-64ff1195-9748-41c2-b8c0-109363d111bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eba314c4d44b496a81b3c05201726760'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:51.366285 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-64ff1195-9748-41c2-b8c0-109363d111bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eba314c4d44b496a81b3c05201726760'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:51.367393 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-64ff1195-9748-41c2-b8c0-109363d111bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eba314c4d44b496a81b3c05201726760'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:51.377294 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1008/2000] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:26:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:26:51.382274 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508d728-ae2d-459a-aea5-d415ef73a4c4 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:51.382274 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0508d728-ae2d-459a-aea5-d415ef73a4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:51.390075 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 993/2001] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:26:51 2022] DELETE /identity/v3/users/eba314c4d44b496a81b3c05201726760 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:26:51.395172 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5bb83-9eca-49f0-af70-80fa2a382ff0 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:51.395645 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5bb83-9eca-49f0-af70-80fa2a382ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:51.396065 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5bb83-9eca-49f0-af70-80fa2a382ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:51.397593 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508d728-ae2d-459a-aea5-d415ef73a4c4 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:51.423373 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-86f5bb83-9eca-49f0-af70-80fa2a382ff0 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:51.425627 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-86f5bb83-9eca-49f0-af70-80fa2a382ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:51.502067 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:51.521572 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 994/2002] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:26:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:26:51.531241 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5bb83-9eca-49f0-af70-80fa2a382ff0 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:51.532670 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-86f5bb83-9eca-49f0-af70-80fa2a382ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:51.548668 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23833659-1fe0-4bbb-8dbf-f0e7ad12532e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:51.549358 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23833659-1fe0-4bbb-8dbf-f0e7ad12532e admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:51.549695 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23833659-1fe0-4bbb-8dbf-f0e7ad12532e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:51.549964 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23833659-1fe0-4bbb-8dbf-f0e7ad12532e admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:51.551039 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23833659-1fe0-4bbb-8dbf-f0e7ad12532e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:51.552989 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23833659-1fe0-4bbb-8dbf-f0e7ad12532e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:51.567984 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1009/2003] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:26:51.573824 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23833659-1fe0-4bbb-8dbf-f0e7ad12532e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:51.585279 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23833659-1fe0-4bbb-8dbf-f0e7ad12532e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:51.590571 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc20d9-6060-4361-bd11-74ef1bed8d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:51.591239 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc20d9-6060-4361-bd11-74ef1bed8d97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:51.591670 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc20d9-6060-4361-bd11-74ef1bed8d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:51.591781 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc20d9-6060-4361-bd11-74ef1bed8d97 admin admin] PATH_INFO: `/v3/projects/895817ad14814e3bbfc199c2bc7eb39e/users/c937e0b3cf994041af4b96f9abe0fc59/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:51.616589 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc20d9-6060-4361-bd11-74ef1bed8d97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=895817ad14814e3bbfc199c2bc7eb39e, user_id=c937e0b3cf994041af4b96f9abe0fc59, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:51.619291 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc20d9-6060-4361-bd11-74ef1bed8d97 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:51.648748 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1010/2004] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:26:51 2022] PUT /identity/v3/projects/895817ad14814e3bbfc199c2bc7eb39e/users/c937e0b3cf994041af4b96f9abe0fc59/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:26:51.650427 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0197dd5-ee45-4d25-9db7-d24e7bfa7d24 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:51.650710 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0197dd5-ee45-4d25-9db7-d24e7bfa7d24 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:51.650983 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0197dd5-ee45-4d25-9db7-d24e7bfa7d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:51.652806 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5bb83-9eca-49f0-af70-80fa2a382ff0 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:51.673843 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-c0197dd5-ee45-4d25-9db7-d24e7bfa7d24 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:51.675649 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c0197dd5-ee45-4d25-9db7-d24e7bfa7d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:51.733798 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b41714-e93d-499d-9ad9-8cdf15dcad43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:51.734430 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b41714-e93d-499d-9ad9-8cdf15dcad43 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:51.734710 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b41714-e93d-499d-9ad9-8cdf15dcad43 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:51.734982 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b41714-e93d-499d-9ad9-8cdf15dcad43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:51.739562 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:51.753157 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1011/2005] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:26:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:26:51.754981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0197dd5-ee45-4d25-9db7-d24e7bfa7d24 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:51.756771 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c0197dd5-ee45-4d25-9db7-d24e7bfa7d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:51.836318 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0197dd5-ee45-4d25-9db7-d24e7bfa7d24 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:51.840450 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa3672a-67d4-4ebd-acbb-15a0f911cd4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:51.840975 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3672a-67d4-4ebd-acbb-15a0f911cd4b service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:51.841264 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3672a-67d4-4ebd-acbb-15a0f911cd4b service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:51.841559 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3672a-67d4-4ebd-acbb-15a0f911cd4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:51.843386 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0fa3672a-67d4-4ebd-acbb-15a0f911cd4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:51.862261 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b41714-e93d-499d-9ad9-8cdf15dcad43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:51.863848 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b41714-e93d-499d-9ad9-8cdf15dcad43 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:51.877318 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 995/2006] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:26:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:26:51.878552 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b41714-e93d-499d-9ad9-8cdf15dcad43 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:51.879875 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e9b41714-e93d-499d-9ad9-8cdf15dcad43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:51.896170 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b41714-e93d-499d-9ad9-8cdf15dcad43 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:51.904789 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ccea0f-8ce5-4301-89ba-683fbf2edfa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:51.905422 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccea0f-8ce5-4301-89ba-683fbf2edfa2 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:51.905744 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccea0f-8ce5-4301-89ba-683fbf2edfa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:51.908391 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccea0f-8ce5-4301-89ba-683fbf2edfa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:51.926815 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa3672a-67d4-4ebd-acbb-15a0f911cd4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:51.928471 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa3672a-67d4-4ebd-acbb-15a0f911cd4b service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:51.930971 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ccea0f-8ce5-4301-89ba-683fbf2edfa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:51.934395 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ccea0f-8ce5-4301-89ba-683fbf2edfa2 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:51.943627 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1012/2007] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:26:51 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:26:51.957418 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 996/2008] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:26:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:26:52.319314 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa3672a-67d4-4ebd-acbb-15a0f911cd4b service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:52.321804 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0fa3672a-67d4-4ebd-acbb-15a0f911cd4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:52.359756 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa3672a-67d4-4ebd-acbb-15a0f911cd4b service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:52.372687 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac797ff-9c3a-49a9-86b3-11d1a2ed0010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:52.375813 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac797ff-9c3a-49a9-86b3-11d1a2ed0010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:52.376102 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac797ff-9c3a-49a9-86b3-11d1a2ed0010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:52.407300 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac797ff-9c3a-49a9-86b3-11d1a2ed0010 admin admin] PATH_INFO: `/v3/projects/7d97b01a08d04a7387eacb4807c0f3f8` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:52.413258 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac797ff-9c3a-49a9-86b3-11d1a2ed0010 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d97b01a08d04a7387eacb4807c0f3f8)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:52.415329 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac797ff-9c3a-49a9-86b3-11d1a2ed0010 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:52.451444 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:52.591341 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-cac797ff-9c3a-49a9-86b3-11d1a2ed0010 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d97b01a08d04a7387eacb4807c0f3f8', 'request_id': 'req-cac797ff-9c3a-49a9-86b3-11d1a2ed0010'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:52.600425 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-cac797ff-9c3a-49a9-86b3-11d1a2ed0010 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d97b01a08d04a7387eacb4807c0f3f8', 'request_id': 'req-cac797ff-9c3a-49a9-86b3-11d1a2ed0010'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:52.608145 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-cac797ff-9c3a-49a9-86b3-11d1a2ed0010 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d97b01a08d04a7387eacb4807c0f3f8', 'request_id': 'req-cac797ff-9c3a-49a9-86b3-11d1a2ed0010'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:52.645434 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-cac797ff-9c3a-49a9-86b3-11d1a2ed0010 admin admin] The token cache is being invalidate because project 7d97b01a08d04a7387eacb4807c0f3f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:26:52.645784 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-cac797ff-9c3a-49a9-86b3-11d1a2ed0010 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:52.647968 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-cac797ff-9c3a-49a9-86b3-11d1a2ed0010 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:52.653584 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1013/2009] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:26:52 2022] DELETE /identity/v3/projects/7d97b01a08d04a7387eacb4807c0f3f8 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:26:56.733935 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ccea0f-8ce5-4301-89ba-683fbf2edfa2 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:56.735439 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-12ccea0f-8ce5-4301-89ba-683fbf2edfa2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:56.749903 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ccea0f-8ce5-4301-89ba-683fbf2edfa2 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:56.847981 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987cd610-702e-453b-8e11-527f63522c49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:56.849542 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987cd610-702e-453b-8e11-527f63522c49 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:56.850601 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987cd610-702e-453b-8e11-527f63522c49 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:56.850956 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987cd610-702e-453b-8e11-527f63522c49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:56.854628 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-987cd610-702e-453b-8e11-527f63522c49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:56.961657 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987cd610-702e-453b-8e11-527f63522c49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:56.964257 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987cd610-702e-453b-8e11-527f63522c49 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:56.975323 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 997/2010] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:26:56 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:26:59.494723 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac797ff-9c3a-49a9-86b3-11d1a2ed0010 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:59.496343 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cac797ff-9c3a-49a9-86b3-11d1a2ed0010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:59.586846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac797ff-9c3a-49a9-86b3-11d1a2ed0010 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:59.592035 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364f0c9-cfe9-4d2e-9d49-720067dc91a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:59.592732 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364f0c9-cfe9-4d2e-9d49-720067dc91a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:59.593072 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364f0c9-cfe9-4d2e-9d49-720067dc91a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:59.593403 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364f0c9-cfe9-4d2e-9d49-720067dc91a6 admin admin] PATH_INFO: `/v3/users/3308aefb992444a5b768c3336f76760c` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:59.594740 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9364f0c9-cfe9-4d2e-9d49-720067dc91a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3308aefb992444a5b768c3336f76760c)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:59.596674 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9364f0c9-cfe9-4d2e-9d49-720067dc91a6 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:59.652155 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9364f0c9-cfe9-4d2e-9d49-720067dc91a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3308aefb992444a5b768c3336f76760c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:59.652395 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9364f0c9-cfe9-4d2e-9d49-720067dc91a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3308aefb992444a5b768c3336f76760c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:59.663292 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9364f0c9-cfe9-4d2e-9d49-720067dc91a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3308aefb992444a5b768c3336f76760c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:59.676773 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9364f0c9-cfe9-4d2e-9d49-720067dc91a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3308aefb992444a5b768c3336f76760c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:59.677514 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9364f0c9-cfe9-4d2e-9d49-720067dc91a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3308aefb992444a5b768c3336f76760c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:26:59.695721 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1014/2011] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:26:59 2022] DELETE /identity/v3/users/3308aefb992444a5b768c3336f76760c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:26:59.700095 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee29073-a742-4143-8ce0-cc5919e129ab None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:59.700642 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee29073-a742-4143-8ce0-cc5919e129ab None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:59.700642 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee29073-a742-4143-8ce0-cc5919e129ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:59.725609 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-cee29073-a742-4143-8ce0-cc5919e129ab None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:26:59.726855 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-cee29073-a742-4143-8ce0-cc5919e129ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:59.778635 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:59.820093 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 998/2012] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:26:59.827012 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364f0c9-cfe9-4d2e-9d49-720067dc91a6 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:26:59.828507 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9364f0c9-cfe9-4d2e-9d49-720067dc91a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:26:59.849311 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:59.913692 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364f0c9-cfe9-4d2e-9d49-720067dc91a6 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:26:59.921700 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea3d55-9586-445c-89a0-9155e121ac92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:26:59.922336 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea3d55-9586-445c-89a0-9155e121ac92 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:26:59.922612 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea3d55-9586-445c-89a0-9155e121ac92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:26:59.922879 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea3d55-9586-445c-89a0-9155e121ac92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:26:59.934780 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea3d55-9586-445c-89a0-9155e121ac92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:26:59.936744 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea3d55-9586-445c-89a0-9155e121ac92 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:26:59.958783 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1015/2013] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:26:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:27:00.443796 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee29073-a742-4143-8ce0-cc5919e129ab None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:00.448959 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-cee29073-a742-4143-8ce0-cc5919e129ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:00.505824 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1debb-f0d9-4ca0-a807-a90497a99a50 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:00.506365 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1debb-f0d9-4ca0-a807-a90497a99a50 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:00.506505 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1debb-f0d9-4ca0-a807-a90497a99a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:00.513684 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee29073-a742-4143-8ce0-cc5919e129ab None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:00.531894 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76b28b-90f5-4855-9628-46652f919ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:00.534889 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76b28b-90f5-4855-9628-46652f919ffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:00.536366 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76b28b-90f5-4855-9628-46652f919ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:00.538002 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76b28b-90f5-4855-9628-46652f919ffe admin admin] PATH_INFO: `/v3/projects/25680aa146824fd4944f3aefd9b02ce4` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:00.541721 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76b28b-90f5-4855-9628-46652f919ffe admin admin] RBAC: Authorizing `identity:delete_project(project_id=25680aa146824fd4944f3aefd9b02ce4)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:00.548980 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76b28b-90f5-4855-9628-46652f919ffe admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:00.571939 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-0ce1debb-f0d9-4ca0-a807-a90497a99a50 None None] MFA Rules not processed for user `c937e0b3cf994041af4b96f9abe0fc59`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:00.573434 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0ce1debb-f0d9-4ca0-a807-a90497a99a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:00.652935 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-db76b28b-90f5-4855-9628-46652f919ffe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25680aa146824fd4944f3aefd9b02ce4', 'request_id': 'req-db76b28b-90f5-4855-9628-46652f919ffe'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:00.663318 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-db76b28b-90f5-4855-9628-46652f919ffe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25680aa146824fd4944f3aefd9b02ce4', 'request_id': 'req-db76b28b-90f5-4855-9628-46652f919ffe'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:00.682911 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-db76b28b-90f5-4855-9628-46652f919ffe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25680aa146824fd4944f3aefd9b02ce4', 'request_id': 'req-db76b28b-90f5-4855-9628-46652f919ffe'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:00.699256 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1016/2014] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:00.705879 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1debb-f0d9-4ca0-a807-a90497a99a50 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:00.707414 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0ce1debb-f0d9-4ca0-a807-a90497a99a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:00.711919 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-db76b28b-90f5-4855-9628-46652f919ffe admin admin] The token cache is being invalidate because project 25680aa146824fd4944f3aefd9b02ce4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:27:00.713954 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-db76b28b-90f5-4855-9628-46652f919ffe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:00.715573 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-db76b28b-90f5-4855-9628-46652f919ffe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:00.720315 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 999/2015] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:27:00 2022] DELETE /identity/v3/projects/25680aa146824fd4944f3aefd9b02ce4 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:00.724872 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76b28b-90f5-4855-9628-46652f919ffe admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:00.727256 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-db76b28b-90f5-4855-9628-46652f919ffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:00.856260 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76b28b-90f5-4855-9628-46652f919ffe admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:00.862591 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e5faa-e21e-48bd-958b-532532f9db1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:00.863382 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e5faa-e21e-48bd-958b-532532f9db1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:00.864132 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e5faa-e21e-48bd-958b-532532f9db1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:00.864536 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e5faa-e21e-48bd-958b-532532f9db1f admin admin] PATH_INFO: `/v3/users/30204e81518e40a0a0c0dda5d1a580a5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:00.866613 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e5faa-e21e-48bd-958b-532532f9db1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=30204e81518e40a0a0c0dda5d1a580a5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:00.869511 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e5faa-e21e-48bd-958b-532532f9db1f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:00.882707 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1debb-f0d9-4ca0-a807-a90497a99a50 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:00.967076 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-7c8e5faa-e21e-48bd-958b-532532f9db1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30204e81518e40a0a0c0dda5d1a580a5'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:00.968057 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-7c8e5faa-e21e-48bd-958b-532532f9db1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30204e81518e40a0a0c0dda5d1a580a5'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:00.986720 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-7c8e5faa-e21e-48bd-958b-532532f9db1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30204e81518e40a0a0c0dda5d1a580a5'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:00.991946 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:01.008225 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:01.014975 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-7c8e5faa-e21e-48bd-958b-532532f9db1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30204e81518e40a0a0c0dda5d1a580a5'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:01.016052 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-7c8e5faa-e21e-48bd-958b-532532f9db1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30204e81518e40a0a0c0dda5d1a580a5'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:01.038279 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1000/2016] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:27:00 2022] DELETE /identity/v3/users/30204e81518e40a0a0c0dda5d1a580a5 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:01.045960 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2bc924-6deb-455a-8711-50c4b951127c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719e4bf834d6490b96066e55a26fb159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:01.046711 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2bc924-6deb-455a-8711-50c4b951127c service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:01.050216 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2bc924-6deb-455a-8711-50c4b951127c service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:01.050615 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2bc924-6deb-455a-8711-50c4b951127c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:01.054864 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3f2bc924-6deb-455a-8711-50c4b951127c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:01.189139 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2bc924-6deb-455a-8711-50c4b951127c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:01.191665 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2bc924-6deb-455a-8711-50c4b951127c service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:01.202634 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1017/2017] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:27:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:27:02.096004 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e5faa-e21e-48bd-958b-532532f9db1f admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:02.099046 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7c8e5faa-e21e-48bd-958b-532532f9db1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:02.274763 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e5faa-e21e-48bd-958b-532532f9db1f admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:02.285452 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8661d5d-8cd1-40af-ade3-b0662163ba6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:02.286177 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8661d5d-8cd1-40af-ade3-b0662163ba6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:02.286452 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8661d5d-8cd1-40af-ade3-b0662163ba6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:02.286749 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8661d5d-8cd1-40af-ade3-b0662163ba6e admin admin] PATH_INFO: `/v3/projects/1952faff04e34e2aab075a7adb24baab` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:02.288631 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8661d5d-8cd1-40af-ade3-b0662163ba6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1952faff04e34e2aab075a7adb24baab)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:02.292840 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8661d5d-8cd1-40af-ade3-b0662163ba6e admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:02.403496 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d8661d5d-8cd1-40af-ade3-b0662163ba6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1952faff04e34e2aab075a7adb24baab', 'request_id': 'req-d8661d5d-8cd1-40af-ade3-b0662163ba6e'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:02.415653 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d8661d5d-8cd1-40af-ade3-b0662163ba6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1952faff04e34e2aab075a7adb24baab', 'request_id': 'req-d8661d5d-8cd1-40af-ade3-b0662163ba6e'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:02.431189 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d8661d5d-8cd1-40af-ade3-b0662163ba6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1952faff04e34e2aab075a7adb24baab', 'request_id': 'req-d8661d5d-8cd1-40af-ade3-b0662163ba6e'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:02.454528 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d8661d5d-8cd1-40af-ade3-b0662163ba6e admin admin] The token cache is being invalidate because project 1952faff04e34e2aab075a7adb24baab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:27:02.455958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d8661d5d-8cd1-40af-ade3-b0662163ba6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:02.458945 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d8661d5d-8cd1-40af-ade3-b0662163ba6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:02.464600 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1001/2018] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:27:02 2022] DELETE /identity/v3/projects/1952faff04e34e2aab075a7adb24baab => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:02.468238 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2bc924-6deb-455a-8711-50c4b951127c service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:02.493611 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2bc924-6deb-455a-8711-50c4b951127c service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:02.666225 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf6a0f-d272-443f-851b-edaed1476ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:02.666996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf6a0f-d272-443f-851b-edaed1476ace admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:02.667565 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf6a0f-d272-443f-851b-edaed1476ace admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:02.668698 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf6a0f-d272-443f-851b-edaed1476ace admin admin] PATH_INFO: `/v3/users/54040ed76b1d4a469190021b1e308f89` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:02.677960 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf6a0f-d272-443f-851b-edaed1476ace admin admin] RBAC: Authorizing `identity:delete_user(user_id=54040ed76b1d4a469190021b1e308f89)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:02.686186 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf6a0f-d272-443f-851b-edaed1476ace admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:02.820466 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5cdf6a0f-d272-443f-851b-edaed1476ace admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54040ed76b1d4a469190021b1e308f89'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:02.821188 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5cdf6a0f-d272-443f-851b-edaed1476ace admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54040ed76b1d4a469190021b1e308f89'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:02.852551 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5cdf6a0f-d272-443f-851b-edaed1476ace admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54040ed76b1d4a469190021b1e308f89'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:02.899887 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5cdf6a0f-d272-443f-851b-edaed1476ace admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54040ed76b1d4a469190021b1e308f89'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:02.900738 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5cdf6a0f-d272-443f-851b-edaed1476ace admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54040ed76b1d4a469190021b1e308f89'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:02.931444 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1018/2019] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:27:02 2022] DELETE /identity/v3/users/54040ed76b1d4a469190021b1e308f89 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:03.576728 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8661d5d-8cd1-40af-ade3-b0662163ba6e admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:03.578599 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d8661d5d-8cd1-40af-ade3-b0662163ba6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:03.595838 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8661d5d-8cd1-40af-ade3-b0662163ba6e admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:03.675294 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b702601-a58a-478a-bb7d-5e9ba464ecb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:03.676003 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b702601-a58a-478a-bb7d-5e9ba464ecb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:03.677674 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b702601-a58a-478a-bb7d-5e9ba464ecb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:03.678149 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b702601-a58a-478a-bb7d-5e9ba464ecb9 admin admin] PATH_INFO: `/v3/users/0534584e51cd4cbf9309ba101cc88b27` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:03.679395 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b702601-a58a-478a-bb7d-5e9ba464ecb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0534584e51cd4cbf9309ba101cc88b27)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:03.681273 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b702601-a58a-478a-bb7d-5e9ba464ecb9 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:03.702082 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:03.754699 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4b702601-a58a-478a-bb7d-5e9ba464ecb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0534584e51cd4cbf9309ba101cc88b27'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:03.755383 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4b702601-a58a-478a-bb7d-5e9ba464ecb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0534584e51cd4cbf9309ba101cc88b27'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:03.765151 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4b702601-a58a-478a-bb7d-5e9ba464ecb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0534584e51cd4cbf9309ba101cc88b27'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:03.783311 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4b702601-a58a-478a-bb7d-5e9ba464ecb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0534584e51cd4cbf9309ba101cc88b27'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:03.789963 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4b702601-a58a-478a-bb7d-5e9ba464ecb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0534584e51cd4cbf9309ba101cc88b27'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:03.809049 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1002/2020] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:27:03 2022] DELETE /identity/v3/users/0534584e51cd4cbf9309ba101cc88b27 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:04.015211 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf6a0f-d272-443f-851b-edaed1476ace admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:04.016786 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5cdf6a0f-d272-443f-851b-edaed1476ace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:04.029291 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:04.040856 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf6a0f-d272-443f-851b-edaed1476ace admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:04.119321 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b702601-a58a-478a-bb7d-5e9ba464ecb9 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:04.121033 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-4b702601-a58a-478a-bb7d-5e9ba464ecb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:04.152378 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e7a1f4-2b20-4ff0-85e3-98d829eb2835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:04.153147 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7a1f4-2b20-4ff0-85e3-98d829eb2835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:04.153485 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7a1f4-2b20-4ff0-85e3-98d829eb2835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:04.153848 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7a1f4-2b20-4ff0-85e3-98d829eb2835 admin admin] PATH_INFO: `/v3/projects/81d871b49fda46f4aead62f4bd9fa528` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:04.155138 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e7a1f4-2b20-4ff0-85e3-98d829eb2835 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81d871b49fda46f4aead62f4bd9fa528)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:04.157508 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e7a1f4-2b20-4ff0-85e3-98d829eb2835 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:04.252428 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b702601-a58a-478a-bb7d-5e9ba464ecb9 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:04.256627 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c1e7a1f4-2b20-4ff0-85e3-98d829eb2835 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81d871b49fda46f4aead62f4bd9fa528', 'request_id': 'req-c1e7a1f4-2b20-4ff0-85e3-98d829eb2835'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:04.269072 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c1e7a1f4-2b20-4ff0-85e3-98d829eb2835 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81d871b49fda46f4aead62f4bd9fa528', 'request_id': 'req-c1e7a1f4-2b20-4ff0-85e3-98d829eb2835'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:04.284966 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c1e7a1f4-2b20-4ff0-85e3-98d829eb2835 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81d871b49fda46f4aead62f4bd9fa528', 'request_id': 'req-c1e7a1f4-2b20-4ff0-85e3-98d829eb2835'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:04.304422 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c1e7a1f4-2b20-4ff0-85e3-98d829eb2835 admin admin] The token cache is being invalidate because project 81d871b49fda46f4aead62f4bd9fa528 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:27:04.304715 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c1e7a1f4-2b20-4ff0-85e3-98d829eb2835 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:04.307820 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c1e7a1f4-2b20-4ff0-85e3-98d829eb2835 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:04.314641 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1019/2021] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:27:04 2022] DELETE /identity/v3/projects/81d871b49fda46f4aead62f4bd9fa528 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:04.316678 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3b0fc-a3a8-4385-acf7-7f1838a553af None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:04.317008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3b0fc-a3a8-4385-acf7-7f1838a553af None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:04.317281 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3b0fc-a3a8-4385-acf7-7f1838a553af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:04.352736 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb180bfd-1fdb-4a86-9b78-5fc74e0e175a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:04.354801 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb180bfd-1fdb-4a86-9b78-5fc74e0e175a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:04.355398 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb180bfd-1fdb-4a86-9b78-5fc74e0e175a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:04.355894 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb180bfd-1fdb-4a86-9b78-5fc74e0e175a admin admin] PATH_INFO: `/v3/projects/5e4e2bea68114530a9c02ca47da9f83f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:04.357735 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb180bfd-1fdb-4a86-9b78-5fc74e0e175a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e4e2bea68114530a9c02ca47da9f83f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:04.363661 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb180bfd-1fdb-4a86-9b78-5fc74e0e175a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:04.391985 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d6d3b0fc-a3a8-4385-acf7-7f1838a553af None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:04.395338 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d6d3b0fc-a3a8-4385-acf7-7f1838a553af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:04.430082 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1020/2022] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:04.441036 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f34465-bdd2-46df-bb39-638167195de6 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:04.441314 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f34465-bdd2-46df-bb39-638167195de6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:04.441608 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f34465-bdd2-46df-bb39-638167195de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:04.468935 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:04.477736 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-fb180bfd-1fdb-4a86-9b78-5fc74e0e175a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e4e2bea68114530a9c02ca47da9f83f', 'request_id': 'req-fb180bfd-1fdb-4a86-9b78-5fc74e0e175a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:04.489513 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-56f34465-bdd2-46df-bb39-638167195de6 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:04.496752 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-56f34465-bdd2-46df-bb39-638167195de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:04.508094 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-fb180bfd-1fdb-4a86-9b78-5fc74e0e175a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e4e2bea68114530a9c02ca47da9f83f', 'request_id': 'req-fb180bfd-1fdb-4a86-9b78-5fc74e0e175a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:04.517078 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-fb180bfd-1fdb-4a86-9b78-5fc74e0e175a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e4e2bea68114530a9c02ca47da9f83f', 'request_id': 'req-fb180bfd-1fdb-4a86-9b78-5fc74e0e175a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:04.548070 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-fb180bfd-1fdb-4a86-9b78-5fc74e0e175a admin admin] The token cache is being invalidate because project 5e4e2bea68114530a9c02ca47da9f83f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:27:04.548363 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-fb180bfd-1fdb-4a86-9b78-5fc74e0e175a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:04.550966 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-fb180bfd-1fdb-4a86-9b78-5fc74e0e175a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:04.558010 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1003/2023] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:27:04 2022] DELETE /identity/v3/projects/5e4e2bea68114530a9c02ca47da9f83f => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:04.559059 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb180bfd-1fdb-4a86-9b78-5fc74e0e175a admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:04.563508 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-fb180bfd-1fdb-4a86-9b78-5fc74e0e175a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:04.601437 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1021/2024] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:04.605954 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f34465-bdd2-46df-bb39-638167195de6 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:04.626802 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f34465-bdd2-46df-bb39-638167195de6 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:04.641381 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240a36c-f498-4319-b752-da23480adb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:04.642248 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240a36c-f498-4319-b752-da23480adb3b admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:04.642636 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240a36c-f498-4319-b752-da23480adb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:04.643012 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240a36c-f498-4319-b752-da23480adb3b admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:04.643801 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6240a36c-f498-4319-b752-da23480adb3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:27:04.644210 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6240a36c-f498-4319-b752-da23480adb3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:04.646960 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6240a36c-f498-4319-b752-da23480adb3b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:04.678881 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1022/2025] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:27:04.680800 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240a36c-f498-4319-b752-da23480adb3b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:04.715520 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb180bfd-1fdb-4a86-9b78-5fc74e0e175a admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:04.718743 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240a36c-f498-4319-b752-da23480adb3b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:04.726222 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53978b0b-ab3a-4041-a081-c7f1fd0a878d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:04.726902 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53978b0b-ab3a-4041-a081-c7f1fd0a878d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:04.727193 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53978b0b-ab3a-4041-a081-c7f1fd0a878d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:04.727465 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53978b0b-ab3a-4041-a081-c7f1fd0a878d admin admin] PATH_INFO: `/v3/users/de0c3c9db41e4de89de792d3bd38ac74` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:04.728535 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105ea82-e027-45f3-84c9-8fb75b424c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:04.729546 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53978b0b-ab3a-4041-a081-c7f1fd0a878d admin admin] RBAC: Authorizing `identity:delete_user(user_id=de0c3c9db41e4de89de792d3bd38ac74)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:04.730646 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105ea82-e027-45f3-84c9-8fb75b424c87 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:04.731512 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53978b0b-ab3a-4041-a081-c7f1fd0a878d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:04.731972 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105ea82-e027-45f3-84c9-8fb75b424c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:04.733009 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105ea82-e027-45f3-84c9-8fb75b424c87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:04.738683 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c105ea82-e027-45f3-84c9-8fb75b424c87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:04.740717 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c105ea82-e027-45f3-84c9-8fb75b424c87 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:04.761378 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:04.799986 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1023/2026] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:27:04 2022] POST /identity/v3/projects => generated 401 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:27:04.806785 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9b913-a2ac-41ed-8e0d-47a9b5d3f67d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:04.807061 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9b913-a2ac-41ed-8e0d-47a9b5d3f67d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:04.808514 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9b913-a2ac-41ed-8e0d-47a9b5d3f67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:04.825352 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-53978b0b-ab3a-4041-a081-c7f1fd0a878d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de0c3c9db41e4de89de792d3bd38ac74'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:04.826252 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-53978b0b-ab3a-4041-a081-c7f1fd0a878d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de0c3c9db41e4de89de792d3bd38ac74'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:04.832844 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d3c9b913-a2ac-41ed-8e0d-47a9b5d3f67d None None] MFA Rules not processed for user `c937e0b3cf994041af4b96f9abe0fc59`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:04.834077 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d3c9b913-a2ac-41ed-8e0d-47a9b5d3f67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:04.836228 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-53978b0b-ab3a-4041-a081-c7f1fd0a878d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de0c3c9db41e4de89de792d3bd38ac74'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:04.868666 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-53978b0b-ab3a-4041-a081-c7f1fd0a878d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de0c3c9db41e4de89de792d3bd38ac74'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:04.871781 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-53978b0b-ab3a-4041-a081-c7f1fd0a878d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de0c3c9db41e4de89de792d3bd38ac74'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:04.897920 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1004/2027] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:27:04 2022] DELETE /identity/v3/users/de0c3c9db41e4de89de792d3bd38ac74 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:04.897920 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53978b0b-ab3a-4041-a081-c7f1fd0a878d admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:04.899619 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-53978b0b-ab3a-4041-a081-c7f1fd0a878d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:04.920028 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1024/2028] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:05.008434 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:05.027196 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53978b0b-ab3a-4041-a081-c7f1fd0a878d admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:05.034053 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2325e-128d-42cd-9213-5977f5024142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:05.034792 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2325e-128d-42cd-9213-5977f5024142 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:05.035133 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2325e-128d-42cd-9213-5977f5024142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:05.035466 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2325e-128d-42cd-9213-5977f5024142 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:05.036170 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2325e-128d-42cd-9213-5977f5024142 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:05.038236 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2325e-128d-42cd-9213-5977f5024142 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:05.065007 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1005/2029] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:27:04 2022] POST /identity/v3/users => generated 301 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:27:05.069705 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9b913-a2ac-41ed-8e0d-47a9b5d3f67d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:05.145000 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9b913-a2ac-41ed-8e0d-47a9b5d3f67d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:05.150065 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4946184-b0f9-4406-b9c6-9dd9f264c251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:05.150689 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4946184-b0f9-4406-b9c6-9dd9f264c251 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:05.151358 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4946184-b0f9-4406-b9c6-9dd9f264c251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:05.151358 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4946184-b0f9-4406-b9c6-9dd9f264c251 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:05.152374 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4946184-b0f9-4406-b9c6-9dd9f264c251 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:05.154284 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4946184-b0f9-4406-b9c6-9dd9f264c251 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:05.165324 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1025/2030] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 13:27:05.169443 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2325e-128d-42cd-9213-5977f5024142 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:05.181686 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2325e-128d-42cd-9213-5977f5024142 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:05.187026 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485b373-4bd9-4f26-a97a-2849b8d5964f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:05.187742 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485b373-4bd9-4f26-a97a-2849b8d5964f admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:05.188124 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485b373-4bd9-4f26-a97a-2849b8d5964f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:05.188461 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485b373-4bd9-4f26-a97a-2849b8d5964f admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:05.189388 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485b373-4bd9-4f26-a97a-2849b8d5964f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:05.191215 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485b373-4bd9-4f26-a97a-2849b8d5964f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:05.204992 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1006/2031] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:27:05.209678 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4946184-b0f9-4406-b9c6-9dd9f264c251 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:05.220650 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4946184-b0f9-4406-b9c6-9dd9f264c251 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:05.225839 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6b284-f206-4fd4-973f-9c828631384a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:05.226536 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6b284-f206-4fd4-973f-9c828631384a admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:05.226863 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6b284-f206-4fd4-973f-9c828631384a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:05.227139 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6b284-f206-4fd4-973f-9c828631384a admin admin] PATH_INFO: `/v3/projects/f14decc7f3914639b7c26115907528cc/users/d4eb3f4399ee40fbb4b306c2c2dcb138/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:05.247172 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6b284-f206-4fd4-973f-9c828631384a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f14decc7f3914639b7c26115907528cc, user_id=d4eb3f4399ee40fbb4b306c2c2dcb138, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:05.250179 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6b284-f206-4fd4-973f-9c828631384a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:05.263163 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485b373-4bd9-4f26-a97a-2849b8d5964f admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:05.265599 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d485b373-4bd9-4f26-a97a-2849b8d5964f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:05.281872 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1026/2032] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:27:05 2022] PUT /identity/v3/projects/f14decc7f3914639b7c26115907528cc/users/d4eb3f4399ee40fbb4b306c2c2dcb138/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:05.298381 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ac540-ff1b-46bc-8955-fb4eb0315cd3 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:05.298672 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ac540-ff1b-46bc-8955-fb4eb0315cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:05.298971 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ac540-ff1b-46bc-8955-fb4eb0315cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:05.306857 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485b373-4bd9-4f26-a97a-2849b8d5964f admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:05.345095 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-0b7ac540-ff1b-46bc-8955-fb4eb0315cd3 None None] MFA Rules not processed for user `d4eb3f4399ee40fbb4b306c2c2dcb138`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:05.347281 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0b7ac540-ff1b-46bc-8955-fb4eb0315cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:05.381747 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eafd9d-9ae8-4b79-ab21-d320adece15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:05.383219 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eafd9d-9ae8-4b79-ab21-d320adece15e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:05.383642 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eafd9d-9ae8-4b79-ab21-d320adece15e admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:05.384060 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eafd9d-9ae8-4b79-ab21-d320adece15e admin admin] PATH_INFO: `/v3/projects/8120cc98ca5a46e2a9680e30f734e07f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:05.385387 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eafd9d-9ae8-4b79-ab21-d320adece15e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8120cc98ca5a46e2a9680e30f734e07f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:05.388148 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eafd9d-9ae8-4b79-ab21-d320adece15e admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:05.430719 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:05.447396 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1027/2033] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:05 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:05.451043 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ac540-ff1b-46bc-8955-fb4eb0315cd3 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:05.461208 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-71eafd9d-9ae8-4b79-ab21-d320adece15e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8120cc98ca5a46e2a9680e30f734e07f', 'request_id': 'req-71eafd9d-9ae8-4b79-ab21-d320adece15e'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:05.470083 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ac540-ff1b-46bc-8955-fb4eb0315cd3 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:05.475126 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-71eafd9d-9ae8-4b79-ab21-d320adece15e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8120cc98ca5a46e2a9680e30f734e07f', 'request_id': 'req-71eafd9d-9ae8-4b79-ab21-d320adece15e'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:05.486251 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-71eafd9d-9ae8-4b79-ab21-d320adece15e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8120cc98ca5a46e2a9680e30f734e07f', 'request_id': 'req-71eafd9d-9ae8-4b79-ab21-d320adece15e'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:05.502458 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-71eafd9d-9ae8-4b79-ab21-d320adece15e admin admin] The token cache is being invalidate because project 8120cc98ca5a46e2a9680e30f734e07f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:27:05.503058 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-71eafd9d-9ae8-4b79-ab21-d320adece15e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:05.503749 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-71eafd9d-9ae8-4b79-ab21-d320adece15e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:05.507755 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1007/2034] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:27:05 2022] DELETE /identity/v3/projects/8120cc98ca5a46e2a9680e30f734e07f => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:05.608040 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c63ed9-f75b-4f4d-99ed-c3b62fab5701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:05.610309 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c63ed9-f75b-4f4d-99ed-c3b62fab5701 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:05.611673 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c63ed9-f75b-4f4d-99ed-c3b62fab5701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:05.612686 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c63ed9-f75b-4f4d-99ed-c3b62fab5701 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:05.613750 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c63ed9-f75b-4f4d-99ed-c3b62fab5701 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:05.628460 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c63ed9-f75b-4f4d-99ed-c3b62fab5701 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:05.669477 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1028/2035] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:27:05 2022] POST /identity/v3/projects => generated 401 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:27:05.670298 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eafd9d-9ae8-4b79-ab21-d320adece15e admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:05.671823 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-71eafd9d-9ae8-4b79-ab21-d320adece15e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:05.695728 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eafd9d-9ae8-4b79-ab21-d320adece15e admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:05.809192 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d6f7a-376d-4cd1-bc5a-656045c8764b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:05.809940 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d6f7a-376d-4cd1-bc5a-656045c8764b admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:05.810223 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d6f7a-376d-4cd1-bc5a-656045c8764b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:05.810492 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d6f7a-376d-4cd1-bc5a-656045c8764b admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:05.811817 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d6f7a-376d-4cd1-bc5a-656045c8764b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:05.813806 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d6f7a-376d-4cd1-bc5a-656045c8764b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:05.824586 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:05.854632 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1008/2036] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:27:05 2022] POST /identity/v3/users => generated 307 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:27:05.859762 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c63ed9-f75b-4f4d-99ed-c3b62fab5701 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:05.872379 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c63ed9-f75b-4f4d-99ed-c3b62fab5701 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:05.879725 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db845c-b3c5-4406-98aa-255724bba1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:05.880228 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db845c-b3c5-4406-98aa-255724bba1fd admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:05.880602 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db845c-b3c5-4406-98aa-255724bba1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:05.880966 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db845c-b3c5-4406-98aa-255724bba1fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:05.881754 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db845c-b3c5-4406-98aa-255724bba1fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:05.883669 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db845c-b3c5-4406-98aa-255724bba1fd admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:05.896566 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1029/2037] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:27:05.901667 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d6f7a-376d-4cd1-bc5a-656045c8764b admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:05.916206 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d6f7a-376d-4cd1-bc5a-656045c8764b admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:05.922050 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541437d-5855-4c35-943f-034b05bd6e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:05.922709 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541437d-5855-4c35-943f-034b05bd6e01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:05.922987 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541437d-5855-4c35-943f-034b05bd6e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:05.923256 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541437d-5855-4c35-943f-034b05bd6e01 admin admin] PATH_INFO: `/v3/projects/c63aec96101445e6ae6d7ef257dd1afe/users/5b0294d5a9f14821b4df2f6f19078730/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:05.941974 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e541437d-5855-4c35-943f-034b05bd6e01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c63aec96101445e6ae6d7ef257dd1afe, user_id=5b0294d5a9f14821b4df2f6f19078730, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:05.945772 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e541437d-5855-4c35-943f-034b05bd6e01 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:05.968203 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1009/2038] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:27:05 2022] PUT /identity/v3/projects/c63aec96101445e6ae6d7ef257dd1afe/users/5b0294d5a9f14821b4df2f6f19078730/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:05.969513 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db845c-b3c5-4406-98aa-255724bba1fd admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:05.980082 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db845c-b3c5-4406-98aa-255724bba1fd admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:06.083220 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700928fb-5f71-4308-adb1-47ed27d3be65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:06.084882 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700928fb-5f71-4308-adb1-47ed27d3be65 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:06.085351 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700928fb-5f71-4308-adb1-47ed27d3be65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:06.085828 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700928fb-5f71-4308-adb1-47ed27d3be65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:06.086700 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700928fb-5f71-4308-adb1-47ed27d3be65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:06.088623 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700928fb-5f71-4308-adb1-47ed27d3be65 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:06.102101 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1030/2039] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:27:06.106462 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541437d-5855-4c35-943f-034b05bd6e01 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:06.118312 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541437d-5855-4c35-943f-034b05bd6e01 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:06.123669 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1527f-611e-476b-825c-565038aaed4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:06.124411 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1527f-611e-476b-825c-565038aaed4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:06.124690 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1527f-611e-476b-825c-565038aaed4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:06.125129 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1527f-611e-476b-825c-565038aaed4b admin admin] PATH_INFO: `/v3/projects/c63aec96101445e6ae6d7ef257dd1afe/users/5b0294d5a9f14821b4df2f6f19078730/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:06.127090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f1527f-611e-476b-825c-565038aaed4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c63aec96101445e6ae6d7ef257dd1afe, user_id=5b0294d5a9f14821b4df2f6f19078730, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:06.130084 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f1527f-611e-476b-825c-565038aaed4b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:06.142549 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1010/2040] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:27:06 2022] PUT /identity/v3/projects/c63aec96101445e6ae6d7ef257dd1afe/users/5b0294d5a9f14821b4df2f6f19078730/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:27:06.152816 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70c3a7-394a-4bbf-ad66-0f6e8b87c754 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:06.153123 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70c3a7-394a-4bbf-ad66-0f6e8b87c754 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:06.153375 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70c3a7-394a-4bbf-ad66-0f6e8b87c754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:06.187372 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-6f70c3a7-394a-4bbf-ad66-0f6e8b87c754 None None] MFA Rules not processed for user `5b0294d5a9f14821b4df2f6f19078730`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:06.189215 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6f70c3a7-394a-4bbf-ad66-0f6e8b87c754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:06.273123 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:06.288495 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1031/2041] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:06 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:06.311650 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1527f-611e-476b-825c-565038aaed4b admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:06.313713 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-84f1527f-611e-476b-825c-565038aaed4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:06.426361 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1527f-611e-476b-825c-565038aaed4b admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:06.431285 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00514c3-3f7a-4812-a729-ba9761f241c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:06.431982 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00514c3-3f7a-4812-a729-ba9761f241c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:06.432261 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00514c3-3f7a-4812-a729-ba9761f241c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:06.432573 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00514c3-3f7a-4812-a729-ba9761f241c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:06.444361 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00514c3-3f7a-4812-a729-ba9761f241c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:06.445980 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00514c3-3f7a-4812-a729-ba9761f241c4 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:06.476018 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1011/2042] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:27:06 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:27:06.581090 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70c3a7-394a-4bbf-ad66-0f6e8b87c754 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:06.603264 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70c3a7-394a-4bbf-ad66-0f6e8b87c754 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:06.613226 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362515b2-5332-4a4d-9273-f02be656a78e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:06.615284 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362515b2-5332-4a4d-9273-f02be656a78e service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:06.615713 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362515b2-5332-4a4d-9273-f02be656a78e service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:06.615887 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362515b2-5332-4a4d-9273-f02be656a78e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:06.621544 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-362515b2-5332-4a4d-9273-f02be656a78e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:06.712466 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362515b2-5332-4a4d-9273-f02be656a78e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:06.714556 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362515b2-5332-4a4d-9273-f02be656a78e service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:06.729900 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1032/2043] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:27:06 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:27:09.335639 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00514c3-3f7a-4812-a729-ba9761f241c4 service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:09.337711 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e00514c3-3f7a-4812-a729-ba9761f241c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:09.410221 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00514c3-3f7a-4812-a729-ba9761f241c4 service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:09.415205 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c052773-fb89-43ba-a220-67914f3cb159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:09.415844 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c052773-fb89-43ba-a220-67914f3cb159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:09.416117 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c052773-fb89-43ba-a220-67914f3cb159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:09.416497 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c052773-fb89-43ba-a220-67914f3cb159 admin admin] PATH_INFO: `/v3/users/946833c2a74f46528ec7c12cfef4e1c9` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:09.417805 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c052773-fb89-43ba-a220-67914f3cb159 admin admin] RBAC: Authorizing `identity:delete_user(user_id=946833c2a74f46528ec7c12cfef4e1c9)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:09.419738 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c052773-fb89-43ba-a220-67914f3cb159 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:09.472459 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4c052773-fb89-43ba-a220-67914f3cb159 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '946833c2a74f46528ec7c12cfef4e1c9'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:09.473055 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4c052773-fb89-43ba-a220-67914f3cb159 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '946833c2a74f46528ec7c12cfef4e1c9'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:09.480762 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4c052773-fb89-43ba-a220-67914f3cb159 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '946833c2a74f46528ec7c12cfef4e1c9'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:09.482065 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:09.496905 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4c052773-fb89-43ba-a220-67914f3cb159 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '946833c2a74f46528ec7c12cfef4e1c9'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:09.497655 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4c052773-fb89-43ba-a220-67914f3cb159 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '946833c2a74f46528ec7c12cfef4e1c9'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:09.511206 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1012/2044] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:27:09 2022] DELETE /identity/v3/users/946833c2a74f46528ec7c12cfef4e1c9 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:09.716535 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362515b2-5332-4a4d-9273-f02be656a78e service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:09.729985 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362515b2-5332-4a4d-9273-f02be656a78e service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:09.822337 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98855761-9608-4af9-b12b-07fa340030e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:09.823042 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98855761-9608-4af9-b12b-07fa340030e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:09.823331 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98855761-9608-4af9-b12b-07fa340030e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:09.823819 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98855761-9608-4af9-b12b-07fa340030e1 admin admin] PATH_INFO: `/v3/projects/810d8a2400464dee8c9a6b6ab5034984` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:09.825215 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98855761-9608-4af9-b12b-07fa340030e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=810d8a2400464dee8c9a6b6ab5034984)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:09.827271 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98855761-9608-4af9-b12b-07fa340030e1 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:09.878567 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-98855761-9608-4af9-b12b-07fa340030e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '810d8a2400464dee8c9a6b6ab5034984', 'request_id': 'req-98855761-9608-4af9-b12b-07fa340030e1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:09.887765 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-98855761-9608-4af9-b12b-07fa340030e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '810d8a2400464dee8c9a6b6ab5034984', 'request_id': 'req-98855761-9608-4af9-b12b-07fa340030e1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:09.900058 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-98855761-9608-4af9-b12b-07fa340030e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '810d8a2400464dee8c9a6b6ab5034984', 'request_id': 'req-98855761-9608-4af9-b12b-07fa340030e1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:09.922626 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-98855761-9608-4af9-b12b-07fa340030e1 admin admin] The token cache is being invalidate because project 810d8a2400464dee8c9a6b6ab5034984 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:27:09.925949 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-98855761-9608-4af9-b12b-07fa340030e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:09.926680 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-98855761-9608-4af9-b12b-07fa340030e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:09.928343 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1033/2045] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:27:09 2022] DELETE /identity/v3/projects/810d8a2400464dee8c9a6b6ab5034984 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:09.933670 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e7924-5cfe-4ff7-ada9-089b970fbce9 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:09.934007 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e7924-5cfe-4ff7-ada9-089b970fbce9 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:09.934291 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e7924-5cfe-4ff7-ada9-089b970fbce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:09.969938 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-374e7924-5cfe-4ff7-ada9-089b970fbce9 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:09.971149 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-374e7924-5cfe-4ff7-ada9-089b970fbce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:10.040178 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1013/2046] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:10.047953 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81592c85-a4e1-44b8-8738-642333a93d13 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:10.048235 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81592c85-a4e1-44b8-8738-642333a93d13 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:10.048506 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81592c85-a4e1-44b8-8738-642333a93d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:10.069441 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-81592c85-a4e1-44b8-8738-642333a93d13 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:10.070676 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-81592c85-a4e1-44b8-8738-642333a93d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:10.079546 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1034/2047] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:10.083898 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e7924-5cfe-4ff7-ada9-089b970fbce9 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:10.093930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e7924-5cfe-4ff7-ada9-089b970fbce9 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:10.100613 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6987a-3d94-4625-8e56-7415647239c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:10.102153 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6987a-3d94-4625-8e56-7415647239c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:10.103725 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6987a-3d94-4625-8e56-7415647239c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:10.104030 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6987a-3d94-4625-8e56-7415647239c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:10.104891 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6987a-3d94-4625-8e56-7415647239c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:27:10.105895 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6987a-3d94-4625-8e56-7415647239c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:10.107472 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6987a-3d94-4625-8e56-7415647239c1 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:10.122252 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1014/2048] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:27:10.128415 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81592c85-a4e1-44b8-8738-642333a93d13 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:10.139562 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81592c85-a4e1-44b8-8738-642333a93d13 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:10.150008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e88cb1-1ba6-4b77-b7a4-8869644dd3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:10.150008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e88cb1-1ba6-4b77-b7a4-8869644dd3ec admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:10.150008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e88cb1-1ba6-4b77-b7a4-8869644dd3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:10.150008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e88cb1-1ba6-4b77-b7a4-8869644dd3ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:10.150353 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e88cb1-1ba6-4b77-b7a4-8869644dd3ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:10.150353 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e88cb1-1ba6-4b77-b7a4-8869644dd3ec admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:10.166222 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:10.182022 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1035/2049] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:27:10 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:27:10.186754 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6987a-3d94-4625-8e56-7415647239c1 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:10.198969 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6987a-3d94-4625-8e56-7415647239c1 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:10.263087 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeff49e-4983-46bc-99a9-47d58cbc427b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:10.263717 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeff49e-4983-46bc-99a9-47d58cbc427b admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:10.263991 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeff49e-4983-46bc-99a9-47d58cbc427b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:10.264258 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeff49e-4983-46bc-99a9-47d58cbc427b admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:10.264958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeff49e-4983-46bc-99a9-47d58cbc427b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:10.267262 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeff49e-4983-46bc-99a9-47d58cbc427b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:10.293579 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1015/2050] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:27:10 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:27:10.297251 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e88cb1-1ba6-4b77-b7a4-8869644dd3ec admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:10.319881 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e88cb1-1ba6-4b77-b7a4-8869644dd3ec admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:10.330239 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d387a2-4b4c-4a16-a6c8-9808c05ec66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:10.330878 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d387a2-4b4c-4a16-a6c8-9808c05ec66b admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:10.331155 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d387a2-4b4c-4a16-a6c8-9808c05ec66b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:10.331425 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d387a2-4b4c-4a16-a6c8-9808c05ec66b admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:10.332081 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d387a2-4b4c-4a16-a6c8-9808c05ec66b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:10.333788 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d387a2-4b4c-4a16-a6c8-9808c05ec66b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:10.345709 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1036/2051] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:27:10.349388 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeff49e-4983-46bc-99a9-47d58cbc427b admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:10.360974 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeff49e-4983-46bc-99a9-47d58cbc427b admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:10.366766 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4e65c-0bbb-4489-a1b9-6f3ef52f634c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:10.367514 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4e65c-0bbb-4489-a1b9-6f3ef52f634c admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:10.367892 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4e65c-0bbb-4489-a1b9-6f3ef52f634c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:10.368269 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4e65c-0bbb-4489-a1b9-6f3ef52f634c admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:10.369149 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4e65c-0bbb-4489-a1b9-6f3ef52f634c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:10.371208 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4e65c-0bbb-4489-a1b9-6f3ef52f634c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:10.383096 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1016/2052] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:27:10.387266 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d387a2-4b4c-4a16-a6c8-9808c05ec66b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:10.398324 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d387a2-4b4c-4a16-a6c8-9808c05ec66b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:10.404125 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d8b98-f34e-4bce-bee9-f3cd71ef55f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:10.404553 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d8b98-f34e-4bce-bee9-f3cd71ef55f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:10.404825 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d8b98-f34e-4bce-bee9-f3cd71ef55f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:10.405094 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d8b98-f34e-4bce-bee9-f3cd71ef55f5 admin admin] PATH_INFO: `/v3/projects/45d786a93c3e457ca6f77f2309aa2c68/users/52d5236365884e859a05762f546499a8/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:10.422034 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d8b98-f34e-4bce-bee9-f3cd71ef55f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45d786a93c3e457ca6f77f2309aa2c68, user_id=52d5236365884e859a05762f546499a8, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:10.424806 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d8b98-f34e-4bce-bee9-f3cd71ef55f5 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:10.449994 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1037/2053] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:27:10 2022] PUT /identity/v3/projects/45d786a93c3e457ca6f77f2309aa2c68/users/52d5236365884e859a05762f546499a8/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:27:10.460792 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299ce36-5d57-4415-ac87-489ba4a7e1cc None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:10.461211 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299ce36-5d57-4415-ac87-489ba4a7e1cc None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:10.461574 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299ce36-5d57-4415-ac87-489ba4a7e1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:10.491597 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-1299ce36-5d57-4415-ac87-489ba4a7e1cc None None] MFA Rules not processed for user `52d5236365884e859a05762f546499a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:10.493003 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1299ce36-5d57-4415-ac87-489ba4a7e1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:10.524777 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:10.572244 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1017/2054] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:10.584412 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d8b98-f34e-4bce-bee9-f3cd71ef55f5 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:10.586178 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-718d8b98-f34e-4bce-bee9-f3cd71ef55f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:10.669627 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d8b98-f34e-4bce-bee9-f3cd71ef55f5 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:10.675613 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738780d-0b36-45b0-80a1-a95efb0329b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719e4bf834d6490b96066e55a26fb159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:10.676234 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738780d-0b36-45b0-80a1-a95efb0329b1 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:10.676530 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738780d-0b36-45b0-80a1-a95efb0329b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:10.676810 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738780d-0b36-45b0-80a1-a95efb0329b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:10.686498 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738780d-0b36-45b0-80a1-a95efb0329b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:10.688194 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738780d-0b36-45b0-80a1-a95efb0329b1 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:10.699820 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1038/2055] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:27:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:27:11.128964 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299ce36-5d57-4415-ac87-489ba4a7e1cc None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:11.246095 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299ce36-5d57-4415-ac87-489ba4a7e1cc None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:11.252307 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b14211-d90f-4240-af05-4bd3392daf18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:11.253272 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b14211-d90f-4240-af05-4bd3392daf18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:11.253775 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b14211-d90f-4240-af05-4bd3392daf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:11.254420 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b14211-d90f-4240-af05-4bd3392daf18 admin admin] PATH_INFO: `/v3/users/52d5236365884e859a05762f546499a8` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:11.255766 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b14211-d90f-4240-af05-4bd3392daf18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52d5236365884e859a05762f546499a8)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:11.257785 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b14211-d90f-4240-af05-4bd3392daf18 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:11.328268 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-38b14211-d90f-4240-af05-4bd3392daf18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52d5236365884e859a05762f546499a8'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:11.329372 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-38b14211-d90f-4240-af05-4bd3392daf18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52d5236365884e859a05762f546499a8'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:11.338056 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-38b14211-d90f-4240-af05-4bd3392daf18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52d5236365884e859a05762f546499a8'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:11.354928 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-38b14211-d90f-4240-af05-4bd3392daf18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52d5236365884e859a05762f546499a8'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:11.355981 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-38b14211-d90f-4240-af05-4bd3392daf18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52d5236365884e859a05762f546499a8'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:11.364421 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738780d-0b36-45b0-80a1-a95efb0329b1 service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:11.366002 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7738780d-0b36-45b0-80a1-a95efb0329b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:11.377232 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1018/2056] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:27:11 2022] DELETE /identity/v3/users/52d5236365884e859a05762f546499a8 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:11.381758 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738780d-0b36-45b0-80a1-a95efb0329b1 service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:11.382289 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001d8f1-178d-4c7b-bfdb-b8f01bac5665 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:11.382574 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001d8f1-178d-4c7b-bfdb-b8f01bac5665 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:11.382844 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001d8f1-178d-4c7b-bfdb-b8f01bac5665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:11.406567 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-a001d8f1-178d-4c7b-bfdb-b8f01bac5665 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:11.407807 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a001d8f1-178d-4c7b-bfdb-b8f01bac5665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:11.463849 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:11.475058 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df83a2-3242-478a-951a-0c0615d49d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:11.475963 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df83a2-3242-478a-951a-0c0615d49d7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:11.476245 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df83a2-3242-478a-951a-0c0615d49d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:11.476583 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df83a2-3242-478a-951a-0c0615d49d7f admin admin] PATH_INFO: `/v3/users/d4eb3f4399ee40fbb4b306c2c2dcb138` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:11.477778 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df83a2-3242-478a-951a-0c0615d49d7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4eb3f4399ee40fbb4b306c2c2dcb138)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:11.480321 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df83a2-3242-478a-951a-0c0615d49d7f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:11.485704 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1019/2057] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:11.493417 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001d8f1-178d-4c7b-bfdb-b8f01bac5665 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:11.495923 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a001d8f1-178d-4c7b-bfdb-b8f01bac5665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:11.532489 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:11.534337 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-07df83a2-3242-478a-951a-0c0615d49d7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4eb3f4399ee40fbb4b306c2c2dcb138'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:11.535120 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-07df83a2-3242-478a-951a-0c0615d49d7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4eb3f4399ee40fbb4b306c2c2dcb138'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:11.544249 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-07df83a2-3242-478a-951a-0c0615d49d7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4eb3f4399ee40fbb4b306c2c2dcb138'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:11.556884 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-07df83a2-3242-478a-951a-0c0615d49d7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4eb3f4399ee40fbb4b306c2c2dcb138'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:11.557668 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-07df83a2-3242-478a-951a-0c0615d49d7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4eb3f4399ee40fbb4b306c2c2dcb138'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:11.562900 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001d8f1-178d-4c7b-bfdb-b8f01bac5665 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:11.568087 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873afb3-5326-45ab-bc60-835ccd620c37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:11.568816 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873afb3-5326-45ab-bc60-835ccd620c37 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:11.569079 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873afb3-5326-45ab-bc60-835ccd620c37 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:11.569421 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873afb3-5326-45ab-bc60-835ccd620c37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:11.571481 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3873afb3-5326-45ab-bc60-835ccd620c37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:11.572720 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1039/2058] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:27:11 2022] DELETE /identity/v3/users/d4eb3f4399ee40fbb4b306c2c2dcb138 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:27:11.578199 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09b270-dfd1-463e-b0a6-e9c0cd1f0e56 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:11.578583 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09b270-dfd1-463e-b0a6-e9c0cd1f0e56 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:11.578865 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09b270-dfd1-463e-b0a6-e9c0cd1f0e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:11.585306 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3873afb3-5326-45ab-bc60-835ccd620c37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:11.586816 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3873afb3-5326-45ab-bc60-835ccd620c37 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:11.596752 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1020/2059] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:27:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:27:11.598643 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-cd09b270-dfd1-463e-b0a6-e9c0cd1f0e56 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:11.599931 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cd09b270-dfd1-463e-b0a6-e9c0cd1f0e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:11.664441 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1040/2060] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:27:11.675681 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873afb3-5326-45ab-bc60-835ccd620c37 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:11.677626 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3873afb3-5326-45ab-bc60-835ccd620c37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:11.689819 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873afb3-5326-45ab-bc60-835ccd620c37 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:11.744859 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56098229-f184-4816-9744-c97d143ad1c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:11.745875 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56098229-f184-4816-9744-c97d143ad1c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:11.746305 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56098229-f184-4816-9744-c97d143ad1c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:11.746864 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56098229-f184-4816-9744-c97d143ad1c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:11.758103 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56098229-f184-4816-9744-c97d143ad1c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:11.759593 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56098229-f184-4816-9744-c97d143ad1c3 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:11.770867 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1021/2061] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:27:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:27:12.025157 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd09b270-dfd1-463e-b0a6-e9c0cd1f0e56 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:12.032858 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cd09b270-dfd1-463e-b0a6-e9c0cd1f0e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:12.054136 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd09b270-dfd1-463e-b0a6-e9c0cd1f0e56 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:12.061444 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ad10d-9f03-4154-8262-7f583b01b8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:12.062117 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ad10d-9f03-4154-8262-7f583b01b8a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:12.062394 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ad10d-9f03-4154-8262-7f583b01b8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:12.062665 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ad10d-9f03-4154-8262-7f583b01b8a4 admin admin] PATH_INFO: `/v3/projects/45d786a93c3e457ca6f77f2309aa2c68` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:12.064189 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ad10d-9f03-4154-8262-7f583b01b8a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45d786a93c3e457ca6f77f2309aa2c68)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:12.065787 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ad10d-9f03-4154-8262-7f583b01b8a4 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:12.147471 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b15ad10d-9f03-4154-8262-7f583b01b8a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45d786a93c3e457ca6f77f2309aa2c68', 'request_id': 'req-b15ad10d-9f03-4154-8262-7f583b01b8a4'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:12.159203 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b15ad10d-9f03-4154-8262-7f583b01b8a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45d786a93c3e457ca6f77f2309aa2c68', 'request_id': 'req-b15ad10d-9f03-4154-8262-7f583b01b8a4'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:12.166447 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b15ad10d-9f03-4154-8262-7f583b01b8a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45d786a93c3e457ca6f77f2309aa2c68', 'request_id': 'req-b15ad10d-9f03-4154-8262-7f583b01b8a4'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:12.186447 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b15ad10d-9f03-4154-8262-7f583b01b8a4 admin admin] The token cache is being invalidate because project 45d786a93c3e457ca6f77f2309aa2c68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:27:12.186755 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b15ad10d-9f03-4154-8262-7f583b01b8a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:12.187847 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b15ad10d-9f03-4154-8262-7f583b01b8a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:12.189570 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1041/2062] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:27:12 2022] DELETE /identity/v3/projects/45d786a93c3e457ca6f77f2309aa2c68 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:12.194233 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03480ef-4d17-4709-892a-36ffb28ba37b None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:12.194572 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03480ef-4d17-4709-892a-36ffb28ba37b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:12.194773 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03480ef-4d17-4709-892a-36ffb28ba37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:12.199892 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ad10d-9f03-4154-8262-7f583b01b8a4 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:12.203034 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b15ad10d-9f03-4154-8262-7f583b01b8a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:12.230428 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-a03480ef-4d17-4709-892a-36ffb28ba37b None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:12.231826 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a03480ef-4d17-4709-892a-36ffb28ba37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:12.259232 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:12.278331 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ad10d-9f03-4154-8262-7f583b01b8a4 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:12.284407 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8ce32-5a6e-460a-988e-fb25256f71b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:12.285053 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8ce32-5a6e-460a-988e-fb25256f71b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:12.285334 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8ce32-5a6e-460a-988e-fb25256f71b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:12.285679 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8ce32-5a6e-460a-988e-fb25256f71b8 admin admin] PATH_INFO: `/v3/projects/f14decc7f3914639b7c26115907528cc` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:12.286843 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf8ce32-5a6e-460a-988e-fb25256f71b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f14decc7f3914639b7c26115907528cc)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:12.288820 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf8ce32-5a6e-460a-988e-fb25256f71b8 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:12.299635 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1022/2063] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:12.311301 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5592c39-1fe7-46e7-b9a0-2f26bfad4897 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:12.313660 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5592c39-1fe7-46e7-b9a0-2f26bfad4897 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:12.314877 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5592c39-1fe7-46e7-b9a0-2f26bfad4897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:12.338670 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-a5592c39-1fe7-46e7-b9a0-2f26bfad4897 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:12.339918 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a5592c39-1fe7-46e7-b9a0-2f26bfad4897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:12.345995 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0cf8ce32-5a6e-460a-988e-fb25256f71b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f14decc7f3914639b7c26115907528cc', 'request_id': 'req-0cf8ce32-5a6e-460a-988e-fb25256f71b8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:12.351736 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0cf8ce32-5a6e-460a-988e-fb25256f71b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f14decc7f3914639b7c26115907528cc', 'request_id': 'req-0cf8ce32-5a6e-460a-988e-fb25256f71b8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:12.358651 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0cf8ce32-5a6e-460a-988e-fb25256f71b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f14decc7f3914639b7c26115907528cc', 'request_id': 'req-0cf8ce32-5a6e-460a-988e-fb25256f71b8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:12.374170 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0cf8ce32-5a6e-460a-988e-fb25256f71b8 admin admin] The token cache is being invalidate because project f14decc7f3914639b7c26115907528cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:27:12.374724 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0cf8ce32-5a6e-460a-988e-fb25256f71b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:12.375105 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0cf8ce32-5a6e-460a-988e-fb25256f71b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:12.376793 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1042/2064] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:27:12 2022] DELETE /identity/v3/projects/f14decc7f3914639b7c26115907528cc => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:12.379028 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:12.380666 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8ce32-5a6e-460a-988e-fb25256f71b8 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:12.382234 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0cf8ce32-5a6e-460a-988e-fb25256f71b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:12.416905 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1023/2065] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:12.422107 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5592c39-1fe7-46e7-b9a0-2f26bfad4897 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:12.431623 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5592c39-1fe7-46e7-b9a0-2f26bfad4897 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:12.438748 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753d9ce-dc15-4f3d-a0d5-57c76422592d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:12.439533 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753d9ce-dc15-4f3d-a0d5-57c76422592d admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:12.439878 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753d9ce-dc15-4f3d-a0d5-57c76422592d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:12.440213 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753d9ce-dc15-4f3d-a0d5-57c76422592d admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:12.440947 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753d9ce-dc15-4f3d-a0d5-57c76422592d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:27:12.441307 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753d9ce-dc15-4f3d-a0d5-57c76422592d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:12.443049 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753d9ce-dc15-4f3d-a0d5-57c76422592d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:12.455999 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8ce32-5a6e-460a-988e-fb25256f71b8 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:12.459840 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1024/2066] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:27:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:27:12.460900 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753d9ce-dc15-4f3d-a0d5-57c76422592d admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:12.464723 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47983d3-bc39-46de-bd56-59ba36c49612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:12.465392 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47983d3-bc39-46de-bd56-59ba36c49612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:12.465771 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47983d3-bc39-46de-bd56-59ba36c49612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:12.466106 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47983d3-bc39-46de-bd56-59ba36c49612 admin admin] PATH_INFO: `/v3/users/5b0294d5a9f14821b4df2f6f19078730` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:12.467462 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47983d3-bc39-46de-bd56-59ba36c49612 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b0294d5a9f14821b4df2f6f19078730)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:12.470502 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47983d3-bc39-46de-bd56-59ba36c49612 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:12.471123 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753d9ce-dc15-4f3d-a0d5-57c76422592d admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:12.476170 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837bd205-bfbb-4e66-b489-776158d5eafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:12.476768 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bd205-bfbb-4e66-b489-776158d5eafb admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:12.477056 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bd205-bfbb-4e66-b489-776158d5eafb admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:12.477456 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bd205-bfbb-4e66-b489-776158d5eafb admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:12.478245 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837bd205-bfbb-4e66-b489-776158d5eafb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:12.480382 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837bd205-bfbb-4e66-b489-776158d5eafb admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:12.517754 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1025/2067] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:27:12 2022] POST /identity/v3/projects => generated 363 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:27:12.519523 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837bd205-bfbb-4e66-b489-776158d5eafb admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:12.532753 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c47983d3-bc39-46de-bd56-59ba36c49612 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b0294d5a9f14821b4df2f6f19078730'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:12.533520 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c47983d3-bc39-46de-bd56-59ba36c49612 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b0294d5a9f14821b4df2f6f19078730'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:12.542932 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c47983d3-bc39-46de-bd56-59ba36c49612 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b0294d5a9f14821b4df2f6f19078730'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:12.561052 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c47983d3-bc39-46de-bd56-59ba36c49612 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b0294d5a9f14821b4df2f6f19078730'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:12.562126 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c47983d3-bc39-46de-bd56-59ba36c49612 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b0294d5a9f14821b4df2f6f19078730'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:12.569330 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:12.586761 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1043/2068] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:27:12 2022] DELETE /identity/v3/users/5b0294d5a9f14821b4df2f6f19078730 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:12.592101 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837bd205-bfbb-4e66-b489-776158d5eafb admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:12.661230 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291fcf6-1924-4e48-9cba-9c3173b9333a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:12.661899 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291fcf6-1924-4e48-9cba-9c3173b9333a admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:12.662343 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291fcf6-1924-4e48-9cba-9c3173b9333a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:12.662629 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291fcf6-1924-4e48-9cba-9c3173b9333a admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:12.663620 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7291fcf6-1924-4e48-9cba-9c3173b9333a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:12.665769 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7291fcf6-1924-4e48-9cba-9c3173b9333a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:12.697590 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1026/2069] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:27:12 2022] POST /identity/v3/users => generated 282 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:27:12.701618 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47983d3-bc39-46de-bd56-59ba36c49612 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:12.704140 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c47983d3-bc39-46de-bd56-59ba36c49612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:12.720751 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47983d3-bc39-46de-bd56-59ba36c49612 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:12.726317 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a590658-8bb9-4a45-8546-2c186b3dcdde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:12.726962 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a590658-8bb9-4a45-8546-2c186b3dcdde admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:12.727249 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a590658-8bb9-4a45-8546-2c186b3dcdde admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:12.727994 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a590658-8bb9-4a45-8546-2c186b3dcdde admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:12.728679 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a590658-8bb9-4a45-8546-2c186b3dcdde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:12.730698 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a590658-8bb9-4a45-8546-2c186b3dcdde admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:12.742998 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1044/2070] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:27:12.747905 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291fcf6-1924-4e48-9cba-9c3173b9333a admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:12.772664 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291fcf6-1924-4e48-9cba-9c3173b9333a admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:12.782351 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa4d133-ccaf-4e32-9c3f-c219e8fc87a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:12.782983 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4d133-ccaf-4e32-9c3f-c219e8fc87a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:12.783262 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4d133-ccaf-4e32-9c3f-c219e8fc87a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:12.783529 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4d133-ccaf-4e32-9c3f-c219e8fc87a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:12.785657 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa4d133-ccaf-4e32-9c3f-c219e8fc87a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:12.789315 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa4d133-ccaf-4e32-9c3f-c219e8fc87a8 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:12.798224 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1027/2071] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:27:12.802288 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a590658-8bb9-4a45-8546-2c186b3dcdde admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:12.815619 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a590658-8bb9-4a45-8546-2c186b3dcdde admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:12.821865 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693bc6b-70d3-4a31-b05a-12a2a20b6d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:12.823666 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693bc6b-70d3-4a31-b05a-12a2a20b6d1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:12.824130 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693bc6b-70d3-4a31-b05a-12a2a20b6d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:12.824427 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693bc6b-70d3-4a31-b05a-12a2a20b6d1c admin admin] PATH_INFO: `/v3/projects/574de4694402479c8278535776a5a7e4/users/4eaf6b0bb47845909bc3323d78a1a566/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:12.849163 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2693bc6b-70d3-4a31-b05a-12a2a20b6d1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=574de4694402479c8278535776a5a7e4, user_id=4eaf6b0bb47845909bc3323d78a1a566, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:12.851957 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2693bc6b-70d3-4a31-b05a-12a2a20b6d1c admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:12.867529 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1045/2072] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:27:12 2022] PUT /identity/v3/projects/574de4694402479c8278535776a5a7e4/users/4eaf6b0bb47845909bc3323d78a1a566/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:12.878967 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102315be-376b-432e-98c1-e67c1aa28158 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:12.879244 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102315be-376b-432e-98c1-e67c1aa28158 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:12.879516 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102315be-376b-432e-98c1-e67c1aa28158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:12.913064 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-102315be-376b-432e-98c1-e67c1aa28158 None None] MFA Rules not processed for user `4eaf6b0bb47845909bc3323d78a1a566`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:12.914862 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-102315be-376b-432e-98c1-e67c1aa28158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:12.924466 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693bc6b-70d3-4a31-b05a-12a2a20b6d1c admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:12.926714 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2693bc6b-70d3-4a31-b05a-12a2a20b6d1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:12.966004 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:13.005259 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693bc6b-70d3-4a31-b05a-12a2a20b6d1c admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:13.012098 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63421332-fed4-4929-ac28-0a6fc854dc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:13.012744 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63421332-fed4-4929-ac28-0a6fc854dc1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:13.013025 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63421332-fed4-4929-ac28-0a6fc854dc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:13.013297 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63421332-fed4-4929-ac28-0a6fc854dc1f admin admin] PATH_INFO: `/v3/projects/c63aec96101445e6ae6d7ef257dd1afe` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:13.014502 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63421332-fed4-4929-ac28-0a6fc854dc1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c63aec96101445e6ae6d7ef257dd1afe)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:13.016465 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63421332-fed4-4929-ac28-0a6fc854dc1f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:13.026150 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1028/2073] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:13.030599 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102315be-376b-432e-98c1-e67c1aa28158 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:13.042927 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102315be-376b-432e-98c1-e67c1aa28158 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:13.047555 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6655f8-d27a-4415-a4fc-9f48ac777d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:13.048159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6655f8-d27a-4415-a4fc-9f48ac777d3f admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:13.048430 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6655f8-d27a-4415-a4fc-9f48ac777d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:13.048701 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6655f8-d27a-4415-a4fc-9f48ac777d3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:13.049334 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6655f8-d27a-4415-a4fc-9f48ac777d3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:13.051279 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6655f8-d27a-4415-a4fc-9f48ac777d3f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:13.081867 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-63421332-fed4-4929-ac28-0a6fc854dc1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c63aec96101445e6ae6d7ef257dd1afe', 'request_id': 'req-63421332-fed4-4929-ac28-0a6fc854dc1f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:13.083177 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1029/2074] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:27:13 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:27:13.087235 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6655f8-d27a-4415-a4fc-9f48ac777d3f admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:13.092335 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-63421332-fed4-4929-ac28-0a6fc854dc1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c63aec96101445e6ae6d7ef257dd1afe', 'request_id': 'req-63421332-fed4-4929-ac28-0a6fc854dc1f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:13.099200 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-63421332-fed4-4929-ac28-0a6fc854dc1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c63aec96101445e6ae6d7ef257dd1afe', 'request_id': 'req-63421332-fed4-4929-ac28-0a6fc854dc1f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:13.115542 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-63421332-fed4-4929-ac28-0a6fc854dc1f admin admin] The token cache is being invalidate because project c63aec96101445e6ae6d7ef257dd1afe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:27:13.115945 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-63421332-fed4-4929-ac28-0a6fc854dc1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:13.116555 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-63421332-fed4-4929-ac28-0a6fc854dc1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:13.118202 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1046/2075] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:27:12 2022] DELETE /identity/v3/projects/c63aec96101445e6ae6d7ef257dd1afe => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:13.123105 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ce710-5cc1-483f-95f2-1226b4c4fd8e None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:13.123384 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ce710-5cc1-483f-95f2-1226b4c4fd8e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:13.123939 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ce710-5cc1-483f-95f2-1226b4c4fd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:13.157166 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-0b1ce710-5cc1-483f-95f2-1226b4c4fd8e None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:13.158075 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0b1ce710-5cc1-483f-95f2-1226b4c4fd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:13.170660 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6655f8-d27a-4415-a4fc-9f48ac777d3f admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:13.171908 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1047/2076] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:27:13.177197 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499ec70-d342-45b6-80c9-a9d47907161f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:13.177879 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499ec70-d342-45b6-80c9-a9d47907161f admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:13.178262 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499ec70-d342-45b6-80c9-a9d47907161f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:13.178408 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499ec70-d342-45b6-80c9-a9d47907161f admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:13.179059 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b499ec70-d342-45b6-80c9-a9d47907161f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:13.181173 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b499ec70-d342-45b6-80c9-a9d47907161f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:13.181319 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c76179-81be-44b5-a370-6531bd976986 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:13.181454 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c76179-81be-44b5-a370-6531bd976986 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:13.181771 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c76179-81be-44b5-a370-6531bd976986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:13.216831 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1030/2077] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:27:13 2022] POST /identity/v3/users => generated 289 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:27:13.219848 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-53c76179-81be-44b5-a370-6531bd976986 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:13.220814 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499ec70-d342-45b6-80c9-a9d47907161f admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:13.221437 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-53c76179-81be-44b5-a370-6531bd976986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:13.222641 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b499ec70-d342-45b6-80c9-a9d47907161f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:13.231495 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1048/2078] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:13.236194 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c76179-81be-44b5-a370-6531bd976986 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:13.238229 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499ec70-d342-45b6-80c9-a9d47907161f admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:13.243507 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85423ba1-46da-41c4-a189-86c379a233ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:13.244193 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85423ba1-46da-41c4-a189-86c379a233ca admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:13.244539 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85423ba1-46da-41c4-a189-86c379a233ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:13.244895 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85423ba1-46da-41c4-a189-86c379a233ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:13.245666 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85423ba1-46da-41c4-a189-86c379a233ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:13.247520 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85423ba1-46da-41c4-a189-86c379a233ca admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:13.248061 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c76179-81be-44b5-a370-6531bd976986 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:13.253628 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956bb6e-4b3d-465a-b76b-8f1e8f6cf8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:13.254375 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956bb6e-4b3d-465a-b76b-8f1e8f6cf8cb admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:13.254482 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956bb6e-4b3d-465a-b76b-8f1e8f6cf8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:13.254755 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956bb6e-4b3d-465a-b76b-8f1e8f6cf8cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:13.255482 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956bb6e-4b3d-465a-b76b-8f1e8f6cf8cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:27:13.255869 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956bb6e-4b3d-465a-b76b-8f1e8f6cf8cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:13.257810 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956bb6e-4b3d-465a-b76b-8f1e8f6cf8cb admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:13.260052 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1031/2079] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 13:27:13.264436 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85423ba1-46da-41c4-a189-86c379a233ca admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:13.274457 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85423ba1-46da-41c4-a189-86c379a233ca admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:13.275566 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1049/2080] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:27:13.280289 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956bb6e-4b3d-465a-b76b-8f1e8f6cf8cb admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:13.284880 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce322ba3-3c8b-414e-acf3-8057db93aff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:13.285700 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce322ba3-3c8b-414e-acf3-8057db93aff6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:13.286167 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce322ba3-3c8b-414e-acf3-8057db93aff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:13.286443 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce322ba3-3c8b-414e-acf3-8057db93aff6 admin admin] PATH_INFO: `/v3/projects/4c3936e6662b482984018206aa2a7e85/users/d5089135db244bb685bcd3993c8e0bbc/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:13.293897 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956bb6e-4b3d-465a-b76b-8f1e8f6cf8cb admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:13.298693 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd621f4-cd00-4536-8500-b90d8200990d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:13.299485 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd621f4-cd00-4536-8500-b90d8200990d admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:13.299766 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd621f4-cd00-4536-8500-b90d8200990d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:13.300037 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd621f4-cd00-4536-8500-b90d8200990d admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:13.300888 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd621f4-cd00-4536-8500-b90d8200990d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:13.303726 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd621f4-cd00-4536-8500-b90d8200990d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:13.305291 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce322ba3-3c8b-414e-acf3-8057db93aff6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c3936e6662b482984018206aa2a7e85, user_id=d5089135db244bb685bcd3993c8e0bbc, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:13.311456 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce322ba3-3c8b-414e-acf3-8057db93aff6 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:13.333268 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1032/2081] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:27:13 2022] PUT /identity/v3/projects/4c3936e6662b482984018206aa2a7e85/users/d5089135db244bb685bcd3993c8e0bbc/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:27:13.334826 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce322ba3-3c8b-414e-acf3-8057db93aff6 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:13.343068 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1050/2082] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:27:13 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:27:13.344080 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd621f4-cd00-4536-8500-b90d8200990d admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:13.349122 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:13.398537 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:13.418304 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce322ba3-3c8b-414e-acf3-8057db93aff6 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:13.422564 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd621f4-cd00-4536-8500-b90d8200990d admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:13.431453 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c289d-1724-4229-b203-08a85c91d917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:13.431649 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56282b80-1490-4cc2-ac93-5e7af20f2f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:13.432137 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56282b80-1490-4cc2-ac93-5e7af20f2f3a admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:13.432298 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c289d-1724-4229-b203-08a85c91d917 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:13.432481 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c289d-1724-4229-b203-08a85c91d917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:13.432594 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56282b80-1490-4cc2-ac93-5e7af20f2f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:13.432780 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56282b80-1490-4cc2-ac93-5e7af20f2f3a admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:13.433253 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c289d-1724-4229-b203-08a85c91d917 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:13.433621 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56282b80-1490-4cc2-ac93-5e7af20f2f3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:13.434758 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156c289d-1724-4229-b203-08a85c91d917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:13.435700 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56282b80-1490-4cc2-ac93-5e7af20f2f3a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:13.436791 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156c289d-1724-4229-b203-08a85c91d917 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:13.450517 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1033/2083] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 13:27:13.454826 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c289d-1724-4229-b203-08a85c91d917 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:13.460005 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1051/2084] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:27:13 2022] POST /identity/v3/users => generated 286 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:27:13.464852 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56282b80-1490-4cc2-ac93-5e7af20f2f3a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:13.467347 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c289d-1724-4229-b203-08a85c91d917 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:13.472848 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53281709-2a94-4693-b843-d99327a030a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:13.473663 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53281709-2a94-4693-b843-d99327a030a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:13.474020 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53281709-2a94-4693-b843-d99327a030a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:13.474295 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53281709-2a94-4693-b843-d99327a030a7 admin admin] PATH_INFO: `/v3/projects/4c3936e6662b482984018206aa2a7e85/users/d5089135db244bb685bcd3993c8e0bbc/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:13.476101 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56282b80-1490-4cc2-ac93-5e7af20f2f3a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:13.476236 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53281709-2a94-4693-b843-d99327a030a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c3936e6662b482984018206aa2a7e85, user_id=d5089135db244bb685bcd3993c8e0bbc, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:13.478992 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53281709-2a94-4693-b843-d99327a030a7 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:13.481600 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d1b272-c46f-4919-b7c0-44fe94077064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:13.482178 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1b272-c46f-4919-b7c0-44fe94077064 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:13.482451 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1b272-c46f-4919-b7c0-44fe94077064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:13.483367 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1b272-c46f-4919-b7c0-44fe94077064 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:13.484036 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d1b272-c46f-4919-b7c0-44fe94077064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:13.485724 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d1b272-c46f-4919-b7c0-44fe94077064 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:13.491642 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1034/2085] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:27:13 2022] PUT /identity/v3/projects/4c3936e6662b482984018206aa2a7e85/users/d5089135db244bb685bcd3993c8e0bbc/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:27:13.504124 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76041249-244f-4a7e-b1d0-5a1c58af0403 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:13.504645 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76041249-244f-4a7e-b1d0-5a1c58af0403 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:13.505017 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76041249-244f-4a7e-b1d0-5a1c58af0403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:13.507301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1052/2086] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:27:13.511660 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d1b272-c46f-4919-b7c0-44fe94077064 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:13.523788 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d1b272-c46f-4919-b7c0-44fe94077064 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:13.544869 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-76041249-244f-4a7e-b1d0-5a1c58af0403 None None] MFA Rules not processed for user `d5089135db244bb685bcd3993c8e0bbc`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:13.546349 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-76041249-244f-4a7e-b1d0-5a1c58af0403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:13.601705 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7b7af-b42f-49f2-9918-28067e7ed094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:13.602470 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7b7af-b42f-49f2-9918-28067e7ed094 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:13.602833 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7b7af-b42f-49f2-9918-28067e7ed094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:13.603193 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7b7af-b42f-49f2-9918-28067e7ed094 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:13.603924 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7b7af-b42f-49f2-9918-28067e7ed094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:13.605842 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7b7af-b42f-49f2-9918-28067e7ed094 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:13.619218 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1053/2087] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:27:13.624090 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7b7af-b42f-49f2-9918-28067e7ed094 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:13.635022 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7b7af-b42f-49f2-9918-28067e7ed094 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:13.637587 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1035/2088] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:13 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:13.640208 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db9277-a65d-48dc-adcc-49a9fae3992f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:13.640886 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db9277-a65d-48dc-adcc-49a9fae3992f admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:13.641163 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db9277-a65d-48dc-adcc-49a9fae3992f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:13.641436 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db9277-a65d-48dc-adcc-49a9fae3992f admin admin] PATH_INFO: `/v3/projects/0ae904b928a64efaa3171f2371852ea9/users/9685c1f4c815465690884c10b272a961/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:13.649129 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76041249-244f-4a7e-b1d0-5a1c58af0403 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:13.650630 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-76041249-244f-4a7e-b1d0-5a1c58af0403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:13.661393 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75db9277-a65d-48dc-adcc-49a9fae3992f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ae904b928a64efaa3171f2371852ea9, user_id=9685c1f4c815465690884c10b272a961, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:13.664320 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75db9277-a65d-48dc-adcc-49a9fae3992f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:13.681270 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1054/2089] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:27:13 2022] PUT /identity/v3/projects/0ae904b928a64efaa3171f2371852ea9/users/9685c1f4c815465690884c10b272a961/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:27:13.693070 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67f9b5-75be-4b2a-8ef2-8bf5deba92b9 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:13.693458 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67f9b5-75be-4b2a-8ef2-8bf5deba92b9 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:13.693825 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67f9b5-75be-4b2a-8ef2-8bf5deba92b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:13.724476 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76041249-244f-4a7e-b1d0-5a1c58af0403 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:13.725184 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-3f67f9b5-75be-4b2a-8ef2-8bf5deba92b9 None None] MFA Rules not processed for user `9685c1f4c815465690884c10b272a961`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:13.726508 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3f67f9b5-75be-4b2a-8ef2-8bf5deba92b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:13.783777 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8aeafd-2193-43a1-be5f-3484bd3ed97a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:13.784552 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8aeafd-2193-43a1-be5f-3484bd3ed97a service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:13.784981 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8aeafd-2193-43a1-be5f-3484bd3ed97a service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:13.785414 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8aeafd-2193-43a1-be5f-3484bd3ed97a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:13.795499 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:13.823598 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:13.832852 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1055/2090] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:13.844958 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67f9b5-75be-4b2a-8ef2-8bf5deba92b9 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:13.846497 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3f67f9b5-75be-4b2a-8ef2-8bf5deba92b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:13.860234 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67f9b5-75be-4b2a-8ef2-8bf5deba92b9 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:13.865502 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148cda2-da9b-4ae9-b3b5-531a4b7480db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:13.865854 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8aeafd-2193-43a1-be5f-3484bd3ed97a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:13.866586 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148cda2-da9b-4ae9-b3b5-531a4b7480db service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:13.866586 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148cda2-da9b-4ae9-b3b5-531a4b7480db service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:13.866798 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148cda2-da9b-4ae9-b3b5-531a4b7480db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:13.867330 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8aeafd-2193-43a1-be5f-3484bd3ed97a service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:13.876591 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d148cda2-da9b-4ae9-b3b5-531a4b7480db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:13.878287 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d148cda2-da9b-4ae9-b3b5-531a4b7480db service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:13.881006 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1036/2091] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:27:13 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:27:13.889901 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1056/2092] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:27:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:27:13.919151 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8aeafd-2193-43a1-be5f-3484bd3ed97a service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:13.997667 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8aeafd-2193-43a1-be5f-3484bd3ed97a service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:13.999161 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148cda2-da9b-4ae9-b3b5-531a4b7480db service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:14.003962 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5c672-df08-47e3-bb19-9680a24712d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:14.004670 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5c672-df08-47e3-bb19-9680a24712d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:14.005006 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5c672-df08-47e3-bb19-9680a24712d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:14.005293 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5c672-df08-47e3-bb19-9680a24712d1 admin admin] PATH_INFO: `/v3/users/9685c1f4c815465690884c10b272a961` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:14.007593 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d5c672-df08-47e3-bb19-9680a24712d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9685c1f4c815465690884c10b272a961)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:14.009598 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d5c672-df08-47e3-bb19-9680a24712d1 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:14.012632 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148cda2-da9b-4ae9-b3b5-531a4b7480db service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:14.017571 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938f854-c2e0-409a-a90c-c13281333e0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:14.018276 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938f854-c2e0-409a-a90c-c13281333e0f service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:14.018618 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938f854-c2e0-409a-a90c-c13281333e0f service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:14.018896 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938f854-c2e0-409a-a90c-c13281333e0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:14.020707 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a938f854-c2e0-409a-a90c-c13281333e0f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:14.068922 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f5d5c672-df08-47e3-bb19-9680a24712d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9685c1f4c815465690884c10b272a961'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:14.070009 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f5d5c672-df08-47e3-bb19-9680a24712d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9685c1f4c815465690884c10b272a961'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:14.079211 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f5d5c672-df08-47e3-bb19-9680a24712d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9685c1f4c815465690884c10b272a961'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:14.091521 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a938f854-c2e0-409a-a90c-c13281333e0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:14.092996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a938f854-c2e0-409a-a90c-c13281333e0f service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:14.093405 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f5d5c672-df08-47e3-bb19-9680a24712d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9685c1f4c815465690884c10b272a961'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:14.094166 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f5d5c672-df08-47e3-bb19-9680a24712d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9685c1f4c815465690884c10b272a961'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:14.103099 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1057/2093] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:27:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:27:14.109839 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1037/2094] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:27:13 2022] DELETE /identity/v3/users/9685c1f4c815465690884c10b272a961 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:14.114242 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee05e4-53d6-48a7-a3df-1f80a39d685d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:14.114714 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee05e4-53d6-48a7-a3df-1f80a39d685d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:14.114966 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee05e4-53d6-48a7-a3df-1f80a39d685d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:14.139650 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-43ee05e4-53d6-48a7-a3df-1f80a39d685d None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:14.140898 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-43ee05e4-53d6-48a7-a3df-1f80a39d685d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:14.206348 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1058/2095] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:27:14.217860 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5c672-df08-47e3-bb19-9680a24712d1 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:14.219344 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f5d5c672-df08-47e3-bb19-9680a24712d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:14.281249 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:14.301172 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5c672-df08-47e3-bb19-9680a24712d1 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:14.305420 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371bb90c-d50c-4fde-aa8e-15fdef231f20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:14.306461 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371bb90c-d50c-4fde-aa8e-15fdef231f20 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:14.306848 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371bb90c-d50c-4fde-aa8e-15fdef231f20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:14.306991 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371bb90c-d50c-4fde-aa8e-15fdef231f20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:14.318512 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371bb90c-d50c-4fde-aa8e-15fdef231f20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:14.319975 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371bb90c-d50c-4fde-aa8e-15fdef231f20 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:14.330207 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1038/2096] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:27:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:27:14.618388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee05e4-53d6-48a7-a3df-1f80a39d685d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:14.619993 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-43ee05e4-53d6-48a7-a3df-1f80a39d685d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:14.633267 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee05e4-53d6-48a7-a3df-1f80a39d685d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:14.638677 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420992e-81a9-4929-897c-319b93f0ce49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:14.639417 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420992e-81a9-4929-897c-319b93f0ce49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:14.639750 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420992e-81a9-4929-897c-319b93f0ce49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:14.640067 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420992e-81a9-4929-897c-319b93f0ce49 admin admin] PATH_INFO: `/v3/projects/0ae904b928a64efaa3171f2371852ea9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:14.641525 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2420992e-81a9-4929-897c-319b93f0ce49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ae904b928a64efaa3171f2371852ea9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:14.643614 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2420992e-81a9-4929-897c-319b93f0ce49 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:14.696734 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2420992e-81a9-4929-897c-319b93f0ce49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ae904b928a64efaa3171f2371852ea9', 'request_id': 'req-2420992e-81a9-4929-897c-319b93f0ce49'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:14.702758 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2420992e-81a9-4929-897c-319b93f0ce49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ae904b928a64efaa3171f2371852ea9', 'request_id': 'req-2420992e-81a9-4929-897c-319b93f0ce49'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:14.709408 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2420992e-81a9-4929-897c-319b93f0ce49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ae904b928a64efaa3171f2371852ea9', 'request_id': 'req-2420992e-81a9-4929-897c-319b93f0ce49'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:14.711165 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:14.726259 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2420992e-81a9-4929-897c-319b93f0ce49 admin admin] The token cache is being invalidate because project 0ae904b928a64efaa3171f2371852ea9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:27:14.726549 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2420992e-81a9-4929-897c-319b93f0ce49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:14.727349 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2420992e-81a9-4929-897c-319b93f0ce49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:14.728959 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1059/2097] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:27:14 2022] DELETE /identity/v3/projects/0ae904b928a64efaa3171f2371852ea9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:14.734713 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48504dd4-88ce-4dab-93d0-a47d69616680 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:14.735195 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48504dd4-88ce-4dab-93d0-a47d69616680 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:14.735195 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48504dd4-88ce-4dab-93d0-a47d69616680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:14.755706 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-48504dd4-88ce-4dab-93d0-a47d69616680 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:14.756941 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-48504dd4-88ce-4dab-93d0-a47d69616680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:14.794640 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be718e-173d-413b-81d0-69980e7503b6 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:14.794928 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be718e-173d-413b-81d0-69980e7503b6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:14.795195 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be718e-173d-413b-81d0-69980e7503b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:14.818769 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-f7be718e-173d-413b-81d0-69980e7503b6 None None] MFA Rules not processed for user `c937e0b3cf994041af4b96f9abe0fc59`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:14.820227 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f7be718e-173d-413b-81d0-69980e7503b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:14.826789 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1039/2098] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:14.834610 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf001c3c-07ee-4547-80d8-5387865d00c0 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:14.834916 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf001c3c-07ee-4547-80d8-5387865d00c0 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:14.835206 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf001c3c-07ee-4547-80d8-5387865d00c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:14.855087 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-cf001c3c-07ee-4547-80d8-5387865d00c0 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:14.856340 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-cf001c3c-07ee-4547-80d8-5387865d00c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:14.864619 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1040/2099] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:27:14.868747 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf001c3c-07ee-4547-80d8-5387865d00c0 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:14.878470 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf001c3c-07ee-4547-80d8-5387865d00c0 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:14.880010 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1060/2100] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:14.883356 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8578d86-4773-4672-8410-d417183910be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:14.883955 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8578d86-4773-4672-8410-d417183910be admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:14.884369 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8578d86-4773-4672-8410-d417183910be admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:14.884650 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8578d86-4773-4672-8410-d417183910be admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:14.885411 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8578d86-4773-4672-8410-d417183910be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:27:14.885748 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8578d86-4773-4672-8410-d417183910be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:14.887382 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8578d86-4773-4672-8410-d417183910be admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:14.903933 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1041/2101] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:27:14.905369 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be718e-173d-413b-81d0-69980e7503b6 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:14.916748 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be718e-173d-413b-81d0-69980e7503b6 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:14.921659 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4886baad-4e6e-457c-b903-cc3e172127d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:14.922295 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886baad-4e6e-457c-b903-cc3e172127d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:14.922573 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886baad-4e6e-457c-b903-cc3e172127d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:14.922852 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886baad-4e6e-457c-b903-cc3e172127d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:14.923509 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4886baad-4e6e-457c-b903-cc3e172127d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:14.925451 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4886baad-4e6e-457c-b903-cc3e172127d0 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:14.958630 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1061/2102] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:27:14 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:27:14.962876 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8578d86-4773-4672-8410-d417183910be admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:14.973254 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8578d86-4773-4672-8410-d417183910be admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:15.034173 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ba6b5-0588-49c5-abeb-8b121235bb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:15.034835 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ba6b5-0588-49c5-abeb-8b121235bb41 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:15.035110 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ba6b5-0588-49c5-abeb-8b121235bb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:15.035399 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ba6b5-0588-49c5-abeb-8b121235bb41 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:15.036048 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ba6b5-0588-49c5-abeb-8b121235bb41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:15.038050 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ba6b5-0588-49c5-abeb-8b121235bb41 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:15.065164 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1042/2103] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:27:14 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:27:15.069897 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4886baad-4e6e-457c-b903-cc3e172127d0 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:15.080712 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4886baad-4e6e-457c-b903-cc3e172127d0 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:15.086242 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6db5d1-c049-4107-aa6f-211b347c80ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:15.086866 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6db5d1-c049-4107-aa6f-211b347c80ff admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:15.087141 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6db5d1-c049-4107-aa6f-211b347c80ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:15.087403 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6db5d1-c049-4107-aa6f-211b347c80ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:15.088072 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6db5d1-c049-4107-aa6f-211b347c80ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:15.089745 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6db5d1-c049-4107-aa6f-211b347c80ff admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:15.100676 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1062/2104] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:27:15.105040 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ba6b5-0588-49c5-abeb-8b121235bb41 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:15.116018 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ba6b5-0588-49c5-abeb-8b121235bb41 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:15.121440 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d6745-bb59-4da3-b0eb-8287c4586368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:15.122069 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d6745-bb59-4da3-b0eb-8287c4586368 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:15.122347 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d6745-bb59-4da3-b0eb-8287c4586368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:15.122618 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d6745-bb59-4da3-b0eb-8287c4586368 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:15.123261 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4d6745-bb59-4da3-b0eb-8287c4586368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:15.124896 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4d6745-bb59-4da3-b0eb-8287c4586368 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:15.136244 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1043/2105] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:27:15.140748 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6db5d1-c049-4107-aa6f-211b347c80ff admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:15.151503 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6db5d1-c049-4107-aa6f-211b347c80ff admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:15.157255 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709a375-4b8e-44d3-be37-490e197f71b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:15.158047 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709a375-4b8e-44d3-be37-490e197f71b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:15.158323 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709a375-4b8e-44d3-be37-490e197f71b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:15.158590 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709a375-4b8e-44d3-be37-490e197f71b4 admin admin] PATH_INFO: `/v3/projects/16569dad3608430d91a40d999fb79430/users/50c586fe68d1486a92ff0bace85ee5fc/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:15.175644 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5709a375-4b8e-44d3-be37-490e197f71b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16569dad3608430d91a40d999fb79430, user_id=50c586fe68d1486a92ff0bace85ee5fc, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:15.178368 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5709a375-4b8e-44d3-be37-490e197f71b4 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:15.193402 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1063/2106] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:27:15 2022] PUT /identity/v3/projects/16569dad3608430d91a40d999fb79430/users/50c586fe68d1486a92ff0bace85ee5fc/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:27:15.205393 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ceb61-c28f-45af-bed6-20b40f6faa04 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:15.205716 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ceb61-c28f-45af-bed6-20b40f6faa04 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:15.206112 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ceb61-c28f-45af-bed6-20b40f6faa04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:15.236027 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-439ceb61-c28f-45af-bed6-20b40f6faa04 None None] MFA Rules not processed for user `50c586fe68d1486a92ff0bace85ee5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:15.237382 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-439ceb61-c28f-45af-bed6-20b40f6faa04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:15.274424 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:15.322643 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1044/2107] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:27:15.327529 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709a375-4b8e-44d3-be37-490e197f71b4 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:15.404956 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709a375-4b8e-44d3-be37-490e197f71b4 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:15.409913 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011896e-7dfc-4bc8-8a71-ce8f721e05e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:15.410628 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011896e-7dfc-4bc8-8a71-ce8f721e05e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:15.410971 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011896e-7dfc-4bc8-8a71-ce8f721e05e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:15.411242 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011896e-7dfc-4bc8-8a71-ce8f721e05e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:15.412015 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d011896e-7dfc-4bc8-8a71-ce8f721e05e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:15.414015 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d011896e-7dfc-4bc8-8a71-ce8f721e05e6 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:15.445631 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1064/2108] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:27:15 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:27:15.448713 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ceb61-c28f-45af-bed6-20b40f6faa04 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:15.460621 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ceb61-c28f-45af-bed6-20b40f6faa04 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:15.546197 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84a495-ea4a-4bb5-830d-777e85a7a979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:15.546967 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84a495-ea4a-4bb5-830d-777e85a7a979 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:15.547241 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84a495-ea4a-4bb5-830d-777e85a7a979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:15.547516 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84a495-ea4a-4bb5-830d-777e85a7a979 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:15.548181 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84a495-ea4a-4bb5-830d-777e85a7a979 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:15.550341 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84a495-ea4a-4bb5-830d-777e85a7a979 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:15.578717 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1045/2109] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:27:15 2022] POST /identity/v3/users => generated 293 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:27:15.583239 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011896e-7dfc-4bc8-8a71-ce8f721e05e6 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:15.598776 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011896e-7dfc-4bc8-8a71-ce8f721e05e6 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:15.620300 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d499f-c2b5-4584-a24a-9961b29e5045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:15.621056 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d499f-c2b5-4584-a24a-9961b29e5045 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:15.621333 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d499f-c2b5-4584-a24a-9961b29e5045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:15.621645 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d499f-c2b5-4584-a24a-9961b29e5045 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:15.622454 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d499f-c2b5-4584-a24a-9961b29e5045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:15.624008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d499f-c2b5-4584-a24a-9961b29e5045 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:15.637754 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1065/2110] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:27:15.641970 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84a495-ea4a-4bb5-830d-777e85a7a979 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:15.654770 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84a495-ea4a-4bb5-830d-777e85a7a979 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:15.660064 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913766db-75eb-4e7b-83d2-012e50a49cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:15.660764 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913766db-75eb-4e7b-83d2-012e50a49cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:15.661154 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913766db-75eb-4e7b-83d2-012e50a49cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:15.661521 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913766db-75eb-4e7b-83d2-012e50a49cd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:15.662336 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913766db-75eb-4e7b-83d2-012e50a49cd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:15.664077 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913766db-75eb-4e7b-83d2-012e50a49cd2 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:15.678804 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1046/2111] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 13:27:15.680554 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d499f-c2b5-4584-a24a-9961b29e5045 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:15.695617 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d499f-c2b5-4584-a24a-9961b29e5045 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:15.701263 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497494a0-27df-4a60-8579-e7facdd37ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:15.702229 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497494a0-27df-4a60-8579-e7facdd37ee1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:15.702780 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497494a0-27df-4a60-8579-e7facdd37ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:15.703054 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497494a0-27df-4a60-8579-e7facdd37ee1 admin admin] PATH_INFO: `/v3/projects/7cda0ceff53a4a8b9bb808bd181c65fb/users/a0451d5e504d48e0b4c95466d297d5bd/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:15.715511 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:15.722273 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497494a0-27df-4a60-8579-e7facdd37ee1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cda0ceff53a4a8b9bb808bd181c65fb, user_id=a0451d5e504d48e0b4c95466d297d5bd, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:15.725044 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497494a0-27df-4a60-8579-e7facdd37ee1 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:15.750648 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1066/2112] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:27:15 2022] PUT /identity/v3/projects/7cda0ceff53a4a8b9bb808bd181c65fb/users/a0451d5e504d48e0b4c95466d297d5bd/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:27:15.762942 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe59bf2-8ade-4564-9b69-d6060253553a None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:15.763420 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe59bf2-8ade-4564-9b69-d6060253553a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:15.763507 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe59bf2-8ade-4564-9b69-d6060253553a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:15.804810 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-bfe59bf2-8ade-4564-9b69-d6060253553a None None] MFA Rules not processed for user `a0451d5e504d48e0b4c95466d297d5bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:15.806605 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-bfe59bf2-8ade-4564-9b69-d6060253553a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:15.877674 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1047/2113] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:15.882047 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497494a0-27df-4a60-8579-e7facdd37ee1 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:15.949033 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497494a0-27df-4a60-8579-e7facdd37ee1 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:15.953934 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e7f14d-dbc4-4648-a2bc-219c0ce71878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:15.954544 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7f14d-dbc4-4648-a2bc-219c0ce71878 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:15.954818 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7f14d-dbc4-4648-a2bc-219c0ce71878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:15.955082 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7f14d-dbc4-4648-a2bc-219c0ce71878 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:15.955743 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e7f14d-dbc4-4648-a2bc-219c0ce71878 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:15.957842 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e7f14d-dbc4-4648-a2bc-219c0ce71878 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:15.989577 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1067/2114] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:27:15 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:27:15.993521 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe59bf2-8ade-4564-9b69-d6060253553a None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:16.005355 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe59bf2-8ade-4564-9b69-d6060253553a None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:16.047956 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:16.067591 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd00543-5aaf-4991-937a-667fc5f52b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:16.068233 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd00543-5aaf-4991-937a-667fc5f52b3e admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:16.068573 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd00543-5aaf-4991-937a-667fc5f52b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:16.068849 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd00543-5aaf-4991-937a-667fc5f52b3e admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:16.069498 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd00543-5aaf-4991-937a-667fc5f52b3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:16.071552 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd00543-5aaf-4991-937a-667fc5f52b3e admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:16.096080 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1048/2115] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:27:15 2022] POST /identity/v3/users => generated 299 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:27:16.100453 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e7f14d-dbc4-4648-a2bc-219c0ce71878 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:16.111578 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e7f14d-dbc4-4648-a2bc-219c0ce71878 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:16.116769 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d8ab8-edac-4a13-b665-322ab355b4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:16.117393 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d8ab8-edac-4a13-b665-322ab355b4b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:16.117795 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d8ab8-edac-4a13-b665-322ab355b4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:16.118100 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d8ab8-edac-4a13-b665-322ab355b4b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:16.118762 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d8ab8-edac-4a13-b665-322ab355b4b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:16.120436 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d8ab8-edac-4a13-b665-322ab355b4b6 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:16.132259 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1068/2116] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:27:16.136805 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd00543-5aaf-4991-937a-667fc5f52b3e admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:16.147543 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd00543-5aaf-4991-937a-667fc5f52b3e admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:16.152860 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7e2b1-2682-4f71-9995-99359fae8965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:16.153631 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7e2b1-2682-4f71-9995-99359fae8965 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:16.153904 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7e2b1-2682-4f71-9995-99359fae8965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:16.154178 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7e2b1-2682-4f71-9995-99359fae8965 admin admin] PATH_INFO: `/v3/projects/b9e022e6146545aa89665a603f229ac4/users/f4e3df3eb9244778ac8c401105d0b1c9/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:16.171577 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a7e2b1-2682-4f71-9995-99359fae8965 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9e022e6146545aa89665a603f229ac4, user_id=f4e3df3eb9244778ac8c401105d0b1c9, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:16.174511 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a7e2b1-2682-4f71-9995-99359fae8965 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:16.190464 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1049/2117] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:27:16 2022] PUT /identity/v3/projects/b9e022e6146545aa89665a603f229ac4/users/f4e3df3eb9244778ac8c401105d0b1c9/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:16.194631 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d8ab8-edac-4a13-b665-322ab355b4b6 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:16.205118 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d8ab8-edac-4a13-b665-322ab355b4b6 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:16.266535 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669afe0-2a7f-4b03-9af1-62ec8a024f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:16.267156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669afe0-2a7f-4b03-9af1-62ec8a024f63 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:16.267438 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669afe0-2a7f-4b03-9af1-62ec8a024f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:16.267710 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669afe0-2a7f-4b03-9af1-62ec8a024f63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:16.268361 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669afe0-2a7f-4b03-9af1-62ec8a024f63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:16.270191 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669afe0-2a7f-4b03-9af1-62ec8a024f63 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:16.280997 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1069/2118] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:27:16.285644 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7e2b1-2682-4f71-9995-99359fae8965 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:16.297795 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7e2b1-2682-4f71-9995-99359fae8965 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:16.302805 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463c47c-23ac-4bdc-8441-14e601740602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:16.303551 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463c47c-23ac-4bdc-8441-14e601740602 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:16.303839 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463c47c-23ac-4bdc-8441-14e601740602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:16.304111 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463c47c-23ac-4bdc-8441-14e601740602 admin admin] PATH_INFO: `/v3/projects/b9e022e6146545aa89665a603f229ac4/users/f4e3df3eb9244778ac8c401105d0b1c9/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:16.306226 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d463c47c-23ac-4bdc-8441-14e601740602 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9e022e6146545aa89665a603f229ac4, user_id=f4e3df3eb9244778ac8c401105d0b1c9, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:16.309197 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d463c47c-23ac-4bdc-8441-14e601740602 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:16.320720 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1050/2119] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:27:16 2022] PUT /identity/v3/projects/b9e022e6146545aa89665a603f229ac4/users/f4e3df3eb9244778ac8c401105d0b1c9/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:16.331776 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28bfe1-8107-4b9d-8698-f3034e8145c5 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:16.332060 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28bfe1-8107-4b9d-8698-f3034e8145c5 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:16.332335 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28bfe1-8107-4b9d-8698-f3034e8145c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:16.361213 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-7c28bfe1-8107-4b9d-8698-f3034e8145c5 None None] MFA Rules not processed for user `f4e3df3eb9244778ac8c401105d0b1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:16.362439 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7c28bfe1-8107-4b9d-8698-f3034e8145c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:16.413932 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:16.439141 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1070/2120] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:16 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:27:16.451546 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463c47c-23ac-4bdc-8441-14e601740602 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:16.453238 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d463c47c-23ac-4bdc-8441-14e601740602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:16.516358 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463c47c-23ac-4bdc-8441-14e601740602 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:16.520534 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658fa289-9c56-447d-8efd-3d73ea809c3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:16.521159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658fa289-9c56-447d-8efd-3d73ea809c3a service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:16.521435 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658fa289-9c56-447d-8efd-3d73ea809c3a service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:16.522546 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658fa289-9c56-447d-8efd-3d73ea809c3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:16.591141 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658fa289-9c56-447d-8efd-3d73ea809c3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:16.592530 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658fa289-9c56-447d-8efd-3d73ea809c3a service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:16.602408 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1051/2121] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:27:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:27:18.175057 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c28bfe1-8107-4b9d-8698-f3034e8145c5 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:18.185141 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c28bfe1-8107-4b9d-8698-f3034e8145c5 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:18.189175 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53242d-081c-4d0a-831e-01fa7f6c8334 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:18.189817 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53242d-081c-4d0a-831e-01fa7f6c8334 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:18.190088 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53242d-081c-4d0a-831e-01fa7f6c8334 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:18.190354 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53242d-081c-4d0a-831e-01fa7f6c8334 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:18.258740 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e53242d-081c-4d0a-831e-01fa7f6c8334 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:18.260333 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e53242d-081c-4d0a-831e-01fa7f6c8334 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:18.270932 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1071/2122] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:27:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:27:18.886070 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658fa289-9c56-447d-8efd-3d73ea809c3a service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:18.895685 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658fa289-9c56-447d-8efd-3d73ea809c3a service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:18.899673 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb73e27-a77b-47b4-9820-baebe71896c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:18.900280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb73e27-a77b-47b4-9820-baebe71896c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:18.900556 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb73e27-a77b-47b4-9820-baebe71896c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:18.900825 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb73e27-a77b-47b4-9820-baebe71896c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:18.916880 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb73e27-a77b-47b4-9820-baebe71896c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:18.919870 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb73e27-a77b-47b4-9820-baebe71896c7 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:18.932307 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1052/2123] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:27:18 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:27:20.523330 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53242d-081c-4d0a-831e-01fa7f6c8334 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:20.524782 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3e53242d-081c-4d0a-831e-01fa7f6c8334 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:20.595784 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53242d-081c-4d0a-831e-01fa7f6c8334 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:20.600229 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a80f8-9477-4edc-aac6-c619e4fc8d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:20.600877 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a80f8-9477-4edc-aac6-c619e4fc8d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:20.601131 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a80f8-9477-4edc-aac6-c619e4fc8d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:20.601399 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a80f8-9477-4edc-aac6-c619e4fc8d52 admin admin] PATH_INFO: `/v3/users/4eaf6b0bb47845909bc3323d78a1a566` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:20.602622 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2a80f8-9477-4edc-aac6-c619e4fc8d52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eaf6b0bb47845909bc3323d78a1a566)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:20.604534 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2a80f8-9477-4edc-aac6-c619e4fc8d52 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:20.663181 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1d2a80f8-9477-4edc-aac6-c619e4fc8d52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eaf6b0bb47845909bc3323d78a1a566'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:20.663895 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1d2a80f8-9477-4edc-aac6-c619e4fc8d52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eaf6b0bb47845909bc3323d78a1a566'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:20.674016 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1d2a80f8-9477-4edc-aac6-c619e4fc8d52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eaf6b0bb47845909bc3323d78a1a566'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:20.698139 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1d2a80f8-9477-4edc-aac6-c619e4fc8d52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eaf6b0bb47845909bc3323d78a1a566'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:20.699272 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1d2a80f8-9477-4edc-aac6-c619e4fc8d52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eaf6b0bb47845909bc3323d78a1a566'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:20.714146 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1072/2124] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:27:20 2022] DELETE /identity/v3/users/4eaf6b0bb47845909bc3323d78a1a566 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:20.718714 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc0b49-18bb-4a83-80aa-adf81f8f01f5 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:20.719166 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc0b49-18bb-4a83-80aa-adf81f8f01f5 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:20.719346 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc0b49-18bb-4a83-80aa-adf81f8f01f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:20.739715 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-b6fc0b49-18bb-4a83-80aa-adf81f8f01f5 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:20.743273 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b6fc0b49-18bb-4a83-80aa-adf81f8f01f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:20.774797 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:20.818814 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1053/2125] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:20.829879 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a80f8-9477-4edc-aac6-c619e4fc8d52 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:20.831306 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1d2a80f8-9477-4edc-aac6-c619e4fc8d52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:20.837222 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:20.894921 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a80f8-9477-4edc-aac6-c619e4fc8d52 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:20.898624 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef1faf-f7e5-41bd-bbdf-db29d92a729e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:20.899322 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef1faf-f7e5-41bd-bbdf-db29d92a729e service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:20.899603 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef1faf-f7e5-41bd-bbdf-db29d92a729e service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:20.899886 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef1faf-f7e5-41bd-bbdf-db29d92a729e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:20.910209 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef1faf-f7e5-41bd-bbdf-db29d92a729e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:20.911719 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef1faf-f7e5-41bd-bbdf-db29d92a729e service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:20.921470 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1073/2126] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:27:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:27:21.208652 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc0b49-18bb-4a83-80aa-adf81f8f01f5 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:21.210234 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b6fc0b49-18bb-4a83-80aa-adf81f8f01f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:21.234258 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc0b49-18bb-4a83-80aa-adf81f8f01f5 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:21.240809 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd7383-d6f0-42c1-a6d9-df83b79ab712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:21.241494 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd7383-d6f0-42c1-a6d9-df83b79ab712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:21.241882 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd7383-d6f0-42c1-a6d9-df83b79ab712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:21.242059 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd7383-d6f0-42c1-a6d9-df83b79ab712 admin admin] PATH_INFO: `/v3/projects/574de4694402479c8278535776a5a7e4` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:21.243192 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd7383-d6f0-42c1-a6d9-df83b79ab712 admin admin] RBAC: Authorizing `identity:delete_project(project_id=574de4694402479c8278535776a5a7e4)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:21.245114 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd7383-d6f0-42c1-a6d9-df83b79ab712 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:21.296251 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1bcd7383-d6f0-42c1-a6d9-df83b79ab712 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '574de4694402479c8278535776a5a7e4', 'request_id': 'req-1bcd7383-d6f0-42c1-a6d9-df83b79ab712'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:21.305278 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1bcd7383-d6f0-42c1-a6d9-df83b79ab712 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '574de4694402479c8278535776a5a7e4', 'request_id': 'req-1bcd7383-d6f0-42c1-a6d9-df83b79ab712'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:21.317326 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1bcd7383-d6f0-42c1-a6d9-df83b79ab712 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '574de4694402479c8278535776a5a7e4', 'request_id': 'req-1bcd7383-d6f0-42c1-a6d9-df83b79ab712'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:21.328747 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1bcd7383-d6f0-42c1-a6d9-df83b79ab712 admin admin] The token cache is being invalidate because project 574de4694402479c8278535776a5a7e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:27:21.329028 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1bcd7383-d6f0-42c1-a6d9-df83b79ab712 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:21.329751 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1bcd7383-d6f0-42c1-a6d9-df83b79ab712 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:21.331346 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1054/2127] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:27:21 2022] DELETE /identity/v3/projects/574de4694402479c8278535776a5a7e4 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:21.336337 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef1faf-f7e5-41bd-bbdf-db29d92a729e service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:21.346175 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef1faf-f7e5-41bd-bbdf-db29d92a729e service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:21.410908 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268a062-6504-4391-8157-3a0c33710617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:21.411824 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268a062-6504-4391-8157-3a0c33710617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:21.412194 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268a062-6504-4391-8157-3a0c33710617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:21.412558 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268a062-6504-4391-8157-3a0c33710617 admin admin] PATH_INFO: `/v3/users/d5089135db244bb685bcd3993c8e0bbc` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:21.413837 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268a062-6504-4391-8157-3a0c33710617 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5089135db244bb685bcd3993c8e0bbc)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:21.415855 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268a062-6504-4391-8157-3a0c33710617 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:21.474361 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c268a062-6504-4391-8157-3a0c33710617 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5089135db244bb685bcd3993c8e0bbc'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:21.475997 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c268a062-6504-4391-8157-3a0c33710617 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5089135db244bb685bcd3993c8e0bbc'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:21.486928 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c268a062-6504-4391-8157-3a0c33710617 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5089135db244bb685bcd3993c8e0bbc'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:21.501768 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c268a062-6504-4391-8157-3a0c33710617 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5089135db244bb685bcd3993c8e0bbc'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:21.502680 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c268a062-6504-4391-8157-3a0c33710617 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5089135db244bb685bcd3993c8e0bbc'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:21.523822 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1074/2128] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:27:21 2022] DELETE /identity/v3/users/d5089135db244bb685bcd3993c8e0bbc => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:27:21.984120 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd7383-d6f0-42c1-a6d9-df83b79ab712 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:21.986612 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1bcd7383-d6f0-42c1-a6d9-df83b79ab712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:22.003504 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd7383-d6f0-42c1-a6d9-df83b79ab712 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:22.067770 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d2ee34-02b2-4f8d-9ae8-76653abb65c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:22.068528 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2ee34-02b2-4f8d-9ae8-76653abb65c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:22.068854 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2ee34-02b2-4f8d-9ae8-76653abb65c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:22.069125 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2ee34-02b2-4f8d-9ae8-76653abb65c6 admin admin] PATH_INFO: `/v3/projects/4c3936e6662b482984018206aa2a7e85` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:22.070380 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d2ee34-02b2-4f8d-9ae8-76653abb65c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c3936e6662b482984018206aa2a7e85)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:22.072307 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d2ee34-02b2-4f8d-9ae8-76653abb65c6 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:22.120296 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-99d2ee34-02b2-4f8d-9ae8-76653abb65c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c3936e6662b482984018206aa2a7e85', 'request_id': 'req-99d2ee34-02b2-4f8d-9ae8-76653abb65c6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:22.129101 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-99d2ee34-02b2-4f8d-9ae8-76653abb65c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c3936e6662b482984018206aa2a7e85', 'request_id': 'req-99d2ee34-02b2-4f8d-9ae8-76653abb65c6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:22.136258 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-99d2ee34-02b2-4f8d-9ae8-76653abb65c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c3936e6662b482984018206aa2a7e85', 'request_id': 'req-99d2ee34-02b2-4f8d-9ae8-76653abb65c6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:22.138075 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:22.152549 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-99d2ee34-02b2-4f8d-9ae8-76653abb65c6 admin admin] The token cache is being invalidate because project 4c3936e6662b482984018206aa2a7e85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:27:22.153453 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-99d2ee34-02b2-4f8d-9ae8-76653abb65c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:22.154182 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-99d2ee34-02b2-4f8d-9ae8-76653abb65c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:22.156406 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1055/2129] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:27:21 2022] DELETE /identity/v3/projects/4c3936e6662b482984018206aa2a7e85 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:22.161183 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea15c7-5f3d-457d-9895-45da69fe5be9 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:22.161452 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea15c7-5f3d-457d-9895-45da69fe5be9 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:22.161739 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea15c7-5f3d-457d-9895-45da69fe5be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:22.182170 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-3bea15c7-5f3d-457d-9895-45da69fe5be9 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:22.183736 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3bea15c7-5f3d-457d-9895-45da69fe5be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:22.204446 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:22.249491 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1075/2130] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:22.258130 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf1ea1-af14-4485-a0b4-c573e17466f5 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:22.258411 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf1ea1-af14-4485-a0b4-c573e17466f5 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:22.258682 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf1ea1-af14-4485-a0b4-c573e17466f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:22.279189 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-0ecf1ea1-af14-4485-a0b4-c573e17466f5 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:22.280434 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0ecf1ea1-af14-4485-a0b4-c573e17466f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:22.288988 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1056/2131] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:22.293554 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea15c7-5f3d-457d-9895-45da69fe5be9 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:22.303258 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea15c7-5f3d-457d-9895-45da69fe5be9 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:22.308156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474903ed-216d-4374-95dd-11a34e9b0b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:22.308782 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474903ed-216d-4374-95dd-11a34e9b0b31 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:22.309057 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474903ed-216d-4374-95dd-11a34e9b0b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:22.309324 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474903ed-216d-4374-95dd-11a34e9b0b31 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:22.310052 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474903ed-216d-4374-95dd-11a34e9b0b31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:27:22.312138 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474903ed-216d-4374-95dd-11a34e9b0b31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:22.313898 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474903ed-216d-4374-95dd-11a34e9b0b31 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:22.326016 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1076/2132] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:27:22.330557 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf1ea1-af14-4485-a0b4-c573e17466f5 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:22.340089 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf1ea1-af14-4485-a0b4-c573e17466f5 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:22.344803 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d8ed4-7d7c-4583-b0c3-d1247e6cc8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:22.345411 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d8ed4-7d7c-4583-b0c3-d1247e6cc8a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:22.345721 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d8ed4-7d7c-4583-b0c3-d1247e6cc8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:22.345987 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d8ed4-7d7c-4583-b0c3-d1247e6cc8a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:22.346639 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d8ed4-7d7c-4583-b0c3-d1247e6cc8a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:22.348585 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d8ed4-7d7c-4583-b0c3-d1247e6cc8a3 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:22.380040 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1057/2133] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:27:22 2022] POST /identity/v3/projects => generated 367 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:27:22.384458 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474903ed-216d-4374-95dd-11a34e9b0b31 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:22.395648 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474903ed-216d-4374-95dd-11a34e9b0b31 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:22.461674 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1c81e-9008-4785-8c27-c65dfe5487a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:22.462330 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1c81e-9008-4785-8c27-c65dfe5487a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:22.462611 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1c81e-9008-4785-8c27-c65dfe5487a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:22.462880 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1c81e-9008-4785-8c27-c65dfe5487a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:22.463550 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c1c81e-9008-4785-8c27-c65dfe5487a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:22.465750 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c1c81e-9008-4785-8c27-c65dfe5487a2 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:22.496719 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1077/2134] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:27:22 2022] POST /identity/v3/users => generated 284 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:27:22.498200 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d8ed4-7d7c-4583-b0c3-d1247e6cc8a3 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:22.509477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d8ed4-7d7c-4583-b0c3-d1247e6cc8a3 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:22.515066 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ffce07-5c8d-459f-abde-b9b3c1497d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:22.515702 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffce07-5c8d-459f-abde-b9b3c1497d91 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:22.515982 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffce07-5c8d-459f-abde-b9b3c1497d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:22.516258 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffce07-5c8d-459f-abde-b9b3c1497d91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:22.516915 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ffce07-5c8d-459f-abde-b9b3c1497d91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:22.518630 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ffce07-5c8d-459f-abde-b9b3c1497d91 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:22.533402 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1058/2135] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:27:22.535009 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1c81e-9008-4785-8c27-c65dfe5487a2 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:22.547461 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1c81e-9008-4785-8c27-c65dfe5487a2 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:22.553238 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d481add-111d-466c-9a73-a780c47faa9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:22.554037 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d481add-111d-466c-9a73-a780c47faa9e admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:22.554577 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d481add-111d-466c-9a73-a780c47faa9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:22.554950 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d481add-111d-466c-9a73-a780c47faa9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:22.555727 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d481add-111d-466c-9a73-a780c47faa9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:22.557516 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d481add-111d-466c-9a73-a780c47faa9e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:22.574695 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1078/2136] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:27:22.578921 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ffce07-5c8d-459f-abde-b9b3c1497d91 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:22.589746 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ffce07-5c8d-459f-abde-b9b3c1497d91 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:22.595358 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d7178-048d-451a-8114-97880b609213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:22.596144 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d7178-048d-451a-8114-97880b609213 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:22.596552 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d7178-048d-451a-8114-97880b609213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:22.597570 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d7178-048d-451a-8114-97880b609213 admin admin] PATH_INFO: `/v3/projects/2ef5872081ef47eaba7d35858fbb0700/users/794b2e5134894dd89510b8da157ea879/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:22.614305 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d7178-048d-451a-8114-97880b609213 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ef5872081ef47eaba7d35858fbb0700, user_id=794b2e5134894dd89510b8da157ea879, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:22.617158 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d7178-048d-451a-8114-97880b609213 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:22.631791 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1059/2137] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:27:22 2022] PUT /identity/v3/projects/2ef5872081ef47eaba7d35858fbb0700/users/794b2e5134894dd89510b8da157ea879/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:22.642580 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a287462-d040-45fc-abf0-748a88552760 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:22.642925 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a287462-d040-45fc-abf0-748a88552760 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:22.643581 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a287462-d040-45fc-abf0-748a88552760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:22.673256 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-8a287462-d040-45fc-abf0-748a88552760 None None] MFA Rules not processed for user `794b2e5134894dd89510b8da157ea879`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:22.674491 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8a287462-d040-45fc-abf0-748a88552760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:22.750072 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1079/2138] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:22.754788 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d7178-048d-451a-8114-97880b609213 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:22.858082 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d7178-048d-451a-8114-97880b609213 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:22.864070 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c70b8-9547-4ced-898a-7fcb0179ca25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:22.864894 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c70b8-9547-4ced-898a-7fcb0179ca25 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:22.865230 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c70b8-9547-4ced-898a-7fcb0179ca25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:22.865596 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c70b8-9547-4ced-898a-7fcb0179ca25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:22.866333 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c70b8-9547-4ced-898a-7fcb0179ca25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:22.868451 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c70b8-9547-4ced-898a-7fcb0179ca25 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:22.905256 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1060/2139] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:27:22 2022] POST /identity/v3/projects => generated 367 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:27:22.909265 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a287462-d040-45fc-abf0-748a88552760 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:22.923988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a287462-d040-45fc-abf0-748a88552760 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:22.949514 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:23.006699 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c70b8-9547-4ced-898a-7fcb0179ca25 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:23.008654 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-df3c70b8-9547-4ced-898a-7fcb0179ca25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:23.027403 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562c6c3-c51b-4ff5-84ec-9750114bd4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:23.028640 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562c6c3-c51b-4ff5-84ec-9750114bd4d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:23.029306 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562c6c3-c51b-4ff5-84ec-9750114bd4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:23.029803 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562c6c3-c51b-4ff5-84ec-9750114bd4d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:23.030668 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b562c6c3-c51b-4ff5-84ec-9750114bd4d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:23.032844 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b562c6c3-c51b-4ff5-84ec-9750114bd4d1 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:23.067651 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1080/2140] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:27:22 2022] POST /identity/v3/users => generated 290 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:27:23.072013 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562c6c3-c51b-4ff5-84ec-9750114bd4d1 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:23.094975 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562c6c3-c51b-4ff5-84ec-9750114bd4d1 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:23.104995 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0963f59-02ae-43ef-a302-b0223d0cd32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:23.107300 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0963f59-02ae-43ef-a302-b0223d0cd32a admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:23.108231 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0963f59-02ae-43ef-a302-b0223d0cd32a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:23.110668 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c70b8-9547-4ced-898a-7fcb0179ca25 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:23.111168 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0963f59-02ae-43ef-a302-b0223d0cd32a admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:23.112064 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0963f59-02ae-43ef-a302-b0223d0cd32a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:23.114742 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0963f59-02ae-43ef-a302-b0223d0cd32a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:23.127033 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd1a8b2-c19c-4752-aaf3-52175c992122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:23.127791 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1a8b2-c19c-4752-aaf3-52175c992122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:23.128286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1a8b2-c19c-4752-aaf3-52175c992122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:23.128639 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1a8b2-c19c-4752-aaf3-52175c992122 admin admin] PATH_INFO: `/v3/users/50c586fe68d1486a92ff0bace85ee5fc` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:23.130185 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd1a8b2-c19c-4752-aaf3-52175c992122 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50c586fe68d1486a92ff0bace85ee5fc)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:23.132299 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd1a8b2-c19c-4752-aaf3-52175c992122 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:23.138855 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1081/2141] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 13:27:23.140038 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0963f59-02ae-43ef-a302-b0223d0cd32a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:23.153858 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0963f59-02ae-43ef-a302-b0223d0cd32a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:23.161154 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:23.161700 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c8cd0-5843-4759-acd8-1fb9dc42737c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:23.162639 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c8cd0-5843-4759-acd8-1fb9dc42737c admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:23.163147 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c8cd0-5843-4759-acd8-1fb9dc42737c admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:23.163643 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c8cd0-5843-4759-acd8-1fb9dc42737c admin admin] PATH_INFO: `/v3/projects/cfd49d9daf244a64884c75c34202eebf/users/90b58d35969b48c09c10355e88025d85/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:23.186144 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c8cd0-5843-4759-acd8-1fb9dc42737c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfd49d9daf244a64884c75c34202eebf, user_id=90b58d35969b48c09c10355e88025d85, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:23.189193 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c8cd0-5843-4759-acd8-1fb9dc42737c admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:23.377142 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1082/2142] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:27:23 2022] PUT /identity/v3/projects/cfd49d9daf244a64884c75c34202eebf/users/90b58d35969b48c09c10355e88025d85/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:23.384234 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c8cd0-5843-4759-acd8-1fb9dc42737c admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:23.401931 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5fd1a8b2-c19c-4752-aaf3-52175c992122 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50c586fe68d1486a92ff0bace85ee5fc'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:23.402619 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5fd1a8b2-c19c-4752-aaf3-52175c992122 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50c586fe68d1486a92ff0bace85ee5fc'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:23.412234 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5fd1a8b2-c19c-4752-aaf3-52175c992122 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50c586fe68d1486a92ff0bace85ee5fc'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:23.433357 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5fd1a8b2-c19c-4752-aaf3-52175c992122 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50c586fe68d1486a92ff0bace85ee5fc'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:23.434159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5fd1a8b2-c19c-4752-aaf3-52175c992122 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50c586fe68d1486a92ff0bace85ee5fc'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:23.455226 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1061/2143] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:27:23 2022] DELETE /identity/v3/users/50c586fe68d1486a92ff0bace85ee5fc => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:27:23.461300 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db8411-b84a-4aae-a7f9-52ea2e274dae None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:23.461598 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db8411-b84a-4aae-a7f9-52ea2e274dae None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:23.464637 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db8411-b84a-4aae-a7f9-52ea2e274dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:23.474502 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c8cd0-5843-4759-acd8-1fb9dc42737c admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:23.493466 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-55db8411-b84a-4aae-a7f9-52ea2e274dae None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:23.494736 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-55db8411-b84a-4aae-a7f9-52ea2e274dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:23.553308 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f73d06-d3a8-429b-80de-25d48414c8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:23.554429 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f73d06-d3a8-429b-80de-25d48414c8c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:23.554812 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f73d06-d3a8-429b-80de-25d48414c8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:23.555191 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f73d06-d3a8-429b-80de-25d48414c8c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:23.556111 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f73d06-d3a8-429b-80de-25d48414c8c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:23.560626 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f73d06-d3a8-429b-80de-25d48414c8c0 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:23.580690 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1062/2144] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:23.581721 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1083/2145] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:27:23.585588 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db8411-b84a-4aae-a7f9-52ea2e274dae None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:23.587277 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-55db8411-b84a-4aae-a7f9-52ea2e274dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:23.598684 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f73d06-d3a8-429b-80de-25d48414c8c0 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:23.601054 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d3f73d06-d3a8-429b-80de-25d48414c8c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:23.606767 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db8411-b84a-4aae-a7f9-52ea2e274dae None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:23.612693 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb3e62-7a18-482d-88cf-f7e2bcdcb2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:23.613939 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb3e62-7a18-482d-88cf-f7e2bcdcb2a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:23.614316 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb3e62-7a18-482d-88cf-f7e2bcdcb2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:23.614679 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb3e62-7a18-482d-88cf-f7e2bcdcb2a4 admin admin] PATH_INFO: `/v3/projects/cfd49d9daf244a64884c75c34202eebf/users/90b58d35969b48c09c10355e88025d85/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:23.619221 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb3e62-7a18-482d-88cf-f7e2bcdcb2a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfd49d9daf244a64884c75c34202eebf, user_id=90b58d35969b48c09c10355e88025d85, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:23.625028 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb3e62-7a18-482d-88cf-f7e2bcdcb2a4 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:23.633324 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:23.651492 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1063/2146] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:27:23 2022] PUT /identity/v3/projects/cfd49d9daf244a64884c75c34202eebf/users/90b58d35969b48c09c10355e88025d85/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:27:23.664968 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedd021-6cc4-4522-a432-cd87d3f85bd6 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:23.665423 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedd021-6cc4-4522-a432-cd87d3f85bd6 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:23.665975 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedd021-6cc4-4522-a432-cd87d3f85bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:23.707698 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-5cedd021-6cc4-4522-a432-cd87d3f85bd6 None None] MFA Rules not processed for user `90b58d35969b48c09c10355e88025d85`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:23.708974 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5cedd021-6cc4-4522-a432-cd87d3f85bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:23.711400 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f73d06-d3a8-429b-80de-25d48414c8c0 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:23.765743 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d84db-c240-49f1-b5c7-b2113b3cbd6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:23.766376 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d84db-c240-49f1-b5c7-b2113b3cbd6f service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:23.766653 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d84db-c240-49f1-b5c7-b2113b3cbd6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:23.766920 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d84db-c240-49f1-b5c7-b2113b3cbd6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:23.787683 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1064/2147] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:23 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:27:23.801109 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cedd021-6cc4-4522-a432-cd87d3f85bd6 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:23.803077 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5cedd021-6cc4-4522-a432-cd87d3f85bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:23.811349 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:23.839834 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d84db-c240-49f1-b5c7-b2113b3cbd6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:23.841741 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d84db-c240-49f1-b5c7-b2113b3cbd6f service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:23.867824 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1084/2148] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:27:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:27:23.876300 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cedd021-6cc4-4522-a432-cd87d3f85bd6 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:23.880883 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73525e07-9b73-453c-a7d7-63faf66bcf2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:23.882764 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73525e07-9b73-453c-a7d7-63faf66bcf2c service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:23.883214 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73525e07-9b73-453c-a7d7-63faf66bcf2c service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:23.883674 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73525e07-9b73-453c-a7d7-63faf66bcf2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:23.895680 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73525e07-9b73-453c-a7d7-63faf66bcf2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:23.897337 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73525e07-9b73-453c-a7d7-63faf66bcf2c service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:23.908076 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1065/2149] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:27:23 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:27:24.198892 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d84db-c240-49f1-b5c7-b2113b3cbd6f service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:24.202235 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b99d84db-c240-49f1-b5c7-b2113b3cbd6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:24.229484 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d84db-c240-49f1-b5c7-b2113b3cbd6f service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:24.235579 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19c9bd-c1ac-4f57-9898-6e4913eb27f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:24.236228 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19c9bd-c1ac-4f57-9898-6e4913eb27f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:24.236508 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19c9bd-c1ac-4f57-9898-6e4913eb27f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:24.236784 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19c9bd-c1ac-4f57-9898-6e4913eb27f5 admin admin] PATH_INFO: `/v3/projects/16569dad3608430d91a40d999fb79430` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:24.238041 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf19c9bd-c1ac-4f57-9898-6e4913eb27f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16569dad3608430d91a40d999fb79430)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:24.240019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf19c9bd-c1ac-4f57-9898-6e4913eb27f5 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:24.297179 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-cf19c9bd-c1ac-4f57-9898-6e4913eb27f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16569dad3608430d91a40d999fb79430', 'request_id': 'req-cf19c9bd-c1ac-4f57-9898-6e4913eb27f5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:24.307954 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-cf19c9bd-c1ac-4f57-9898-6e4913eb27f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16569dad3608430d91a40d999fb79430', 'request_id': 'req-cf19c9bd-c1ac-4f57-9898-6e4913eb27f5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:24.320659 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-cf19c9bd-c1ac-4f57-9898-6e4913eb27f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16569dad3608430d91a40d999fb79430', 'request_id': 'req-cf19c9bd-c1ac-4f57-9898-6e4913eb27f5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:24.337932 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-cf19c9bd-c1ac-4f57-9898-6e4913eb27f5 admin admin] The token cache is being invalidate because project 16569dad3608430d91a40d999fb79430 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:27:24.338297 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-cf19c9bd-c1ac-4f57-9898-6e4913eb27f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:24.338943 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-cf19c9bd-c1ac-4f57-9898-6e4913eb27f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:24.340962 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1085/2150] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:27:24 2022] DELETE /identity/v3/projects/16569dad3608430d91a40d999fb79430 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:24.345600 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73525e07-9b73-453c-a7d7-63faf66bcf2c service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:24.357747 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73525e07-9b73-453c-a7d7-63faf66bcf2c service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:24.424774 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f5ce3c-426d-43b0-9335-f31430012b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:24.425422 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5ce3c-426d-43b0-9335-f31430012b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:24.425719 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5ce3c-426d-43b0-9335-f31430012b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:24.425996 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5ce3c-426d-43b0-9335-f31430012b16 admin admin] PATH_INFO: `/v3/users/a0451d5e504d48e0b4c95466d297d5bd` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:24.427287 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f5ce3c-426d-43b0-9335-f31430012b16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0451d5e504d48e0b4c95466d297d5bd)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:24.429232 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f5ce3c-426d-43b0-9335-f31430012b16 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:24.510645 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-23f5ce3c-426d-43b0-9335-f31430012b16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0451d5e504d48e0b4c95466d297d5bd'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:24.511392 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-23f5ce3c-426d-43b0-9335-f31430012b16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0451d5e504d48e0b4c95466d297d5bd'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:24.520739 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-23f5ce3c-426d-43b0-9335-f31430012b16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0451d5e504d48e0b4c95466d297d5bd'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:24.544328 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-23f5ce3c-426d-43b0-9335-f31430012b16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0451d5e504d48e0b4c95466d297d5bd'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:24.545208 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-23f5ce3c-426d-43b0-9335-f31430012b16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0451d5e504d48e0b4c95466d297d5bd'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:24.566966 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1066/2151] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:27:24 2022] DELETE /identity/v3/users/a0451d5e504d48e0b4c95466d297d5bd => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:25.014430 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19c9bd-c1ac-4f57-9898-6e4913eb27f5 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:25.016531 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cf19c9bd-c1ac-4f57-9898-6e4913eb27f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:25.035614 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19c9bd-c1ac-4f57-9898-6e4913eb27f5 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:25.046410 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:25.151580 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d1ff1-47c1-4ff2-a99e-e3772d8aa0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:25.152545 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d1ff1-47c1-4ff2-a99e-e3772d8aa0a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:25.152841 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d1ff1-47c1-4ff2-a99e-e3772d8aa0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:25.153096 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d1ff1-47c1-4ff2-a99e-e3772d8aa0a1 admin admin] PATH_INFO: `/v3/projects/7cda0ceff53a4a8b9bb808bd181c65fb` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:25.154441 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d1ff1-47c1-4ff2-a99e-e3772d8aa0a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cda0ceff53a4a8b9bb808bd181c65fb)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:25.157278 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d1ff1-47c1-4ff2-a99e-e3772d8aa0a1 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:25.227341 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f72d1ff1-47c1-4ff2-a99e-e3772d8aa0a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cda0ceff53a4a8b9bb808bd181c65fb', 'request_id': 'req-f72d1ff1-47c1-4ff2-a99e-e3772d8aa0a1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:25.235363 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f72d1ff1-47c1-4ff2-a99e-e3772d8aa0a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cda0ceff53a4a8b9bb808bd181c65fb', 'request_id': 'req-f72d1ff1-47c1-4ff2-a99e-e3772d8aa0a1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:25.263149 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f72d1ff1-47c1-4ff2-a99e-e3772d8aa0a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cda0ceff53a4a8b9bb808bd181c65fb', 'request_id': 'req-f72d1ff1-47c1-4ff2-a99e-e3772d8aa0a1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:25.288398 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f72d1ff1-47c1-4ff2-a99e-e3772d8aa0a1 admin admin] The token cache is being invalidate because project 7cda0ceff53a4a8b9bb808bd181c65fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:27:25.288758 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f72d1ff1-47c1-4ff2-a99e-e3772d8aa0a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:25.289812 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f72d1ff1-47c1-4ff2-a99e-e3772d8aa0a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:25.291593 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1086/2152] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:27:25 2022] DELETE /identity/v3/projects/7cda0ceff53a4a8b9bb808bd181c65fb => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:25.295640 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f5ce3c-426d-43b0-9335-f31430012b16 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:25.297044 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-23f5ce3c-426d-43b0-9335-f31430012b16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:25.314163 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f5ce3c-426d-43b0-9335-f31430012b16 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:25.338074 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:25.390741 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39086328-ed05-475f-a5e3-2a32222a7c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:25.392245 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39086328-ed05-475f-a5e3-2a32222a7c8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:25.392614 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39086328-ed05-475f-a5e3-2a32222a7c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:25.393042 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39086328-ed05-475f-a5e3-2a32222a7c8c admin admin] PATH_INFO: `/v3/users/f4e3df3eb9244778ac8c401105d0b1c9` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:25.394562 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39086328-ed05-475f-a5e3-2a32222a7c8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4e3df3eb9244778ac8c401105d0b1c9)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:25.398614 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39086328-ed05-475f-a5e3-2a32222a7c8c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:25.466303 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-39086328-ed05-475f-a5e3-2a32222a7c8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4e3df3eb9244778ac8c401105d0b1c9'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:25.467254 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-39086328-ed05-475f-a5e3-2a32222a7c8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4e3df3eb9244778ac8c401105d0b1c9'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:25.476590 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-39086328-ed05-475f-a5e3-2a32222a7c8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4e3df3eb9244778ac8c401105d0b1c9'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:25.490298 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-39086328-ed05-475f-a5e3-2a32222a7c8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4e3df3eb9244778ac8c401105d0b1c9'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:25.491051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-39086328-ed05-475f-a5e3-2a32222a7c8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4e3df3eb9244778ac8c401105d0b1c9'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:25.507809 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1067/2153] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:27:25 2022] DELETE /identity/v3/users/f4e3df3eb9244778ac8c401105d0b1c9 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:25.672449 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d1ff1-47c1-4ff2-a99e-e3772d8aa0a1 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:25.673945 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f72d1ff1-47c1-4ff2-a99e-e3772d8aa0a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:25.691344 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d1ff1-47c1-4ff2-a99e-e3772d8aa0a1 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:25.699491 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39086328-ed05-475f-a5e3-2a32222a7c8c admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:25.701199 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-39086328-ed05-475f-a5e3-2a32222a7c8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:25.777116 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08716bff-ab6f-4c7d-8d63-f38234b02546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:25.781681 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08716bff-ab6f-4c7d-8d63-f38234b02546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:25.782170 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08716bff-ab6f-4c7d-8d63-f38234b02546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:25.782444 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08716bff-ab6f-4c7d-8d63-f38234b02546 admin admin] PATH_INFO: `/v3/users/c937e0b3cf994041af4b96f9abe0fc59` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:25.785369 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08716bff-ab6f-4c7d-8d63-f38234b02546 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c937e0b3cf994041af4b96f9abe0fc59)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:25.787577 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08716bff-ab6f-4c7d-8d63-f38234b02546 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:25.795794 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39086328-ed05-475f-a5e3-2a32222a7c8c admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:25.812031 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35be80-5128-498f-aa52-90b0e7087810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:25.812853 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35be80-5128-498f-aa52-90b0e7087810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:25.813229 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35be80-5128-498f-aa52-90b0e7087810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:25.813669 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35be80-5128-498f-aa52-90b0e7087810 admin admin] PATH_INFO: `/v3/users/794b2e5134894dd89510b8da157ea879` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:25.815781 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca35be80-5128-498f-aa52-90b0e7087810 admin admin] RBAC: Authorizing `identity:delete_user(user_id=794b2e5134894dd89510b8da157ea879)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:25.818758 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca35be80-5128-498f-aa52-90b0e7087810 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:25.856009 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:25.872549 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-08716bff-ab6f-4c7d-8d63-f38234b02546 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c937e0b3cf994041af4b96f9abe0fc59'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:25.874275 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-08716bff-ab6f-4c7d-8d63-f38234b02546 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c937e0b3cf994041af4b96f9abe0fc59'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:25.884697 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-08716bff-ab6f-4c7d-8d63-f38234b02546 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c937e0b3cf994041af4b96f9abe0fc59'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:25.892883 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:25.894434 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ca35be80-5128-498f-aa52-90b0e7087810 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '794b2e5134894dd89510b8da157ea879'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:25.895279 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ca35be80-5128-498f-aa52-90b0e7087810 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '794b2e5134894dd89510b8da157ea879'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:25.903967 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-08716bff-ab6f-4c7d-8d63-f38234b02546 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c937e0b3cf994041af4b96f9abe0fc59'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:25.905501 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-08716bff-ab6f-4c7d-8d63-f38234b02546 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c937e0b3cf994041af4b96f9abe0fc59'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:25.906033 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ca35be80-5128-498f-aa52-90b0e7087810 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '794b2e5134894dd89510b8da157ea879'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:25.920329 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ca35be80-5128-498f-aa52-90b0e7087810 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '794b2e5134894dd89510b8da157ea879'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:25.921066 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ca35be80-5128-498f-aa52-90b0e7087810 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '794b2e5134894dd89510b8da157ea879'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:25.925675 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1087/2154] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:27:25 2022] DELETE /identity/v3/users/c937e0b3cf994041af4b96f9abe0fc59 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:25.944769 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1068/2155] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:27:25 2022] DELETE /identity/v3/users/794b2e5134894dd89510b8da157ea879 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:27:25.949582 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d659f1e-b6b7-429c-a39a-9c8089074f47 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:25.949858 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d659f1e-b6b7-429c-a39a-9c8089074f47 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:25.950174 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d659f1e-b6b7-429c-a39a-9c8089074f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:25.972114 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-1d659f1e-b6b7-429c-a39a-9c8089074f47 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:25.972933 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1d659f1e-b6b7-429c-a39a-9c8089074f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:26.035409 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35be80-5128-498f-aa52-90b0e7087810 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:26.036561 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ca35be80-5128-498f-aa52-90b0e7087810 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:26.062755 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1088/2156] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:26.073785 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d659f1e-b6b7-429c-a39a-9c8089074f47 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:26.075798 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1d659f1e-b6b7-429c-a39a-9c8089074f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:26.133126 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35be80-5128-498f-aa52-90b0e7087810 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:26.138008 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a24f2f-0112-40ea-9a99-43f07b11244f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:26.138646 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a24f2f-0112-40ea-9a99-43f07b11244f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:26.138919 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a24f2f-0112-40ea-9a99-43f07b11244f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:26.139189 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a24f2f-0112-40ea-9a99-43f07b11244f admin admin] PATH_INFO: `/v3/projects/b9e022e6146545aa89665a603f229ac4` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:26.140485 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a24f2f-0112-40ea-9a99-43f07b11244f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9e022e6146545aa89665a603f229ac4)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:26.143483 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a24f2f-0112-40ea-9a99-43f07b11244f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:26.145417 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d659f1e-b6b7-429c-a39a-9c8089074f47 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:26.149701 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fabd764-c297-419c-bc8c-9f29327932c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:26.150507 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabd764-c297-419c-bc8c-9f29327932c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:26.150790 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabd764-c297-419c-bc8c-9f29327932c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:26.151093 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabd764-c297-419c-bc8c-9f29327932c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:26.161162 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fabd764-c297-419c-bc8c-9f29327932c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:26.162681 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fabd764-c297-419c-bc8c-9f29327932c4 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:26.181736 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1089/2157] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:27:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:27:26.183257 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fabd764-c297-419c-bc8c-9f29327932c4 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:26.184826 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9fabd764-c297-419c-bc8c-9f29327932c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:26.196334 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-74a24f2f-0112-40ea-9a99-43f07b11244f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9e022e6146545aa89665a603f229ac4', 'request_id': 'req-74a24f2f-0112-40ea-9a99-43f07b11244f'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:26.200077 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fabd764-c297-419c-bc8c-9f29327932c4 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:26.206445 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-74a24f2f-0112-40ea-9a99-43f07b11244f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9e022e6146545aa89665a603f229ac4', 'request_id': 'req-74a24f2f-0112-40ea-9a99-43f07b11244f'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:26.218590 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-74a24f2f-0112-40ea-9a99-43f07b11244f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9e022e6146545aa89665a603f229ac4', 'request_id': 'req-74a24f2f-0112-40ea-9a99-43f07b11244f'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:26.234666 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-74a24f2f-0112-40ea-9a99-43f07b11244f admin admin] The token cache is being invalidate because project b9e022e6146545aa89665a603f229ac4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:27:26.235111 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-74a24f2f-0112-40ea-9a99-43f07b11244f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:26.235902 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-74a24f2f-0112-40ea-9a99-43f07b11244f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:26.237796 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1069/2158] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:27:26 2022] DELETE /identity/v3/projects/b9e022e6146545aa89665a603f229ac4 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:27:26.243261 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8bcb3-54c2-48d4-8e30-8298d61811a1 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:26.243545 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8bcb3-54c2-48d4-8e30-8298d61811a1 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:26.243822 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8bcb3-54c2-48d4-8e30-8298d61811a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:26.265094 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-45f8bcb3-54c2-48d4-8e30-8298d61811a1 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:26.265659 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c46b6-618a-4096-84ef-d12b544e7dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:26.266302 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c46b6-618a-4096-84ef-d12b544e7dba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:26.266415 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-45f8bcb3-54c2-48d4-8e30-8298d61811a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:26.266581 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c46b6-618a-4096-84ef-d12b544e7dba admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:26.266860 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c46b6-618a-4096-84ef-d12b544e7dba admin admin] PATH_INFO: `/v3/projects/895817ad14814e3bbfc199c2bc7eb39e` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:26.267991 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898c46b6-618a-4096-84ef-d12b544e7dba admin admin] RBAC: Authorizing `identity:delete_project(project_id=895817ad14814e3bbfc199c2bc7eb39e)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:26.269950 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898c46b6-618a-4096-84ef-d12b544e7dba admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:26.271760 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:26.276165 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1070/2159] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:26.284841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557048d-def1-408a-a007-2646494d8f8d None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:26.285326 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557048d-def1-408a-a007-2646494d8f8d None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:26.285641 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557048d-def1-408a-a007-2646494d8f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:26.306374 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-7557048d-def1-408a-a007-2646494d8f8d None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:26.308388 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7557048d-def1-408a-a007-2646494d8f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:26.319800 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1071/2160] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:26.326051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557048d-def1-408a-a007-2646494d8f8d None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:26.337121 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557048d-def1-408a-a007-2646494d8f8d None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:26.339154 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-898c46b6-618a-4096-84ef-d12b544e7dba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '895817ad14814e3bbfc199c2bc7eb39e', 'request_id': 'req-898c46b6-618a-4096-84ef-d12b544e7dba'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:26.347873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-898c46b6-618a-4096-84ef-d12b544e7dba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '895817ad14814e3bbfc199c2bc7eb39e', 'request_id': 'req-898c46b6-618a-4096-84ef-d12b544e7dba'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:26.356965 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-898c46b6-618a-4096-84ef-d12b544e7dba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '895817ad14814e3bbfc199c2bc7eb39e', 'request_id': 'req-898c46b6-618a-4096-84ef-d12b544e7dba'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:26.380053 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-898c46b6-618a-4096-84ef-d12b544e7dba admin admin] The token cache is being invalidate because project 895817ad14814e3bbfc199c2bc7eb39e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:27:26.380346 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-898c46b6-618a-4096-84ef-d12b544e7dba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:26.381066 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-898c46b6-618a-4096-84ef-d12b544e7dba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:26.384025 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1090/2161] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:27:26 2022] DELETE /identity/v3/projects/895817ad14814e3bbfc199c2bc7eb39e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:26.388957 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:26.391453 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded76c4c-3445-473e-83fd-f549f0d87bfb None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:26.391723 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded76c4c-3445-473e-83fd-f549f0d87bfb None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:26.391915 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded76c4c-3445-473e-83fd-f549f0d87bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:26.411809 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16112d03-19ea-4351-b42a-776ec590d115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:26.412681 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16112d03-19ea-4351-b42a-776ec590d115 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:26.412681 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16112d03-19ea-4351-b42a-776ec590d115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:26.412969 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16112d03-19ea-4351-b42a-776ec590d115 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:26.413667 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16112d03-19ea-4351-b42a-776ec590d115 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:27:26.414004 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16112d03-19ea-4351-b42a-776ec590d115 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:26.414759 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-ded76c4c-3445-473e-83fd-f549f0d87bfb None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:26.416282 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16112d03-19ea-4351-b42a-776ec590d115 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:26.416398 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ded76c4c-3445-473e-83fd-f549f0d87bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:26.425288 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1091/2162] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:27:26.430116 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1072/2163] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:27:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:27:26.432890 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f604444-257f-44cb-b10a-53626984b871 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:26.433286 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f604444-257f-44cb-b10a-53626984b871 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:26.433673 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f604444-257f-44cb-b10a-53626984b871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:26.434599 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16112d03-19ea-4351-b42a-776ec590d115 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:26.436766 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-16112d03-19ea-4351-b42a-776ec590d115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:26.456768 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16112d03-19ea-4351-b42a-776ec590d115 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:26.459542 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-7f604444-257f-44cb-b10a-53626984b871 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:26.461034 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7f604444-257f-44cb-b10a-53626984b871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:26.462181 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b21cc-9849-4f27-b4dd-452619cab54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:26.463039 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b21cc-9849-4f27-b4dd-452619cab54f admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:26.463514 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b21cc-9849-4f27-b4dd-452619cab54f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:26.463789 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b21cc-9849-4f27-b4dd-452619cab54f admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:26.464658 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b21cc-9849-4f27-b4dd-452619cab54f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:26.466567 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b21cc-9849-4f27-b4dd-452619cab54f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:26.472471 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1092/2164] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:26.475490 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f604444-257f-44cb-b10a-53626984b871 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:26.486525 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f604444-257f-44cb-b10a-53626984b871 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:26.492330 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35245f1e-baf9-4649-bf7b-7288086058b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:26.492330 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35245f1e-baf9-4649-bf7b-7288086058b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:26.492330 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35245f1e-baf9-4649-bf7b-7288086058b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:26.492619 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35245f1e-baf9-4649-bf7b-7288086058b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:26.493254 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35245f1e-baf9-4649-bf7b-7288086058b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:27:26.493371 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35245f1e-baf9-4649-bf7b-7288086058b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:26.495145 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35245f1e-baf9-4649-bf7b-7288086058b4 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:26.508560 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1093/2165] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:27:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:27:26.509242 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35245f1e-baf9-4649-bf7b-7288086058b4 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:26.511012 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-35245f1e-baf9-4649-bf7b-7288086058b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:26.519133 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1073/2166] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:27:26 2022] POST /identity/v3/projects => generated 381 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:27:26.519987 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b21cc-9849-4f27-b4dd-452619cab54f admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:26.527129 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35245f1e-baf9-4649-bf7b-7288086058b4 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:26.588015 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b21cc-9849-4f27-b4dd-452619cab54f admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:26.588234 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a074d16-795e-48c7-89c3-d4ba5909da0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:26.588904 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a074d16-795e-48c7-89c3-d4ba5909da0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:26.589283 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a074d16-795e-48c7-89c3-d4ba5909da0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:26.589654 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a074d16-795e-48c7-89c3-d4ba5909da0c admin admin] PATH_INFO: `/v3/projects/2ef5872081ef47eaba7d35858fbb0700` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:26.590845 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a074d16-795e-48c7-89c3-d4ba5909da0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ef5872081ef47eaba7d35858fbb0700)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:26.592717 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d3a59-5d2f-437a-a1be-d916a2c42525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:26.592897 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a074d16-795e-48c7-89c3-d4ba5909da0c admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:26.593319 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d3a59-5d2f-437a-a1be-d916a2c42525 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:26.593625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d3a59-5d2f-437a-a1be-d916a2c42525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:26.593900 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d3a59-5d2f-437a-a1be-d916a2c42525 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:26.594537 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d3a59-5d2f-437a-a1be-d916a2c42525 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:26.596444 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d3a59-5d2f-437a-a1be-d916a2c42525 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:26.627813 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1074/2167] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:27:26 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:27:26.627813 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d3a59-5d2f-437a-a1be-d916a2c42525 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:26.640742 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0a074d16-795e-48c7-89c3-d4ba5909da0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ef5872081ef47eaba7d35858fbb0700', 'request_id': 'req-0a074d16-795e-48c7-89c3-d4ba5909da0c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:26.646326 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0a074d16-795e-48c7-89c3-d4ba5909da0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ef5872081ef47eaba7d35858fbb0700', 'request_id': 'req-0a074d16-795e-48c7-89c3-d4ba5909da0c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:26.653677 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0a074d16-795e-48c7-89c3-d4ba5909da0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ef5872081ef47eaba7d35858fbb0700', 'request_id': 'req-0a074d16-795e-48c7-89c3-d4ba5909da0c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:26.656217 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:26.669598 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0a074d16-795e-48c7-89c3-d4ba5909da0c admin admin] The token cache is being invalidate because project 2ef5872081ef47eaba7d35858fbb0700 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:27:26.669906 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0a074d16-795e-48c7-89c3-d4ba5909da0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:26.670642 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0a074d16-795e-48c7-89c3-d4ba5909da0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:26.672233 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1094/2168] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:27:26 2022] DELETE /identity/v3/projects/2ef5872081ef47eaba7d35858fbb0700 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:26.672987 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a074d16-795e-48c7-89c3-d4ba5909da0c admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:26.675028 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0a074d16-795e-48c7-89c3-d4ba5909da0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:26.690613 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d3a59-5d2f-437a-a1be-d916a2c42525 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:26.734030 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:26.738565 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a074d16-795e-48c7-89c3-d4ba5909da0c admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:26.743945 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b904cc-2e6e-4daf-9ca5-18b92f826969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:26.744736 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b904cc-2e6e-4daf-9ca5-18b92f826969 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:26.745317 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b904cc-2e6e-4daf-9ca5-18b92f826969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:26.745628 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b904cc-2e6e-4daf-9ca5-18b92f826969 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:26.746267 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b904cc-2e6e-4daf-9ca5-18b92f826969 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:26.748271 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b904cc-2e6e-4daf-9ca5-18b92f826969 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:26.750908 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e77628-cf73-4d21-9eb0-8c88204ceff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:26.751516 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e77628-cf73-4d21-9eb0-8c88204ceff4 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:26.751786 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e77628-cf73-4d21-9eb0-8c88204ceff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:26.752187 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e77628-cf73-4d21-9eb0-8c88204ceff4 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:26.752822 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e77628-cf73-4d21-9eb0-8c88204ceff4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:26.754755 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e77628-cf73-4d21-9eb0-8c88204ceff4 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:26.771052 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1095/2169] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:27:26 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:27:26.771052 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b904cc-2e6e-4daf-9ca5-18b92f826969 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:26.775431 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-45b904cc-2e6e-4daf-9ca5-18b92f826969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:26.779356 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1075/2170] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:27:26 2022] POST /identity/v3/users => generated 291 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:27:26.779356 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e77628-cf73-4d21-9eb0-8c88204ceff4 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:26.788251 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e77628-cf73-4d21-9eb0-8c88204ceff4 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:26.788454 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b904cc-2e6e-4daf-9ca5-18b92f826969 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:26.792901 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713a988-649a-48e8-b7fc-0c928d910fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:26.793317 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc4779-9305-4c21-ac3b-f902f1336d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:26.793498 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713a988-649a-48e8-b7fc-0c928d910fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:26.793814 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713a988-649a-48e8-b7fc-0c928d910fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:26.793981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc4779-9305-4c21-ac3b-f902f1336d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:26.794087 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713a988-649a-48e8-b7fc-0c928d910fa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:26.794258 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc4779-9305-4c21-ac3b-f902f1336d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:26.794535 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc4779-9305-4c21-ac3b-f902f1336d48 admin admin] PATH_INFO: `/v3/users/90b58d35969b48c09c10355e88025d85` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:26.794703 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1713a988-649a-48e8-b7fc-0c928d910fa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:26.795659 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc4779-9305-4c21-ac3b-f902f1336d48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90b58d35969b48c09c10355e88025d85)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:26.796304 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1713a988-649a-48e8-b7fc-0c928d910fa1 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:26.797719 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc4779-9305-4c21-ac3b-f902f1336d48 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:26.812385 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1076/2171] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:27:26.812385 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713a988-649a-48e8-b7fc-0c928d910fa1 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:26.812385 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1713a988-649a-48e8-b7fc-0c928d910fa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:26.824832 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713a988-649a-48e8-b7fc-0c928d910fa1 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:26.830015 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a8835-1c2b-4c39-95a9-af648c65aa5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:26.830437 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a8835-1c2b-4c39-95a9-af648c65aa5d admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:26.830751 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a8835-1c2b-4c39-95a9-af648c65aa5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:26.831081 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a8835-1c2b-4c39-95a9-af648c65aa5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:26.831844 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a8835-1c2b-4c39-95a9-af648c65aa5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:26.833700 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a8835-1c2b-4c39-95a9-af648c65aa5d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:26.845291 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1077/2172] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:27:26.846133 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a8835-1c2b-4c39-95a9-af648c65aa5d admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:26.851198 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2bdc4779-9305-4c21-ac3b-f902f1336d48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90b58d35969b48c09c10355e88025d85'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:26.851989 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2bdc4779-9305-4c21-ac3b-f902f1336d48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90b58d35969b48c09c10355e88025d85'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:26.856159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a8835-1c2b-4c39-95a9-af648c65aa5d admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:26.859073 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2bdc4779-9305-4c21-ac3b-f902f1336d48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90b58d35969b48c09c10355e88025d85'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:26.860960 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d6131-06fd-445e-89fe-3ee4c9b9267a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:26.861695 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d6131-06fd-445e-89fe-3ee4c9b9267a admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:26.862137 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d6131-06fd-445e-89fe-3ee4c9b9267a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:26.862482 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d6131-06fd-445e-89fe-3ee4c9b9267a admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:26.863194 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d6131-06fd-445e-89fe-3ee4c9b9267a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:26.864909 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d6131-06fd-445e-89fe-3ee4c9b9267a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:26.871106 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2bdc4779-9305-4c21-ac3b-f902f1336d48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90b58d35969b48c09c10355e88025d85'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:26.871791 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2bdc4779-9305-4c21-ac3b-f902f1336d48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90b58d35969b48c09c10355e88025d85'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:26.875202 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1078/2173] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:27:26.876138 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d6131-06fd-445e-89fe-3ee4c9b9267a admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:26.877863 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6a2d6131-06fd-445e-89fe-3ee4c9b9267a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:26.888752 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1096/2174] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:27:26 2022] DELETE /identity/v3/users/90b58d35969b48c09c10355e88025d85 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:26.891335 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d6131-06fd-445e-89fe-3ee4c9b9267a admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:26.892686 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc4779-9305-4c21-ac3b-f902f1336d48 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:26.893894 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2bdc4779-9305-4c21-ac3b-f902f1336d48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:26.959520 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331bbe1-db75-425e-9c9d-d95dfcc3cd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:26.960217 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331bbe1-db75-425e-9c9d-d95dfcc3cd90 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:26.960529 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331bbe1-db75-425e-9c9d-d95dfcc3cd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:26.960888 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331bbe1-db75-425e-9c9d-d95dfcc3cd90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:26.961703 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d331bbe1-db75-425e-9c9d-d95dfcc3cd90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:26.963360 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:26.963818 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d331bbe1-db75-425e-9c9d-d95dfcc3cd90 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:26.970570 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc4779-9305-4c21-ac3b-f902f1336d48 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:26.976763 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1079/2175] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:27:26.979125 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f2d9a-4b7c-48a3-963c-fd4e6ed7a444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:26.980668 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f2d9a-4b7c-48a3-963c-fd4e6ed7a444 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:26.981006 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f2d9a-4b7c-48a3-963c-fd4e6ed7a444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:26.981456 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f2d9a-4b7c-48a3-963c-fd4e6ed7a444 admin admin] PATH_INFO: `/v3/projects/6aec30c4c91f410cae3f6bcfe6b41f55/users/a968cbb7b0f04d519071073ad2494ff5/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:26.981778 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331bbe1-db75-425e-9c9d-d95dfcc3cd90 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:26.992721 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331bbe1-db75-425e-9c9d-d95dfcc3cd90 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:26.997857 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f2d9a-4b7c-48a3-963c-fd4e6ed7a444 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aec30c4c91f410cae3f6bcfe6b41f55, user_id=a968cbb7b0f04d519071073ad2494ff5, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:27.000661 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f2d9a-4b7c-48a3-963c-fd4e6ed7a444 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:27.002044 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a7cbbb-877f-406e-9f3d-c6a70ad7cce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:27.002872 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7cbbb-877f-406e-9f3d-c6a70ad7cce3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:27.003155 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7cbbb-877f-406e-9f3d-c6a70ad7cce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:27.003429 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7cbbb-877f-406e-9f3d-c6a70ad7cce3 admin admin] PATH_INFO: `/v3/projects/50b120a9b98e4fd78f36f33a83a28894/users/cdb0e2b312244e9fbfa41fedd8a4f7fd/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:27.015395 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1097/2176] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:27:26 2022] PUT /identity/v3/projects/6aec30c4c91f410cae3f6bcfe6b41f55/users/a968cbb7b0f04d519071073ad2494ff5/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:27.024263 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a7cbbb-877f-406e-9f3d-c6a70ad7cce3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50b120a9b98e4fd78f36f33a83a28894, user_id=cdb0e2b312244e9fbfa41fedd8a4f7fd, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:27.027042 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be41b0a-c06a-4b99-9c91-1728d6586ebf None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:27.027327 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be41b0a-c06a-4b99-9c91-1728d6586ebf None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:27.027589 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be41b0a-c06a-4b99-9c91-1728d6586ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:27.027849 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a7cbbb-877f-406e-9f3d-c6a70ad7cce3 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:27.044778 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1080/2177] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:27:26 2022] PUT /identity/v3/projects/50b120a9b98e4fd78f36f33a83a28894/users/cdb0e2b312244e9fbfa41fedd8a4f7fd/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:27:27.051386 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde64b6f-c7bd-4f42-be7f-39072b9aee74 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:27.051913 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde64b6f-c7bd-4f42-be7f-39072b9aee74 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:27.052490 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde64b6f-c7bd-4f42-be7f-39072b9aee74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:27.075849 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-fde64b6f-c7bd-4f42-be7f-39072b9aee74 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:27.077352 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-fde64b6f-c7bd-4f42-be7f-39072b9aee74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:27.079888 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-7be41b0a-c06a-4b99-9c91-1728d6586ebf None None] MFA Rules not processed for user `a968cbb7b0f04d519071073ad2494ff5`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:27.081083 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7be41b0a-c06a-4b99-9c91-1728d6586ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:27.150995 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1081/2178] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:27:27.161381 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde64b6f-c7bd-4f42-be7f-39072b9aee74 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:27.163173 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-fde64b6f-c7bd-4f42-be7f-39072b9aee74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:27.166910 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1098/2179] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:27:27.171976 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be41b0a-c06a-4b99-9c91-1728d6586ebf None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:27.182768 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:27.184123 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be41b0a-c06a-4b99-9c91-1728d6586ebf None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:27.189368 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199163c8-0e6d-4036-a46c-524c9bad6ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:27.190180 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199163c8-0e6d-4036-a46c-524c9bad6ebf admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:27.190459 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199163c8-0e6d-4036-a46c-524c9bad6ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:27.190776 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199163c8-0e6d-4036-a46c-524c9bad6ebf admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:27.191376 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199163c8-0e6d-4036-a46c-524c9bad6ebf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:27.193383 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199163c8-0e6d-4036-a46c-524c9bad6ebf admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:27.231502 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1099/2180] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:27:27 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:27:27.232219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199163c8-0e6d-4036-a46c-524c9bad6ebf admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:27.233956 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-199163c8-0e6d-4036-a46c-524c9bad6ebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:27.242683 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde64b6f-c7bd-4f42-be7f-39072b9aee74 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:27.293071 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a8689-caba-4e7d-b3f5-9ae5075768c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:27.293735 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a8689-caba-4e7d-b3f5-9ae5075768c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:27.294013 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a8689-caba-4e7d-b3f5-9ae5075768c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:27.294283 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a8689-caba-4e7d-b3f5-9ae5075768c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:27.300189 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199163c8-0e6d-4036-a46c-524c9bad6ebf admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:27.303904 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a8689-caba-4e7d-b3f5-9ae5075768c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:27.304977 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b2ca8-b7d3-4f1d-8f2e-1ebf02ee8a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:27.305368 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a8689-caba-4e7d-b3f5-9ae5075768c8 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:27.305641 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b2ca8-b7d3-4f1d-8f2e-1ebf02ee8a63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:27.305921 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b2ca8-b7d3-4f1d-8f2e-1ebf02ee8a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:27.306189 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b2ca8-b7d3-4f1d-8f2e-1ebf02ee8a63 admin admin] PATH_INFO: `/v3/projects/cfd49d9daf244a64884c75c34202eebf` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:27.307365 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b2ca8-b7d3-4f1d-8f2e-1ebf02ee8a63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfd49d9daf244a64884c75c34202eebf)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:27.309562 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b2ca8-b7d3-4f1d-8f2e-1ebf02ee8a63 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:27.315739 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1082/2181] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:27:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:27:27.316511 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a8689-caba-4e7d-b3f5-9ae5075768c8 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:27.326307 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a8689-caba-4e7d-b3f5-9ae5075768c8 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:27.331088 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac16339-09eb-46c2-a83a-a55ce9932aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:27.331686 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac16339-09eb-46c2-a83a-a55ce9932aa9 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:27.331961 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac16339-09eb-46c2-a83a-a55ce9932aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:27.332229 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac16339-09eb-46c2-a83a-a55ce9932aa9 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:27.332873 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac16339-09eb-46c2-a83a-a55ce9932aa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:27.334800 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac16339-09eb-46c2-a83a-a55ce9932aa9 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:27.363127 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1083/2182] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:27:27 2022] POST /identity/v3/users => generated 292 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:27:27.364203 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac16339-09eb-46c2-a83a-a55ce9932aa9 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:27.366656 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:27.368091 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7d7b2ca8-b7d3-4f1d-8f2e-1ebf02ee8a63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfd49d9daf244a64884c75c34202eebf', 'request_id': 'req-7d7b2ca8-b7d3-4f1d-8f2e-1ebf02ee8a63'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:27.375494 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac16339-09eb-46c2-a83a-a55ce9932aa9 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:27.379944 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7d7b2ca8-b7d3-4f1d-8f2e-1ebf02ee8a63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfd49d9daf244a64884c75c34202eebf', 'request_id': 'req-7d7b2ca8-b7d3-4f1d-8f2e-1ebf02ee8a63'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:27.387438 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7d7b2ca8-b7d3-4f1d-8f2e-1ebf02ee8a63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfd49d9daf244a64884c75c34202eebf', 'request_id': 'req-7d7b2ca8-b7d3-4f1d-8f2e-1ebf02ee8a63'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:27.402999 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7d7b2ca8-b7d3-4f1d-8f2e-1ebf02ee8a63 admin admin] The token cache is being invalidate because project cfd49d9daf244a64884c75c34202eebf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:27:27.403542 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7d7b2ca8-b7d3-4f1d-8f2e-1ebf02ee8a63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:27.405047 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7d7b2ca8-b7d3-4f1d-8f2e-1ebf02ee8a63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:27.407961 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1100/2183] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:27:27 2022] DELETE /identity/v3/projects/cfd49d9daf244a64884c75c34202eebf => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:27.413319 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31cc46-39ed-4166-a869-350eada31713 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:27.413646 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31cc46-39ed-4166-a869-350eada31713 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:27.414147 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31cc46-39ed-4166-a869-350eada31713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:27.439603 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-8a31cc46-39ed-4166-a869-350eada31713 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:27.439975 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974531a-c26f-4de2-a4d7-58670929ce46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:27.440589 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974531a-c26f-4de2-a4d7-58670929ce46 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:27.440855 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974531a-c26f-4de2-a4d7-58670929ce46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:27.441018 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8a31cc46-39ed-4166-a869-350eada31713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:27.441116 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974531a-c26f-4de2-a4d7-58670929ce46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:27.441794 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974531a-c26f-4de2-a4d7-58670929ce46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:27.443406 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974531a-c26f-4de2-a4d7-58670929ce46 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:27.449184 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1101/2184] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:27:27.454325 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1084/2185] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:27:27.458004 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144359f5-e207-4456-9766-12322d3c97ae None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:27.458304 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974531a-c26f-4de2-a4d7-58670929ce46 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:27.458417 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144359f5-e207-4456-9766-12322d3c97ae None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:27.458731 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144359f5-e207-4456-9766-12322d3c97ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:27.460029 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e974531a-c26f-4de2-a4d7-58670929ce46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:27.474868 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974531a-c26f-4de2-a4d7-58670929ce46 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:27.480572 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893c828-da39-4801-99ce-9f031e727e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:27.481831 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893c828-da39-4801-99ce-9f031e727e5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:27.482115 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893c828-da39-4801-99ce-9f031e727e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:27.482247 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-144359f5-e207-4456-9766-12322d3c97ae None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:27.482419 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893c828-da39-4801-99ce-9f031e727e5c admin admin] PATH_INFO: `/v3/projects/b356bdc29f31406a85c5492d2c71283a/users/080aa57388eb4075847236f220efe707/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:27.483530 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-144359f5-e207-4456-9766-12322d3c97ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:27.493289 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1102/2186] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:27.501928 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7893c828-da39-4801-99ce-9f031e727e5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b356bdc29f31406a85c5492d2c71283a, user_id=080aa57388eb4075847236f220efe707, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:27.505064 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7893c828-da39-4801-99ce-9f031e727e5c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:27.510134 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144359f5-e207-4456-9766-12322d3c97ae None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:27.519893 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144359f5-e207-4456-9766-12322d3c97ae None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:27.521845 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1085/2187] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:27:27 2022] PUT /identity/v3/projects/b356bdc29f31406a85c5492d2c71283a/users/080aa57388eb4075847236f220efe707/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:27.525381 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893c828-da39-4801-99ce-9f031e727e5c admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:27.561423 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:27.595559 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f187ec-263a-4cc3-a7b8-f7847b967bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:27.596472 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f187ec-263a-4cc3-a7b8-f7847b967bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:27.596840 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f187ec-263a-4cc3-a7b8-f7847b967bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:27.597234 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f187ec-263a-4cc3-a7b8-f7847b967bf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:27.598275 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f187ec-263a-4cc3-a7b8-f7847b967bf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:27:27.598647 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f187ec-263a-4cc3-a7b8-f7847b967bf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:27.600361 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f187ec-263a-4cc3-a7b8-f7847b967bf6 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:27.601184 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893c828-da39-4801-99ce-9f031e727e5c admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:27.606433 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133497d-bfc4-4f29-b7d8-192c543406de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:27.607376 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133497d-bfc4-4f29-b7d8-192c543406de admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:27.607724 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133497d-bfc4-4f29-b7d8-192c543406de admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:27.608112 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133497d-bfc4-4f29-b7d8-192c543406de admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:27.608869 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133497d-bfc4-4f29-b7d8-192c543406de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:27.610722 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133497d-bfc4-4f29-b7d8-192c543406de admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:27.621238 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1103/2188] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:27:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:27:27.625655 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f187ec-263a-4cc3-a7b8-f7847b967bf6 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:27.630139 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1086/2189] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 13:27:27.631103 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133497d-bfc4-4f29-b7d8-192c543406de admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:27.639135 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f187ec-263a-4cc3-a7b8-f7847b967bf6 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:27.643268 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133497d-bfc4-4f29-b7d8-192c543406de admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:27.646172 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb59b1b-cc97-4878-be45-a715032416ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:27.647122 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb59b1b-cc97-4878-be45-a715032416ad admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:27.647689 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb59b1b-cc97-4878-be45-a715032416ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:27.648092 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb59b1b-cc97-4878-be45-a715032416ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:27.648584 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4129da-222b-4b13-afd9-10927606a827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:27.649081 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb59b1b-cc97-4878-be45-a715032416ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:27.649600 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4129da-222b-4b13-afd9-10927606a827 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:27.649964 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4129da-222b-4b13-afd9-10927606a827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:27.650640 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4129da-222b-4b13-afd9-10927606a827 admin admin] PATH_INFO: `/v3/projects/b356bdc29f31406a85c5492d2c71283a/users/080aa57388eb4075847236f220efe707/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:27.651917 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb59b1b-cc97-4878-be45-a715032416ad admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:27.653674 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4129da-222b-4b13-afd9-10927606a827 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b356bdc29f31406a85c5492d2c71283a, user_id=080aa57388eb4075847236f220efe707, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:27.656450 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4129da-222b-4b13-afd9-10927606a827 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:27.673630 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1087/2190] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:27:27 2022] PUT /identity/v3/projects/b356bdc29f31406a85c5492d2c71283a/users/080aa57388eb4075847236f220efe707/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:27.683765 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47a751-f21b-4ed7-a4f8-6895b38322a5 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:27.684392 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47a751-f21b-4ed7-a4f8-6895b38322a5 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:27.684632 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47a751-f21b-4ed7-a4f8-6895b38322a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:27.702196 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1104/2191] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:27:27 2022] POST /identity/v3/projects => generated 379 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:27:27.703788 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb59b1b-cc97-4878-be45-a715032416ad admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:27.723928 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-cf47a751-f21b-4ed7-a4f8-6895b38322a5 None None] MFA Rules not processed for user `080aa57388eb4075847236f220efe707`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:27.725527 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-cf47a751-f21b-4ed7-a4f8-6895b38322a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:27.790671 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb59b1b-cc97-4878-be45-a715032416ad admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:27.798834 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d122a-ecfd-476a-8526-32edbb5e8d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:27.799059 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d122a-ecfd-476a-8526-32edbb5e8d22 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:27.801587 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d122a-ecfd-476a-8526-32edbb5e8d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:27.801587 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d122a-ecfd-476a-8526-32edbb5e8d22 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:27.801587 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6d122a-ecfd-476a-8526-32edbb5e8d22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:27.803483 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6d122a-ecfd-476a-8526-32edbb5e8d22 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:27.832470 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1105/2192] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:27:27 2022] POST /identity/v3/users => generated 290 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:27:27.832696 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1088/2193] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:27 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:27.833641 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d122a-ecfd-476a-8526-32edbb5e8d22 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:27.842669 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47a751-f21b-4ed7-a4f8-6895b38322a5 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:27.843638 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d122a-ecfd-476a-8526-32edbb5e8d22 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:27.844078 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-cf47a751-f21b-4ed7-a4f8-6895b38322a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:27.848321 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f8c10-28c0-42e3-9a1f-73eab539507a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:27.848924 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f8c10-28c0-42e3-9a1f-73eab539507a admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:27.849344 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f8c10-28c0-42e3-9a1f-73eab539507a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:27.849455 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f8c10-28c0-42e3-9a1f-73eab539507a admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:27.850148 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f8c10-28c0-42e3-9a1f-73eab539507a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:27.852654 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f8c10-28c0-42e3-9a1f-73eab539507a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:27.865567 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1106/2194] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 13:27:27.869045 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f8c10-28c0-42e3-9a1f-73eab539507a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:27.879593 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f8c10-28c0-42e3-9a1f-73eab539507a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:27.884588 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b175f-6eca-4ebc-b96d-3addeeaa747c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:27.885825 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b175f-6eca-4ebc-b96d-3addeeaa747c admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:27.886268 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b175f-6eca-4ebc-b96d-3addeeaa747c admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:27.886549 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b175f-6eca-4ebc-b96d-3addeeaa747c admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:27.887374 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b175f-6eca-4ebc-b96d-3addeeaa747c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:27.889066 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b175f-6eca-4ebc-b96d-3addeeaa747c admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:27.901923 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1107/2195] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 13:27:27.904437 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b175f-6eca-4ebc-b96d-3addeeaa747c admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:27.910033 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:27.918960 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b175f-6eca-4ebc-b96d-3addeeaa747c admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:27.920011 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47a751-f21b-4ed7-a4f8-6895b38322a5 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:27.925193 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162cfab-3d48-41fb-9cc5-62d1aa8e696b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:27.926052 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162cfab-3d48-41fb-9cc5-62d1aa8e696b service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:27.926777 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162cfab-3d48-41fb-9cc5-62d1aa8e696b service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:27.927267 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162cfab-3d48-41fb-9cc5-62d1aa8e696b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:27.932414 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe18f6-7a3e-433f-bf55-0dab7bfcb398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:27.933891 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe18f6-7a3e-433f-bf55-0dab7bfcb398 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:27.934242 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe18f6-7a3e-433f-bf55-0dab7bfcb398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:27.934576 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe18f6-7a3e-433f-bf55-0dab7bfcb398 admin admin] PATH_INFO: `/v3/projects/0ddf6f3f255b469f8ceb5f6062438d28/users/c3eb5800386246739bfcaa423a6c44cd/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:27.943115 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162cfab-3d48-41fb-9cc5-62d1aa8e696b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:27.944985 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162cfab-3d48-41fb-9cc5-62d1aa8e696b service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:27.956818 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fe18f6-7a3e-433f-bf55-0dab7bfcb398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ddf6f3f255b469f8ceb5f6062438d28, user_id=c3eb5800386246739bfcaa423a6c44cd, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:27.959529 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1089/2196] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:27:27 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:27:27.959915 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fe18f6-7a3e-433f-bf55-0dab7bfcb398 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:27.984038 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1108/2197] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:27:27 2022] PUT /identity/v3/projects/0ddf6f3f255b469f8ceb5f6062438d28/users/c3eb5800386246739bfcaa423a6c44cd/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:27:28.000769 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da38117-27b5-4bb4-80b2-1f29fccaa831 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:28.001132 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da38117-27b5-4bb4-80b2-1f29fccaa831 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:28.001447 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da38117-27b5-4bb4-80b2-1f29fccaa831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:28.008286 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5e374-a097-4890-8721-051738c69852 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:28.009589 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5e374-a097-4890-8721-051738c69852 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:28.009996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5e374-a097-4890-8721-051738c69852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:28.037634 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-0da38117-27b5-4bb4-80b2-1f29fccaa831 None None] MFA Rules not processed for user `cdb0e2b312244e9fbfa41fedd8a4f7fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:28.038989 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0da38117-27b5-4bb4-80b2-1f29fccaa831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:28.052256 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-19c5e374-a097-4890-8721-051738c69852 None None] MFA Rules not processed for user `c3eb5800386246739bfcaa423a6c44cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:28.053666 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-19c5e374-a097-4890-8721-051738c69852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:28.079423 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:28.126510 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1090/2198] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:28.158414 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da38117-27b5-4bb4-80b2-1f29fccaa831 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:28.184922 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1109/2199] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:28.188088 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5e374-a097-4890-8721-051738c69852 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:28.242877 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da38117-27b5-4bb4-80b2-1f29fccaa831 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:28.249611 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f195a-fb49-4bd4-8367-b8e675bd1eb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:28.249745 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f195a-fb49-4bd4-8367-b8e675bd1eb1 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:28.250057 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f195a-fb49-4bd4-8367-b8e675bd1eb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:28.250789 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f195a-fb49-4bd4-8367-b8e675bd1eb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:28.262490 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f195a-fb49-4bd4-8367-b8e675bd1eb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:28.264223 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f195a-fb49-4bd4-8367-b8e675bd1eb1 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:28.274905 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1091/2200] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:27:28 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:27:28.278599 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5e374-a097-4890-8721-051738c69852 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:28.287527 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d426e9c-a19c-4701-8da1-f9587142208a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:28.288275 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d426e9c-a19c-4701-8da1-f9587142208a admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:28.288664 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d426e9c-a19c-4701-8da1-f9587142208a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:28.288818 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d426e9c-a19c-4701-8da1-f9587142208a admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:28.289420 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d426e9c-a19c-4701-8da1-f9587142208a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:28.291405 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d426e9c-a19c-4701-8da1-f9587142208a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:28.328341 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1110/2201] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:27:28 2022] POST /identity/v3/projects => generated 379 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:27:28.333171 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f195a-fb49-4bd4-8367-b8e675bd1eb1 service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:28.349407 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f195a-fb49-4bd4-8367-b8e675bd1eb1 service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:28.430096 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45afc9d0-7cdb-4d6f-9f9c-911ccc7af421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:28.431394 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45afc9d0-7cdb-4d6f-9f9c-911ccc7af421 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:28.431394 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45afc9d0-7cdb-4d6f-9f9c-911ccc7af421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:28.431583 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45afc9d0-7cdb-4d6f-9f9c-911ccc7af421 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:28.432169 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45afc9d0-7cdb-4d6f-9f9c-911ccc7af421 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:28.434953 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45afc9d0-7cdb-4d6f-9f9c-911ccc7af421 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:28.446539 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d426e9c-a19c-4701-8da1-f9587142208a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:28.458826 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d426e9c-a19c-4701-8da1-f9587142208a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:28.464151 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1092/2202] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:27:28 2022] POST /identity/v3/users => generated 296 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:27:28.464631 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573be4cf-cb4f-4943-abba-055564bf13f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:28.465194 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573be4cf-cb4f-4943-abba-055564bf13f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:28.465460 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573be4cf-cb4f-4943-abba-055564bf13f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:28.465831 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573be4cf-cb4f-4943-abba-055564bf13f4 admin admin] PATH_INFO: `/v3/users/a968cbb7b0f04d519071073ad2494ff5` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:28.467011 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573be4cf-cb4f-4943-abba-055564bf13f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a968cbb7b0f04d519071073ad2494ff5)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:28.468920 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573be4cf-cb4f-4943-abba-055564bf13f4 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:28.469070 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45afc9d0-7cdb-4d6f-9f9c-911ccc7af421 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:28.479897 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45afc9d0-7cdb-4d6f-9f9c-911ccc7af421 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:28.487319 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d99ae-5b27-4405-8b3b-79c4e3b44510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:28.488801 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d99ae-5b27-4405-8b3b-79c4e3b44510 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:28.489154 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d99ae-5b27-4405-8b3b-79c4e3b44510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:28.489492 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d99ae-5b27-4405-8b3b-79c4e3b44510 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:28.490227 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d99ae-5b27-4405-8b3b-79c4e3b44510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:28.491945 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d99ae-5b27-4405-8b3b-79c4e3b44510 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:28.504515 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1093/2203] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 13:27:28.508950 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d99ae-5b27-4405-8b3b-79c4e3b44510 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:28.523784 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d99ae-5b27-4405-8b3b-79c4e3b44510 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:28.531091 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c344c4c-d83a-464a-bbef-62c6be6c6b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:28.531283 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-573be4cf-cb4f-4943-abba-055564bf13f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a968cbb7b0f04d519071073ad2494ff5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:28.531811 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c344c4c-d83a-464a-bbef-62c6be6c6b70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:28.532091 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c344c4c-d83a-464a-bbef-62c6be6c6b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:28.532188 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-573be4cf-cb4f-4943-abba-055564bf13f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a968cbb7b0f04d519071073ad2494ff5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:28.532369 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c344c4c-d83a-464a-bbef-62c6be6c6b70 admin admin] PATH_INFO: `/v3/projects/53690578d8404d19a49741773d19485f/users/10c7b357c22e4067ab732557e18a63ac/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:28.534645 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:28.546168 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-573be4cf-cb4f-4943-abba-055564bf13f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a968cbb7b0f04d519071073ad2494ff5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:28.550795 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c344c4c-d83a-464a-bbef-62c6be6c6b70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53690578d8404d19a49741773d19485f, user_id=10c7b357c22e4067ab732557e18a63ac, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:28.554223 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c344c4c-d83a-464a-bbef-62c6be6c6b70 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:28.564082 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-573be4cf-cb4f-4943-abba-055564bf13f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a968cbb7b0f04d519071073ad2494ff5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:28.567486 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-573be4cf-cb4f-4943-abba-055564bf13f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a968cbb7b0f04d519071073ad2494ff5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:28.578254 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1094/2204] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:27:28 2022] PUT /identity/v3/projects/53690578d8404d19a49741773d19485f/users/10c7b357c22e4067ab732557e18a63ac/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:27:28.582816 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c344c4c-d83a-464a-bbef-62c6be6c6b70 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:28.586359 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-4c344c4c-d83a-464a-bbef-62c6be6c6b70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:28.593329 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1111/2205] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:27:28 2022] DELETE /identity/v3/users/a968cbb7b0f04d519071073ad2494ff5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:27:28.597830 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71709182-ef4a-4bf8-95c3-b5170f58e565 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:28.598109 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71709182-ef4a-4bf8-95c3-b5170f58e565 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:28.598377 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71709182-ef4a-4bf8-95c3-b5170f58e565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:28.619214 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-71709182-ef4a-4bf8-95c3-b5170f58e565 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:28.622281 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-71709182-ef4a-4bf8-95c3-b5170f58e565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:28.632949 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:28.674598 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c344c4c-d83a-464a-bbef-62c6be6c6b70 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:28.695200 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1112/2206] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:27:28.705452 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71709182-ef4a-4bf8-95c3-b5170f58e565 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:28.706877 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-71709182-ef4a-4bf8-95c3-b5170f58e565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:28.735128 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e75ad-81e4-4beb-9164-db474e20ad0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:28.735744 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e75ad-81e4-4beb-9164-db474e20ad0d admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:28.736017 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e75ad-81e4-4beb-9164-db474e20ad0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:28.736288 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e75ad-81e4-4beb-9164-db474e20ad0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:28.736933 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e75ad-81e4-4beb-9164-db474e20ad0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:28.739211 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e75ad-81e4-4beb-9164-db474e20ad0d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:28.752298 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1095/2207] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 13:27:28.753277 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e75ad-81e4-4beb-9164-db474e20ad0d admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:28.763074 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e75ad-81e4-4beb-9164-db474e20ad0d admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:28.763423 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71709182-ef4a-4bf8-95c3-b5170f58e565 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:28.767243 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7016590-0fb7-403d-b437-46e7789e0541 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:28.767852 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7016590-0fb7-403d-b437-46e7789e0541 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:28.768124 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7016590-0fb7-403d-b437-46e7789e0541 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:28.768394 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec14cb-71a7-4ce2-bde6-7c1c1da24d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:28.768510 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7016590-0fb7-403d-b437-46e7789e0541 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:28.769049 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec14cb-71a7-4ce2-bde6-7c1c1da24d75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:28.769326 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec14cb-71a7-4ce2-bde6-7c1c1da24d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:28.769626 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec14cb-71a7-4ce2-bde6-7c1c1da24d75 admin admin] PATH_INFO: `/v3/projects/53690578d8404d19a49741773d19485f/users/10c7b357c22e4067ab732557e18a63ac/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:28.771611 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ec14cb-71a7-4ce2-bde6-7c1c1da24d75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53690578d8404d19a49741773d19485f, user_id=10c7b357c22e4067ab732557e18a63ac, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:28.774367 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ec14cb-71a7-4ce2-bde6-7c1c1da24d75 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:28.778799 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7016590-0fb7-403d-b437-46e7789e0541 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:28.780150 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7016590-0fb7-403d-b437-46e7789e0541 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:28.787395 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1096/2208] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:27:28 2022] PUT /identity/v3/projects/53690578d8404d19a49741773d19485f/users/10c7b357c22e4067ab732557e18a63ac/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:28.791668 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1113/2209] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:27:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:27:28.799985 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f7317-1a9f-44c3-8000-0c18aa3f6843 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:28.800266 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f7317-1a9f-44c3-8000-0c18aa3f6843 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:28.800538 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f7317-1a9f-44c3-8000-0c18aa3f6843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:28.833422 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-7f4f7317-1a9f-44c3-8000-0c18aa3f6843 None None] MFA Rules not processed for user `10c7b357c22e4067ab732557e18a63ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:28.834784 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7f4f7317-1a9f-44c3-8000-0c18aa3f6843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:28.905590 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1097/2210] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:28 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:28.918998 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7016590-0fb7-403d-b437-46e7789e0541 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:28.920385 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e7016590-0fb7-403d-b437-46e7789e0541 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:28.985495 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7016590-0fb7-403d-b437-46e7789e0541 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:29.005682 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:29.039542 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac969d8-ba20-4441-8afd-a0f6496fadf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:29.040275 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac969d8-ba20-4441-8afd-a0f6496fadf4 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:29.040832 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac969d8-ba20-4441-8afd-a0f6496fadf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:29.041080 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac969d8-ba20-4441-8afd-a0f6496fadf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:29.051911 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac969d8-ba20-4441-8afd-a0f6496fadf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:29.053610 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac969d8-ba20-4441-8afd-a0f6496fadf4 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:29.064096 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1114/2211] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:27:28 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:27:29.066590 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f7317-1a9f-44c3-8000-0c18aa3f6843 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:29.068688 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7f4f7317-1a9f-44c3-8000-0c18aa3f6843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:29.136754 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:29.159777 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f7317-1a9f-44c3-8000-0c18aa3f6843 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:29.164300 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31077c67-86a4-4e3a-b05e-8086225c8aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:29.164931 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31077c67-86a4-4e3a-b05e-8086225c8aa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:29.165213 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31077c67-86a4-4e3a-b05e-8086225c8aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:29.165502 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31077c67-86a4-4e3a-b05e-8086225c8aa8 admin admin] PATH_INFO: `/v3/projects/6aec30c4c91f410cae3f6bcfe6b41f55` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:29.166665 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31077c67-86a4-4e3a-b05e-8086225c8aa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aec30c4c91f410cae3f6bcfe6b41f55)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:29.168644 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31077c67-86a4-4e3a-b05e-8086225c8aa8 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:29.232920 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-31077c67-86a4-4e3a-b05e-8086225c8aa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aec30c4c91f410cae3f6bcfe6b41f55', 'request_id': 'req-31077c67-86a4-4e3a-b05e-8086225c8aa8'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:29.241258 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-31077c67-86a4-4e3a-b05e-8086225c8aa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aec30c4c91f410cae3f6bcfe6b41f55', 'request_id': 'req-31077c67-86a4-4e3a-b05e-8086225c8aa8'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:29.248634 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-31077c67-86a4-4e3a-b05e-8086225c8aa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aec30c4c91f410cae3f6bcfe6b41f55', 'request_id': 'req-31077c67-86a4-4e3a-b05e-8086225c8aa8'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:29.261056 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-31077c67-86a4-4e3a-b05e-8086225c8aa8 admin admin] The token cache is being invalidate because project 6aec30c4c91f410cae3f6bcfe6b41f55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:27:29.261639 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-31077c67-86a4-4e3a-b05e-8086225c8aa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:29.262328 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-31077c67-86a4-4e3a-b05e-8086225c8aa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:29.263961 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1098/2212] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:27:29 2022] DELETE /identity/v3/projects/6aec30c4c91f410cae3f6bcfe6b41f55 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:29.268087 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac969d8-ba20-4441-8afd-a0f6496fadf4 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:29.278816 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac969d8-ba20-4441-8afd-a0f6496fadf4 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:29.338747 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4a840-84fb-4fa8-badc-622559fea417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:29.339556 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4a840-84fb-4fa8-badc-622559fea417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:29.339899 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4a840-84fb-4fa8-badc-622559fea417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:29.340565 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4a840-84fb-4fa8-badc-622559fea417 admin admin] PATH_INFO: `/v3/users/080aa57388eb4075847236f220efe707` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:29.341414 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4a840-84fb-4fa8-badc-622559fea417 admin admin] RBAC: Authorizing `identity:delete_user(user_id=080aa57388eb4075847236f220efe707)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:29.343431 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4a840-84fb-4fa8-badc-622559fea417 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:29.392378 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-a3c4a840-84fb-4fa8-badc-622559fea417 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '080aa57388eb4075847236f220efe707'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:29.393068 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-a3c4a840-84fb-4fa8-badc-622559fea417 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '080aa57388eb4075847236f220efe707'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:29.394703 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31077c67-86a4-4e3a-b05e-8086225c8aa8 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:29.396150 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-31077c67-86a4-4e3a-b05e-8086225c8aa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:29.400342 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-a3c4a840-84fb-4fa8-badc-622559fea417 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '080aa57388eb4075847236f220efe707'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:29.412764 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-a3c4a840-84fb-4fa8-badc-622559fea417 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '080aa57388eb4075847236f220efe707'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:29.413427 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-a3c4a840-84fb-4fa8-badc-622559fea417 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '080aa57388eb4075847236f220efe707'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:29.426696 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1115/2213] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:27:29 2022] DELETE /identity/v3/users/080aa57388eb4075847236f220efe707 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:29.466332 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31077c67-86a4-4e3a-b05e-8086225c8aa8 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:29.529372 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62d5fc-eb67-4131-a043-ad6bb89fa00e tempest-VolumeQuotaClassesTest-102430876 tempest-VolumeQuotaClassesTest-102430876-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10c7b357c22e4067ab732557e18a63ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53690578d8404d19a49741773d19485f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:29.530028 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62d5fc-eb67-4131-a043-ad6bb89fa00e tempest-VolumeQuotaClassesTest-102430876 tempest-VolumeQuotaClassesTest-102430876-project-admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:29.530299 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62d5fc-eb67-4131-a043-ad6bb89fa00e tempest-VolumeQuotaClassesTest-102430876 tempest-VolumeQuotaClassesTest-102430876-project-admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:29.530564 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62d5fc-eb67-4131-a043-ad6bb89fa00e tempest-VolumeQuotaClassesTest-102430876 tempest-VolumeQuotaClassesTest-102430876-project-admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:29.531211 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62d5fc-eb67-4131-a043-ad6bb89fa00e tempest-VolumeQuotaClassesTest-102430876 tempest-VolumeQuotaClassesTest-102430876-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:27:29.531512 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62d5fc-eb67-4131-a043-ad6bb89fa00e tempest-VolumeQuotaClassesTest-102430876 tempest-VolumeQuotaClassesTest-102430876-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:29.533144 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62d5fc-eb67-4131-a043-ad6bb89fa00e tempest-VolumeQuotaClassesTest-102430876 tempest-VolumeQuotaClassesTest-102430876-project-admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:29.549044 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1099/2214] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:27:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:27:29.550164 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4a840-84fb-4fa8-badc-622559fea417 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:29.551652 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a3c4a840-84fb-4fa8-badc-622559fea417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:29.566101 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4a840-84fb-4fa8-badc-622559fea417 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:29.571805 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a083f-1327-4fe4-931b-5a48500813fa tempest-VolumeQuotaClassesTest-102430876 tempest-VolumeQuotaClassesTest-102430876-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10c7b357c22e4067ab732557e18a63ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53690578d8404d19a49741773d19485f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:29.572465 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a083f-1327-4fe4-931b-5a48500813fa tempest-VolumeQuotaClassesTest-102430876 tempest-VolumeQuotaClassesTest-102430876-project-admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:29.572737 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a083f-1327-4fe4-931b-5a48500813fa tempest-VolumeQuotaClassesTest-102430876 tempest-VolumeQuotaClassesTest-102430876-project-admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:29.573008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a083f-1327-4fe4-931b-5a48500813fa tempest-VolumeQuotaClassesTest-102430876 tempest-VolumeQuotaClassesTest-102430876-project-admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:29.573801 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a083f-1327-4fe4-931b-5a48500813fa tempest-VolumeQuotaClassesTest-102430876 tempest-VolumeQuotaClassesTest-102430876-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:29.575825 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a083f-1327-4fe4-931b-5a48500813fa tempest-VolumeQuotaClassesTest-102430876 tempest-VolumeQuotaClassesTest-102430876-project-admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:29.608305 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1116/2215] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:27:29 2022] POST /identity/v3/projects => generated 354 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:27:29.609734 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62d5fc-eb67-4131-a043-ad6bb89fa00e tempest-VolumeQuotaClassesTest-102430876 tempest-VolumeQuotaClassesTest-102430876-project-admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:29.620191 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62d5fc-eb67-4131-a043-ad6bb89fa00e tempest-VolumeQuotaClassesTest-102430876 tempest-VolumeQuotaClassesTest-102430876-project-admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:29.629402 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:29.696463 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfd0f2-3019-43a7-9b4a-0b7e98f7f7bc tempest-VolumeQuotaClassesTest-102430876 tempest-VolumeQuotaClassesTest-102430876-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10c7b357c22e4067ab732557e18a63ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53690578d8404d19a49741773d19485f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:29.697188 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfd0f2-3019-43a7-9b4a-0b7e98f7f7bc tempest-VolumeQuotaClassesTest-102430876 tempest-VolumeQuotaClassesTest-102430876-project-admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:29.697550 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfd0f2-3019-43a7-9b4a-0b7e98f7f7bc tempest-VolumeQuotaClassesTest-102430876 tempest-VolumeQuotaClassesTest-102430876-project-admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:29.697942 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfd0f2-3019-43a7-9b4a-0b7e98f7f7bc tempest-VolumeQuotaClassesTest-102430876 tempest-VolumeQuotaClassesTest-102430876-project-admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:29.698784 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbfd0f2-3019-43a7-9b4a-0b7e98f7f7bc tempest-VolumeQuotaClassesTest-102430876 tempest-VolumeQuotaClassesTest-102430876-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:27:29.699288 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbfd0f2-3019-43a7-9b4a-0b7e98f7f7bc tempest-VolumeQuotaClassesTest-102430876 tempest-VolumeQuotaClassesTest-102430876-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:29.700970 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbfd0f2-3019-43a7-9b4a-0b7e98f7f7bc tempest-VolumeQuotaClassesTest-102430876 tempest-VolumeQuotaClassesTest-102430876-project-admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:29.718592 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1100/2216] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:27:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:27:29.719081 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b2e30-2886-453e-b4d2-121be2eb3edb None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:29.719372 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b2e30-2886-453e-b4d2-121be2eb3edb None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:29.719650 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b2e30-2886-453e-b4d2-121be2eb3edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:29.745369 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfd0f2-3019-43a7-9b4a-0b7e98f7f7bc tempest-VolumeQuotaClassesTest-102430876 tempest-VolumeQuotaClassesTest-102430876-project-admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:29.745944 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-596b2e30-2886-453e-b4d2-121be2eb3edb None None] MFA Rules not processed for user `cdb0e2b312244e9fbfa41fedd8a4f7fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:29.747273 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-596b2e30-2886-453e-b4d2-121be2eb3edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:29.749844 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-dcbfd0f2-3019-43a7-9b4a-0b7e98f7f7bc tempest-VolumeQuotaClassesTest-102430876 tempest-VolumeQuotaClassesTest-102430876-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:29.777859 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:29.823003 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1117/2217] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:27:29.824123 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b2e30-2886-453e-b4d2-121be2eb3edb None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:29.832222 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfd0f2-3019-43a7-9b4a-0b7e98f7f7bc tempest-VolumeQuotaClassesTest-102430876 tempest-VolumeQuotaClassesTest-102430876-project-admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:29.834410 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b2e30-2886-453e-b4d2-121be2eb3edb None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:29.837555 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed702b1-fe26-4280-8bfa-90ff194b2fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:29.838270 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed702b1-fe26-4280-8bfa-90ff194b2fa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:29.838549 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed702b1-fe26-4280-8bfa-90ff194b2fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:29.838878 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed702b1-fe26-4280-8bfa-90ff194b2fa2 admin admin] PATH_INFO: `/v3/projects/b356bdc29f31406a85c5492d2c71283a` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:29.839202 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2eeeca-25a9-4a80-a912-d9d13fe4b416 tempest-VolumeQuotaClassesTest-102430876 tempest-VolumeQuotaClassesTest-102430876-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10c7b357c22e4067ab732557e18a63ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53690578d8404d19a49741773d19485f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:29.839881 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2eeeca-25a9-4a80-a912-d9d13fe4b416 tempest-VolumeQuotaClassesTest-102430876 tempest-VolumeQuotaClassesTest-102430876-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:29.840223 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2eeeca-25a9-4a80-a912-d9d13fe4b416 tempest-VolumeQuotaClassesTest-102430876 tempest-VolumeQuotaClassesTest-102430876-project-admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:29.840333 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed702b1-fe26-4280-8bfa-90ff194b2fa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b356bdc29f31406a85c5492d2c71283a)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:29.840597 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2eeeca-25a9-4a80-a912-d9d13fe4b416 tempest-VolumeQuotaClassesTest-102430876 tempest-VolumeQuotaClassesTest-102430876-project-admin] PATH_INFO: `/v3/projects/f38f541241b841d08c4040918b4bee32` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:29.841812 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2eeeca-25a9-4a80-a912-d9d13fe4b416 tempest-VolumeQuotaClassesTest-102430876 tempest-VolumeQuotaClassesTest-102430876-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f38f541241b841d08c4040918b4bee32)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:29.842244 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed702b1-fe26-4280-8bfa-90ff194b2fa2 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:29.843882 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2eeeca-25a9-4a80-a912-d9d13fe4b416 tempest-VolumeQuotaClassesTest-102430876 tempest-VolumeQuotaClassesTest-102430876-project-admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:29.900774 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4f2eeeca-25a9-4a80-a912-d9d13fe4b416 tempest-VolumeQuotaClassesTest-102430876 tempest-VolumeQuotaClassesTest-102430876-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f38f541241b841d08c4040918b4bee32', 'request_id': 'req-4f2eeeca-25a9-4a80-a912-d9d13fe4b416'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:29.903332 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0ed702b1-fe26-4280-8bfa-90ff194b2fa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b356bdc29f31406a85c5492d2c71283a', 'request_id': 'req-0ed702b1-fe26-4280-8bfa-90ff194b2fa2'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:29.906996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4f2eeeca-25a9-4a80-a912-d9d13fe4b416 tempest-VolumeQuotaClassesTest-102430876 tempest-VolumeQuotaClassesTest-102430876-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f38f541241b841d08c4040918b4bee32', 'request_id': 'req-4f2eeeca-25a9-4a80-a912-d9d13fe4b416'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:29.911754 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0ed702b1-fe26-4280-8bfa-90ff194b2fa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b356bdc29f31406a85c5492d2c71283a', 'request_id': 'req-0ed702b1-fe26-4280-8bfa-90ff194b2fa2'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:29.916052 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4f2eeeca-25a9-4a80-a912-d9d13fe4b416 tempest-VolumeQuotaClassesTest-102430876 tempest-VolumeQuotaClassesTest-102430876-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f38f541241b841d08c4040918b4bee32', 'request_id': 'req-4f2eeeca-25a9-4a80-a912-d9d13fe4b416'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:29.919948 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0ed702b1-fe26-4280-8bfa-90ff194b2fa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b356bdc29f31406a85c5492d2c71283a', 'request_id': 'req-0ed702b1-fe26-4280-8bfa-90ff194b2fa2'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:29.932854 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0ed702b1-fe26-4280-8bfa-90ff194b2fa2 admin admin] The token cache is being invalidate because project b356bdc29f31406a85c5492d2c71283a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:27:29.933186 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4f2eeeca-25a9-4a80-a912-d9d13fe4b416 tempest-VolumeQuotaClassesTest-102430876 tempest-VolumeQuotaClassesTest-102430876-project-admin] The token cache is being invalidate because project f38f541241b841d08c4040918b4bee32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:27:29.933395 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4f2eeeca-25a9-4a80-a912-d9d13fe4b416 tempest-VolumeQuotaClassesTest-102430876 tempest-VolumeQuotaClassesTest-102430876-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:29.933666 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0ed702b1-fe26-4280-8bfa-90ff194b2fa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:29.934284 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0ed702b1-fe26-4280-8bfa-90ff194b2fa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:29.934499 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4f2eeeca-25a9-4a80-a912-d9d13fe4b416 tempest-VolumeQuotaClassesTest-102430876 tempest-VolumeQuotaClassesTest-102430876-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:29.936802 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1118/2218] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:27:29 2022] DELETE /identity/v3/projects/f38f541241b841d08c4040918b4bee32 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:29.936946 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1101/2219] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:27:29 2022] DELETE /identity/v3/projects/b356bdc29f31406a85c5492d2c71283a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:27:29.947007 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bcf36-8e67-4002-8291-b370d8eabf98 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:29.947299 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bcf36-8e67-4002-8291-b370d8eabf98 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:29.947604 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bcf36-8e67-4002-8291-b370d8eabf98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:29.970903 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-c96bcf36-8e67-4002-8291-b370d8eabf98 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:29.972113 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c96bcf36-8e67-4002-8291-b370d8eabf98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:30.041046 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1119/2220] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:30.049394 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea58ba-e003-4c3c-a181-8ea10be8b352 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:30.050141 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea58ba-e003-4c3c-a181-8ea10be8b352 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:30.050640 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea58ba-e003-4c3c-a181-8ea10be8b352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:30.076705 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-d9ea58ba-e003-4c3c-a181-8ea10be8b352 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:30.078044 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d9ea58ba-e003-4c3c-a181-8ea10be8b352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:30.088577 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1102/2221] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:30.092939 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96bcf36-8e67-4002-8291-b370d8eabf98 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:30.103780 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96bcf36-8e67-4002-8291-b370d8eabf98 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:30.111127 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3dab2e-d1a4-4ab9-b7e7-0e6cecc79520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:30.112039 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3dab2e-d1a4-4ab9-b7e7-0e6cecc79520 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:30.113034 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3dab2e-d1a4-4ab9-b7e7-0e6cecc79520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:30.113034 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3dab2e-d1a4-4ab9-b7e7-0e6cecc79520 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:30.113492 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3dab2e-d1a4-4ab9-b7e7-0e6cecc79520 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:27:30.114045 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3dab2e-d1a4-4ab9-b7e7-0e6cecc79520 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:30.115721 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3dab2e-d1a4-4ab9-b7e7-0e6cecc79520 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:30.129899 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1120/2222] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:27:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:27:30.134989 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea58ba-e003-4c3c-a181-8ea10be8b352 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:30.148541 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea58ba-e003-4c3c-a181-8ea10be8b352 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:30.155343 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944ad70-8635-4bb5-8a4c-6527324eb308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:30.156048 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944ad70-8635-4bb5-8a4c-6527324eb308 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:30.156392 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944ad70-8635-4bb5-8a4c-6527324eb308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:30.156729 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944ad70-8635-4bb5-8a4c-6527324eb308 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:30.157003 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3dab2e-d1a4-4ab9-b7e7-0e6cecc79520 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:30.157517 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3944ad70-8635-4bb5-8a4c-6527324eb308 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:30.158796 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9a3dab2e-d1a4-4ab9-b7e7-0e6cecc79520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:30.159704 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3944ad70-8635-4bb5-8a4c-6527324eb308 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:30.177592 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3dab2e-d1a4-4ab9-b7e7-0e6cecc79520 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:30.183665 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c56d01-499b-4f8d-b485-d4afa90b9dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:30.184396 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c56d01-499b-4f8d-b485-d4afa90b9dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:30.184679 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c56d01-499b-4f8d-b485-d4afa90b9dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:30.184952 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c56d01-499b-4f8d-b485-d4afa90b9dcf admin admin] PATH_INFO: `/v3/users/c3eb5800386246739bfcaa423a6c44cd` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:30.186458 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c56d01-499b-4f8d-b485-d4afa90b9dcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3eb5800386246739bfcaa423a6c44cd)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:30.188416 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c56d01-499b-4f8d-b485-d4afa90b9dcf admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:30.193125 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1103/2223] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:27:30 2022] POST /identity/v3/projects => generated 367 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:27:30.194545 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944ad70-8635-4bb5-8a4c-6527324eb308 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:30.203637 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:30.234409 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:30.247508 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-74c56d01-499b-4f8d-b485-d4afa90b9dcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3eb5800386246739bfcaa423a6c44cd'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:30.248461 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-74c56d01-499b-4f8d-b485-d4afa90b9dcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3eb5800386246739bfcaa423a6c44cd'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:30.256566 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-74c56d01-499b-4f8d-b485-d4afa90b9dcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3eb5800386246739bfcaa423a6c44cd'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:30.275340 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-74c56d01-499b-4f8d-b485-d4afa90b9dcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3eb5800386246739bfcaa423a6c44cd'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:30.276081 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-74c56d01-499b-4f8d-b485-d4afa90b9dcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3eb5800386246739bfcaa423a6c44cd'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:30.302823 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1121/2224] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:27:30 2022] DELETE /identity/v3/users/c3eb5800386246739bfcaa423a6c44cd => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:30.303540 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944ad70-8635-4bb5-8a4c-6527324eb308 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:30.306980 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfba01d-9461-4d68-aa94-153cdaca4cdc None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:30.307402 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfba01d-9461-4d68-aa94-153cdaca4cdc None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:30.307539 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfba01d-9461-4d68-aa94-153cdaca4cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:30.327980 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-9cfba01d-9461-4d68-aa94-153cdaca4cdc None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:30.329179 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9cfba01d-9461-4d68-aa94-153cdaca4cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:30.372513 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ac369-09df-4b81-848a-293b7d3eec4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:30.373490 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ac369-09df-4b81-848a-293b7d3eec4f admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:30.373812 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ac369-09df-4b81-848a-293b7d3eec4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:30.374082 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ac369-09df-4b81-848a-293b7d3eec4f admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:30.374718 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ac369-09df-4b81-848a-293b7d3eec4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:30.377030 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ac369-09df-4b81-848a-293b7d3eec4f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:30.394123 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1122/2225] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:30.406103 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfba01d-9461-4d68-aa94-153cdaca4cdc None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:30.407852 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9cfba01d-9461-4d68-aa94-153cdaca4cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:30.409979 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1104/2226] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:27:30 2022] POST /identity/v3/users => generated 284 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:27:30.410854 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ac369-09df-4b81-848a-293b7d3eec4f admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:30.412507 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-149ac369-09df-4b81-848a-293b7d3eec4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:30.443919 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ac369-09df-4b81-848a-293b7d3eec4f admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:30.452923 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a2598-959f-40ca-a95f-741ee6b3807d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:30.453568 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a2598-959f-40ca-a95f-741ee6b3807d admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:30.453895 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a2598-959f-40ca-a95f-741ee6b3807d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:30.454556 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a2598-959f-40ca-a95f-741ee6b3807d admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:30.454968 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a2598-959f-40ca-a95f-741ee6b3807d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:30.456702 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a2598-959f-40ca-a95f-741ee6b3807d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:30.468552 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1105/2227] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:30 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 13:27:30.472659 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a2598-959f-40ca-a95f-741ee6b3807d admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:30.483104 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfba01d-9461-4d68-aa94-153cdaca4cdc None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:30.488682 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a3854-3499-46d2-adcf-9814956b5f52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:30.489618 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a3854-3499-46d2-adcf-9814956b5f52 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:30.489904 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a3854-3499-46d2-adcf-9814956b5f52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:30.490182 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a3854-3499-46d2-adcf-9814956b5f52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:30.490756 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a2598-959f-40ca-a95f-741ee6b3807d admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:30.495969 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e4bea1-b1b1-4a8d-9063-0cc9247d1471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:30.496639 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4bea1-b1b1-4a8d-9063-0cc9247d1471 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:30.496927 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4bea1-b1b1-4a8d-9063-0cc9247d1471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:30.497696 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4bea1-b1b1-4a8d-9063-0cc9247d1471 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:30.498369 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e4bea1-b1b1-4a8d-9063-0cc9247d1471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:30.500313 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e4bea1-b1b1-4a8d-9063-0cc9247d1471 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:30.508927 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a3854-3499-46d2-adcf-9814956b5f52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:30.510400 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a3854-3499-46d2-adcf-9814956b5f52 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:30.516078 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1106/2228] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:27:30.518193 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e4bea1-b1b1-4a8d-9063-0cc9247d1471 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:30.522330 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1123/2229] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:27:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:27:30.528997 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e4bea1-b1b1-4a8d-9063-0cc9247d1471 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:30.533882 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d623e938-c947-4c10-9349-f3d6e6f68b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:30.534623 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623e938-c947-4c10-9349-f3d6e6f68b20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:30.534966 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623e938-c947-4c10-9349-f3d6e6f68b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:30.535304 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623e938-c947-4c10-9349-f3d6e6f68b20 admin admin] PATH_INFO: `/v3/projects/3e86c2575df24477a133e7a493d7d04c/users/c44358a0fc1140dabe3bc8b80c78e1d6/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:30.551983 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d623e938-c947-4c10-9349-f3d6e6f68b20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e86c2575df24477a133e7a493d7d04c, user_id=c44358a0fc1140dabe3bc8b80c78e1d6, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:30.554779 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d623e938-c947-4c10-9349-f3d6e6f68b20 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:30.574828 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1107/2230] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:27:30 2022] PUT /identity/v3/projects/3e86c2575df24477a133e7a493d7d04c/users/c44358a0fc1140dabe3bc8b80c78e1d6/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:30.586911 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0154f-47b7-4f57-95f6-73ff6b6d4e73 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:30.587173 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0154f-47b7-4f57-95f6-73ff6b6d4e73 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:30.587694 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0154f-47b7-4f57-95f6-73ff6b6d4e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:30.617568 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-06d0154f-47b7-4f57-95f6-73ff6b6d4e73 None None] MFA Rules not processed for user `c44358a0fc1140dabe3bc8b80c78e1d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:30.618817 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-06d0154f-47b7-4f57-95f6-73ff6b6d4e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:30.671976 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:30.705470 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1124/2231] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:30.710404 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d623e938-c947-4c10-9349-f3d6e6f68b20 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:30.780727 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:30.805096 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d623e938-c947-4c10-9349-f3d6e6f68b20 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:30.813296 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c4617-75d3-4e58-8a4d-d81bb4148238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:30.813981 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c4617-75d3-4e58-8a4d-d81bb4148238 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:30.814359 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c4617-75d3-4e58-8a4d-d81bb4148238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:30.814562 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c4617-75d3-4e58-8a4d-d81bb4148238 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:30.815210 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c4617-75d3-4e58-8a4d-d81bb4148238 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:30.817123 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c4617-75d3-4e58-8a4d-d81bb4148238 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:30.849877 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0154f-47b7-4f57-95f6-73ff6b6d4e73 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:30.851318 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-06d0154f-47b7-4f57-95f6-73ff6b6d4e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:30.854080 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1108/2232] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:27:30 2022] POST /identity/v3/projects => generated 367 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:27:30.858034 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c4617-75d3-4e58-8a4d-d81bb4148238 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:30.875618 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0154f-47b7-4f57-95f6-73ff6b6d4e73 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:30.948388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5fb135-6c98-47b1-ab50-4a4b67b0944f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:30.949027 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fb135-6c98-47b1-ab50-4a4b67b0944f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:30.949298 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fb135-6c98-47b1-ab50-4a4b67b0944f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:30.949586 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fb135-6c98-47b1-ab50-4a4b67b0944f admin admin] PATH_INFO: `/v3/projects/0ddf6f3f255b469f8ceb5f6062438d28` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:30.950729 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5fb135-6c98-47b1-ab50-4a4b67b0944f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ddf6f3f255b469f8ceb5f6062438d28)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:30.952711 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5fb135-6c98-47b1-ab50-4a4b67b0944f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:30.953890 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c4617-75d3-4e58-8a4d-d81bb4148238 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:30.960470 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5580a25-7340-4f6d-86eb-21c81d7ecce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:30.960849 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5580a25-7340-4f6d-86eb-21c81d7ecce4 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:30.961153 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5580a25-7340-4f6d-86eb-21c81d7ecce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:30.961439 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5580a25-7340-4f6d-86eb-21c81d7ecce4 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:30.962922 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5580a25-7340-4f6d-86eb-21c81d7ecce4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:30.965073 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5580a25-7340-4f6d-86eb-21c81d7ecce4 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:30.992972 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1109/2233] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:27:30 2022] POST /identity/v3/users => generated 290 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:27:30.994123 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5580a25-7340-4f6d-86eb-21c81d7ecce4 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:31.006309 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5580a25-7340-4f6d-86eb-21c81d7ecce4 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:31.009145 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2c5fb135-6c98-47b1-ab50-4a4b67b0944f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ddf6f3f255b469f8ceb5f6062438d28', 'request_id': 'req-2c5fb135-6c98-47b1-ab50-4a4b67b0944f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:31.017495 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2c5fb135-6c98-47b1-ab50-4a4b67b0944f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ddf6f3f255b469f8ceb5f6062438d28', 'request_id': 'req-2c5fb135-6c98-47b1-ab50-4a4b67b0944f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:31.026076 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2c5fb135-6c98-47b1-ab50-4a4b67b0944f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ddf6f3f255b469f8ceb5f6062438d28', 'request_id': 'req-2c5fb135-6c98-47b1-ab50-4a4b67b0944f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:31.044590 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2c5fb135-6c98-47b1-ab50-4a4b67b0944f admin admin] The token cache is being invalidate because project 0ddf6f3f255b469f8ceb5f6062438d28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:27:31.044873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2c5fb135-6c98-47b1-ab50-4a4b67b0944f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:31.045601 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2c5fb135-6c98-47b1-ab50-4a4b67b0944f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:31.047542 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1125/2234] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:27:30 2022] DELETE /identity/v3/projects/0ddf6f3f255b469f8ceb5f6062438d28 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:31.051514 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5fb135-6c98-47b1-ab50-4a4b67b0944f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:31.052895 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2c5fb135-6c98-47b1-ab50-4a4b67b0944f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:31.071794 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab35318-f772-406d-a713-03b6f3df9816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:31.072613 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab35318-f772-406d-a713-03b6f3df9816 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:31.072857 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab35318-f772-406d-a713-03b6f3df9816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:31.073131 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab35318-f772-406d-a713-03b6f3df9816 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:31.073872 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab35318-f772-406d-a713-03b6f3df9816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:31.075948 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab35318-f772-406d-a713-03b6f3df9816 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:31.089183 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1110/2235] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:30 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:27:31.093213 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab35318-f772-406d-a713-03b6f3df9816 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:31.095250 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-dab35318-f772-406d-a713-03b6f3df9816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:31.111628 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab35318-f772-406d-a713-03b6f3df9816 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:31.116766 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf5699-4178-41ff-a880-2bf7904b8f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:31.117472 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf5699-4178-41ff-a880-2bf7904b8f91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:31.117775 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf5699-4178-41ff-a880-2bf7904b8f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:31.118041 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf5699-4178-41ff-a880-2bf7904b8f91 admin admin] PATH_INFO: `/v3/projects/6e0d7ef0159846b181c6a3af4afc60ce/users/5e24e63f0cc4404f94734dc4e941bb97/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:31.123819 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5fb135-6c98-47b1-ab50-4a4b67b0944f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:31.128384 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea82867-d8ec-4813-bde2-f5f46931c826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:31.129022 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea82867-d8ec-4813-bde2-f5f46931c826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:31.129296 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea82867-d8ec-4813-bde2-f5f46931c826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:31.129590 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea82867-d8ec-4813-bde2-f5f46931c826 admin admin] PATH_INFO: `/v3/users/10c7b357c22e4067ab732557e18a63ac` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:31.131467 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea82867-d8ec-4813-bde2-f5f46931c826 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10c7b357c22e4067ab732557e18a63ac)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:31.133573 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea82867-d8ec-4813-bde2-f5f46931c826 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:31.138118 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf5699-4178-41ff-a880-2bf7904b8f91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e0d7ef0159846b181c6a3af4afc60ce, user_id=5e24e63f0cc4404f94734dc4e941bb97, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:31.141203 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf5699-4178-41ff-a880-2bf7904b8f91 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:31.158080 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1111/2236] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:27:31 2022] PUT /identity/v3/projects/6e0d7ef0159846b181c6a3af4afc60ce/users/5e24e63f0cc4404f94734dc4e941bb97/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:31.162107 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf5699-4178-41ff-a880-2bf7904b8f91 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:31.162666 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:31.204211 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4ea82867-d8ec-4813-bde2-f5f46931c826 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10c7b357c22e4067ab732557e18a63ac'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:31.204884 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4ea82867-d8ec-4813-bde2-f5f46931c826 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10c7b357c22e4067ab732557e18a63ac'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:31.214497 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:31.214806 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4ea82867-d8ec-4813-bde2-f5f46931c826 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10c7b357c22e4067ab732557e18a63ac'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:31.233441 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4ea82867-d8ec-4813-bde2-f5f46931c826 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10c7b357c22e4067ab732557e18a63ac'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:31.234493 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4ea82867-d8ec-4813-bde2-f5f46931c826 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10c7b357c22e4067ab732557e18a63ac'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:31.238005 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf5699-4178-41ff-a880-2bf7904b8f91 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:31.244227 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e57b0-cedd-485b-9fc3-17509c580e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:31.246091 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e57b0-cedd-485b-9fc3-17509c580e2d admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:31.246404 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e57b0-cedd-485b-9fc3-17509c580e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:31.246667 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e57b0-cedd-485b-9fc3-17509c580e2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:31.247328 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e57b0-cedd-485b-9fc3-17509c580e2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:31.249128 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e57b0-cedd-485b-9fc3-17509c580e2d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:31.253908 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1126/2237] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:27:31 2022] DELETE /identity/v3/users/10c7b357c22e4067ab732557e18a63ac => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:27:31.264355 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1112/2238] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 13:27:31.272449 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea82867-d8ec-4813-bde2-f5f46931c826 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:31.274485 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4ea82867-d8ec-4813-bde2-f5f46931c826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:31.354538 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea82867-d8ec-4813-bde2-f5f46931c826 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:31.360524 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9dffca-2b2b-4ad7-9df6-0a44d84cf582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:31.361199 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dffca-2b2b-4ad7-9df6-0a44d84cf582 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:31.361489 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dffca-2b2b-4ad7-9df6-0a44d84cf582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:31.361819 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dffca-2b2b-4ad7-9df6-0a44d84cf582 admin admin] PATH_INFO: `/v3/projects/6e0d7ef0159846b181c6a3af4afc60ce/users/5e24e63f0cc4404f94734dc4e941bb97/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:31.364018 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9dffca-2b2b-4ad7-9df6-0a44d84cf582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e0d7ef0159846b181c6a3af4afc60ce, user_id=5e24e63f0cc4404f94734dc4e941bb97, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:31.366721 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9dffca-2b2b-4ad7-9df6-0a44d84cf582 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:31.377778 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1127/2239] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:27:31 2022] PUT /identity/v3/projects/6e0d7ef0159846b181c6a3af4afc60ce/users/5e24e63f0cc4404f94734dc4e941bb97/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:31.389042 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452fb7a-c491-40bb-b6cb-54689dcbb58a None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:31.389331 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452fb7a-c491-40bb-b6cb-54689dcbb58a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:31.389665 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452fb7a-c491-40bb-b6cb-54689dcbb58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:31.423884 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-d452fb7a-c491-40bb-b6cb-54689dcbb58a None None] MFA Rules not processed for user `5e24e63f0cc4404f94734dc4e941bb97`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:31.425134 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d452fb7a-c491-40bb-b6cb-54689dcbb58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:31.535770 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1113/2240] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:31 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:31.547942 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9dffca-2b2b-4ad7-9df6-0a44d84cf582 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:31.550571 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4a9dffca-2b2b-4ad7-9df6-0a44d84cf582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:31.595316 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452fb7a-c491-40bb-b6cb-54689dcbb58a None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:31.597470 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d452fb7a-c491-40bb-b6cb-54689dcbb58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:31.674919 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9dffca-2b2b-4ad7-9df6-0a44d84cf582 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:31.679580 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d33b3d-4536-4b37-aa0e-058c20125b71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:31.680358 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d33b3d-4536-4b37-aa0e-058c20125b71 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:31.680593 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d33b3d-4536-4b37-aa0e-058c20125b71 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:31.681383 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d33b3d-4536-4b37-aa0e-058c20125b71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:31.693799 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d33b3d-4536-4b37-aa0e-058c20125b71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:31.695245 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d33b3d-4536-4b37-aa0e-058c20125b71 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:31.707150 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1128/2241] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:27:31 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:27:31.710939 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452fb7a-c491-40bb-b6cb-54689dcbb58a None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:31.718032 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7e6872-a7c9-4578-af8b-4bb4c696fd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:31.718863 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e6872-a7c9-4578-af8b-4bb4c696fd49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:31.719245 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e6872-a7c9-4578-af8b-4bb4c696fd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:31.719613 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e6872-a7c9-4578-af8b-4bb4c696fd49 admin admin] PATH_INFO: `/v3/projects/53690578d8404d19a49741773d19485f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:31.720993 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7e6872-a7c9-4578-af8b-4bb4c696fd49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53690578d8404d19a49741773d19485f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:31.724730 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7e6872-a7c9-4578-af8b-4bb4c696fd49 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:31.781112 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2a7e6872-a7c9-4578-af8b-4bb4c696fd49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53690578d8404d19a49741773d19485f', 'request_id': 'req-2a7e6872-a7c9-4578-af8b-4bb4c696fd49'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:31.798136 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2a7e6872-a7c9-4578-af8b-4bb4c696fd49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53690578d8404d19a49741773d19485f', 'request_id': 'req-2a7e6872-a7c9-4578-af8b-4bb4c696fd49'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:31.801728 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d33b3d-4536-4b37-aa0e-058c20125b71 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:31.813327 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d33b3d-4536-4b37-aa0e-058c20125b71 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:31.814422 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2a7e6872-a7c9-4578-af8b-4bb4c696fd49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53690578d8404d19a49741773d19485f', 'request_id': 'req-2a7e6872-a7c9-4578-af8b-4bb4c696fd49'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:31.820786 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:31.831306 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2a7e6872-a7c9-4578-af8b-4bb4c696fd49 admin admin] The token cache is being invalidate because project 53690578d8404d19a49741773d19485f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:27:31.831712 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2a7e6872-a7c9-4578-af8b-4bb4c696fd49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:31.832328 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2a7e6872-a7c9-4578-af8b-4bb4c696fd49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:31.834074 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1114/2242] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:27:31 2022] DELETE /identity/v3/projects/53690578d8404d19a49741773d19485f => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:31.838853 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b6a91-0ad9-4fbf-b47a-4b99ae4aa2f8 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:31.839185 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b6a91-0ad9-4fbf-b47a-4b99ae4aa2f8 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:31.839702 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b6a91-0ad9-4fbf-b47a-4b99ae4aa2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:31.846155 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:31.863877 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-e87b6a91-0ad9-4fbf-b47a-4b99ae4aa2f8 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:31.865220 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e87b6a91-0ad9-4fbf-b47a-4b99ae4aa2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:31.873685 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7ba75-1318-42e3-a250-b021ac9d1644 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:31.874305 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7ba75-1318-42e3-a250-b021ac9d1644 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:31.874821 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7ba75-1318-42e3-a250-b021ac9d1644 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:31.875099 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7ba75-1318-42e3-a250-b021ac9d1644 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:31.876916 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-55e7ba75-1318-42e3-a250-b021ac9d1644 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:31.938033 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1115/2243] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:27:31.946773 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b0b3f-0c77-4feb-b7a1-cee539c2c598 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:31.947070 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b0b3f-0c77-4feb-b7a1-cee539c2c598 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:31.947323 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b0b3f-0c77-4feb-b7a1-cee539c2c598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:31.950690 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7ba75-1318-42e3-a250-b021ac9d1644 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:31.952581 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7ba75-1318-42e3-a250-b021ac9d1644 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:31.965215 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1129/2244] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:27:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:27:31.967934 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-be7b0b3f-0c77-4feb-b7a1-cee539c2c598 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:31.969129 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-be7b0b3f-0c77-4feb-b7a1-cee539c2c598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:31.977426 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1116/2245] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:31.981767 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7ba75-1318-42e3-a250-b021ac9d1644 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:31.993811 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7ba75-1318-42e3-a250-b021ac9d1644 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:31.999841 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e206207-5cbd-439b-af2f-7cef1d23615a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:32.000479 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e206207-5cbd-439b-af2f-7cef1d23615a admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:32.000729 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e206207-5cbd-439b-af2f-7cef1d23615a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:32.000987 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e206207-5cbd-439b-af2f-7cef1d23615a admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:32.001674 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e206207-5cbd-439b-af2f-7cef1d23615a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:27:32.001975 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e206207-5cbd-439b-af2f-7cef1d23615a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:32.003811 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e206207-5cbd-439b-af2f-7cef1d23615a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:32.020715 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1130/2246] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:27:32.021860 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b0b3f-0c77-4feb-b7a1-cee539c2c598 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:32.031494 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b0b3f-0c77-4feb-b7a1-cee539c2c598 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:32.036200 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbed5e-bd80-488c-ab43-7af977220785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:32.036807 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbed5e-bd80-488c-ab43-7af977220785 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:32.037088 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbed5e-bd80-488c-ab43-7af977220785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:32.037359 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbed5e-bd80-488c-ab43-7af977220785 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:32.038046 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fbed5e-bd80-488c-ab43-7af977220785 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:32.039996 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fbed5e-bd80-488c-ab43-7af977220785 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:32.071719 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1117/2247] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:27:32 2022] POST /identity/v3/projects => generated 391 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:27:32.076179 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e206207-5cbd-439b-af2f-7cef1d23615a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:32.089604 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e206207-5cbd-439b-af2f-7cef1d23615a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:32.154021 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0e508-776b-4965-9e9c-d6d28d7859e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:32.154633 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0e508-776b-4965-9e9c-d6d28d7859e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:32.154907 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0e508-776b-4965-9e9c-d6d28d7859e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:32.155276 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0e508-776b-4965-9e9c-d6d28d7859e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:32.155998 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0e508-776b-4965-9e9c-d6d28d7859e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:32.158102 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0e508-776b-4965-9e9c-d6d28d7859e2 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:32.182951 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1131/2248] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:27:32 2022] POST /identity/v3/users => generated 296 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:27:32.187788 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbed5e-bd80-488c-ab43-7af977220785 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:32.211913 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbed5e-bd80-488c-ab43-7af977220785 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:32.220043 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2cd0a4-d0d4-4be4-939f-f724e88ceeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:32.220768 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2cd0a4-d0d4-4be4-939f-f724e88ceeaf admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:32.221026 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2cd0a4-d0d4-4be4-939f-f724e88ceeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:32.221293 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2cd0a4-d0d4-4be4-939f-f724e88ceeaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:32.222010 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2cd0a4-d0d4-4be4-939f-f724e88ceeaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:32.223798 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2cd0a4-d0d4-4be4-939f-f724e88ceeaf admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:32.234855 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1118/2249] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:27:32.238873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0e508-776b-4965-9e9c-d6d28d7859e2 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:32.255437 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0e508-776b-4965-9e9c-d6d28d7859e2 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:32.263640 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd2e06-c2cf-493d-a88b-14efaf545e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:32.264450 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd2e06-c2cf-493d-a88b-14efaf545e7f admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:32.264971 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd2e06-c2cf-493d-a88b-14efaf545e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:32.265572 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd2e06-c2cf-493d-a88b-14efaf545e7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:32.266365 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd2e06-c2cf-493d-a88b-14efaf545e7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:32.270575 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd2e06-c2cf-493d-a88b-14efaf545e7f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:32.288302 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1132/2250] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:27:32.291470 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2cd0a4-d0d4-4be4-939f-f724e88ceeaf admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:32.303887 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2cd0a4-d0d4-4be4-939f-f724e88ceeaf admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:32.308981 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995dce9-590c-4bf2-a4f1-362dc2de2321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:32.309692 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995dce9-590c-4bf2-a4f1-362dc2de2321 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:32.309974 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995dce9-590c-4bf2-a4f1-362dc2de2321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:32.310372 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995dce9-590c-4bf2-a4f1-362dc2de2321 admin admin] PATH_INFO: `/v3/projects/21b8c922926a49019bf19698f84e95ca/users/4c6da61780df4dba8ce744ba3336892a/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:32.331262 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c995dce9-590c-4bf2-a4f1-362dc2de2321 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21b8c922926a49019bf19698f84e95ca, user_id=4c6da61780df4dba8ce744ba3336892a, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:32.334295 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c995dce9-590c-4bf2-a4f1-362dc2de2321 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:32.351510 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1119/2251] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:27:32 2022] PUT /identity/v3/projects/21b8c922926a49019bf19698f84e95ca/users/4c6da61780df4dba8ce744ba3336892a/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:27:32.365049 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24967d22-bb73-48a0-bb11-b4a5a35d95aa None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:32.365566 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24967d22-bb73-48a0-bb11-b4a5a35d95aa None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:32.365798 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24967d22-bb73-48a0-bb11-b4a5a35d95aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:32.404564 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-24967d22-bb73-48a0-bb11-b4a5a35d95aa None None] MFA Rules not processed for user `4c6da61780df4dba8ce744ba3336892a`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:32.405958 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-24967d22-bb73-48a0-bb11-b4a5a35d95aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:32.453787 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:32.479678 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1133/2252] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:32.485283 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995dce9-590c-4bf2-a4f1-362dc2de2321 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:32.548807 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995dce9-590c-4bf2-a4f1-362dc2de2321 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:32.553557 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214c2c6-b7e1-4f0f-85e7-b97b22dde0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:32.554360 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214c2c6-b7e1-4f0f-85e7-b97b22dde0b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:32.554638 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214c2c6-b7e1-4f0f-85e7-b97b22dde0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:32.554926 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214c2c6-b7e1-4f0f-85e7-b97b22dde0b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:32.555594 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214c2c6-b7e1-4f0f-85e7-b97b22dde0b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:32.557517 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214c2c6-b7e1-4f0f-85e7-b97b22dde0b3 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:32.591038 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1120/2253] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:27:32 2022] POST /identity/v3/projects => generated 391 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:27:32.592278 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24967d22-bb73-48a0-bb11-b4a5a35d95aa None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:32.603560 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24967d22-bb73-48a0-bb11-b4a5a35d95aa None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:32.666439 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372063b5-3905-4736-a204-dae97cfda341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:32.667531 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372063b5-3905-4736-a204-dae97cfda341 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:32.667880 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372063b5-3905-4736-a204-dae97cfda341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:32.668152 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372063b5-3905-4736-a204-dae97cfda341 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:32.668789 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372063b5-3905-4736-a204-dae97cfda341 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:32.671392 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372063b5-3905-4736-a204-dae97cfda341 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:32.696996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1134/2254] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:27:32 2022] POST /identity/v3/users => generated 302 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:27:32.701310 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214c2c6-b7e1-4f0f-85e7-b97b22dde0b3 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:32.712399 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214c2c6-b7e1-4f0f-85e7-b97b22dde0b3 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:32.717104 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b0570-2080-449b-8c24-0c300af907dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:32.717786 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b0570-2080-449b-8c24-0c300af907dc admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:32.718083 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b0570-2080-449b-8c24-0c300af907dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:32.718359 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b0570-2080-449b-8c24-0c300af907dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:32.719012 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b0570-2080-449b-8c24-0c300af907dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:32.720663 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b0570-2080-449b-8c24-0c300af907dc admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:32.732318 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1121/2255] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:27:32.736937 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372063b5-3905-4736-a204-dae97cfda341 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:32.747736 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372063b5-3905-4736-a204-dae97cfda341 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:32.752646 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175b7e1-1826-4e97-a542-1b356b883cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:32.753290 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175b7e1-1826-4e97-a542-1b356b883cbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:32.754338 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175b7e1-1826-4e97-a542-1b356b883cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:32.754620 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175b7e1-1826-4e97-a542-1b356b883cbc admin admin] PATH_INFO: `/v3/projects/5064988bcd7648d8a150182af08a0de2/users/22ac1fca1c324ff69ca3f57857427eac/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:32.770552 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c175b7e1-1826-4e97-a542-1b356b883cbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5064988bcd7648d8a150182af08a0de2, user_id=22ac1fca1c324ff69ca3f57857427eac, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:32.773263 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c175b7e1-1826-4e97-a542-1b356b883cbc admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:32.791214 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1135/2256] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:27:32 2022] PUT /identity/v3/projects/5064988bcd7648d8a150182af08a0de2/users/22ac1fca1c324ff69ca3f57857427eac/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:32.792819 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b0570-2080-449b-8c24-0c300af907dc admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:32.805075 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b0570-2080-449b-8c24-0c300af907dc admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:32.809422 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:32.867237 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9c06c-8a19-47d8-b98e-51baf6927aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:32.867933 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9c06c-8a19-47d8-b98e-51baf6927aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:32.868217 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9c06c-8a19-47d8-b98e-51baf6927aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:32.868484 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9c06c-8a19-47d8-b98e-51baf6927aa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:32.869130 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db9c06c-8a19-47d8-b98e-51baf6927aa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:32.870916 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db9c06c-8a19-47d8-b98e-51baf6927aa7 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:32.884838 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1122/2257] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:27:32.886268 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175b7e1-1826-4e97-a542-1b356b883cbc admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:32.896329 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175b7e1-1826-4e97-a542-1b356b883cbc admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:32.900820 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c2f99-543a-4951-9cd5-f019b38b52ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:32.901630 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c2f99-543a-4951-9cd5-f019b38b52ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:32.902023 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c2f99-543a-4951-9cd5-f019b38b52ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:32.902355 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c2f99-543a-4951-9cd5-f019b38b52ae admin admin] PATH_INFO: `/v3/projects/5064988bcd7648d8a150182af08a0de2/users/22ac1fca1c324ff69ca3f57857427eac/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:32.904342 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c2f99-543a-4951-9cd5-f019b38b52ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=5064988bcd7648d8a150182af08a0de2, user_id=22ac1fca1c324ff69ca3f57857427eac, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:32.907063 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c2f99-543a-4951-9cd5-f019b38b52ae admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:32.918988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1136/2258] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:27:32 2022] PUT /identity/v3/projects/5064988bcd7648d8a150182af08a0de2/users/22ac1fca1c324ff69ca3f57857427eac/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:32.929402 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4195b-0f36-497d-9283-9f5aa128b906 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:32.929725 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4195b-0f36-497d-9283-9f5aa128b906 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:32.930009 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4195b-0f36-497d-9283-9f5aa128b906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:32.962359 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-c0e4195b-0f36-497d-9283-9f5aa128b906 None None] MFA Rules not processed for user `22ac1fca1c324ff69ca3f57857427eac`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:32.963892 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c0e4195b-0f36-497d-9283-9f5aa128b906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:33.034186 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1123/2259] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:32 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:27:33.045207 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c2f99-543a-4951-9cd5-f019b38b52ae admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:33.046991 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1b4c2f99-543a-4951-9cd5-f019b38b52ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:33.123596 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c2f99-543a-4951-9cd5-f019b38b52ae admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:33.127623 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d78462-207f-418e-b507-8d4cfa379311 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:33.128509 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d78462-207f-418e-b507-8d4cfa379311 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:33.128900 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d78462-207f-418e-b507-8d4cfa379311 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:33.129230 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d78462-207f-418e-b507-8d4cfa379311 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:33.138914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d78462-207f-418e-b507-8d4cfa379311 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:33.140436 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d78462-207f-418e-b507-8d4cfa379311 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:33.160486 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1137/2260] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:27:33 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:27:33.210567 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e4195b-0f36-497d-9283-9f5aa128b906 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:33.212008 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c0e4195b-0f36-497d-9283-9f5aa128b906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:33.224654 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e4195b-0f36-497d-9283-9f5aa128b906 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:33.228486 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3b3c5-2cc1-4c49-aeb9-5a5020044e8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:33.229086 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3b3c5-2cc1-4c49-aeb9-5a5020044e8c service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:33.229355 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3b3c5-2cc1-4c49-aeb9-5a5020044e8c service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:33.229977 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3b3c5-2cc1-4c49-aeb9-5a5020044e8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:33.289935 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a3b3c5-2cc1-4c49-aeb9-5a5020044e8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:33.291362 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a3b3c5-2cc1-4c49-aeb9-5a5020044e8c service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:33.300782 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1124/2261] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:27:33 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:27:36.853311 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d78462-207f-418e-b507-8d4cfa379311 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:36.910736 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:36.937105 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3b3c5-2cc1-4c49-aeb9-5a5020044e8c service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:36.938583 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-26a3b3c5-2cc1-4c49-aeb9-5a5020044e8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:36.942279 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d78462-207f-418e-b507-8d4cfa379311 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:36.946746 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535da43-5665-4c76-8a31-07b9741b3fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:36.947378 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535da43-5665-4c76-8a31-07b9741b3fff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:36.947663 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535da43-5665-4c76-8a31-07b9741b3fff admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:36.947934 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535da43-5665-4c76-8a31-07b9741b3fff admin admin] PATH_INFO: `/v3/users/4c6da61780df4dba8ce744ba3336892a` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:36.949048 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8535da43-5665-4c76-8a31-07b9741b3fff admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c6da61780df4dba8ce744ba3336892a)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:36.951361 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8535da43-5665-4c76-8a31-07b9741b3fff admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:36.954379 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3b3c5-2cc1-4c49-aeb9-5a5020044e8c service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:36.962173 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c53337-3df2-4e58-83d3-2602e9f53c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:36.962881 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c53337-3df2-4e58-83d3-2602e9f53c64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:36.963227 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c53337-3df2-4e58-83d3-2602e9f53c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:36.963563 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c53337-3df2-4e58-83d3-2602e9f53c64 admin admin] PATH_INFO: `/v3/users/c44358a0fc1140dabe3bc8b80c78e1d6` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:36.964715 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c53337-3df2-4e58-83d3-2602e9f53c64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c44358a0fc1140dabe3bc8b80c78e1d6)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:36.967035 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c53337-3df2-4e58-83d3-2602e9f53c64 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:37.000135 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:37.014123 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-8535da43-5665-4c76-8a31-07b9741b3fff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c6da61780df4dba8ce744ba3336892a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:37.015090 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-8535da43-5665-4c76-8a31-07b9741b3fff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c6da61780df4dba8ce744ba3336892a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:37.024322 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-8535da43-5665-4c76-8a31-07b9741b3fff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c6da61780df4dba8ce744ba3336892a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:37.030428 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a4c53337-3df2-4e58-83d3-2602e9f53c64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c44358a0fc1140dabe3bc8b80c78e1d6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:37.031507 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a4c53337-3df2-4e58-83d3-2602e9f53c64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c44358a0fc1140dabe3bc8b80c78e1d6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:37.037342 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-8535da43-5665-4c76-8a31-07b9741b3fff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c6da61780df4dba8ce744ba3336892a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:37.038536 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-8535da43-5665-4c76-8a31-07b9741b3fff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c6da61780df4dba8ce744ba3336892a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:37.039857 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a4c53337-3df2-4e58-83d3-2602e9f53c64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c44358a0fc1140dabe3bc8b80c78e1d6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:37.053452 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1138/2262] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:27:36 2022] DELETE /identity/v3/users/4c6da61780df4dba8ce744ba3336892a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:37.057809 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeaf1ac-5293-4056-8ee4-18417b88af14 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:37.058086 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeaf1ac-5293-4056-8ee4-18417b88af14 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:37.058572 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeaf1ac-5293-4056-8ee4-18417b88af14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:37.062164 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a4c53337-3df2-4e58-83d3-2602e9f53c64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c44358a0fc1140dabe3bc8b80c78e1d6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:37.063033 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a4c53337-3df2-4e58-83d3-2602e9f53c64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c44358a0fc1140dabe3bc8b80c78e1d6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:37.080781 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1125/2263] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:27:36 2022] DELETE /identity/v3/users/c44358a0fc1140dabe3bc8b80c78e1d6 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:27:37.081853 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-ffeaf1ac-5293-4056-8ee4-18417b88af14 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:37.083626 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ffeaf1ac-5293-4056-8ee4-18417b88af14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:37.085646 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83778d70-c9c4-41d9-b516-a9993c014e88 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:37.085997 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83778d70-c9c4-41d9-b516-a9993c014e88 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:37.086334 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83778d70-c9c4-41d9-b516-a9993c014e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:37.111963 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-83778d70-c9c4-41d9-b516-a9993c014e88 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:37.114419 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-83778d70-c9c4-41d9-b516-a9993c014e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:37.156458 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1139/2264] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:37.167450 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeaf1ac-5293-4056-8ee4-18417b88af14 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:37.169213 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ffeaf1ac-5293-4056-8ee4-18417b88af14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:37.205205 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1126/2265] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:27:37.215131 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83778d70-c9c4-41d9-b516-a9993c014e88 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:37.216875 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-83778d70-c9c4-41d9-b516-a9993c014e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:37.242073 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeaf1ac-5293-4056-8ee4-18417b88af14 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:37.246393 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8a7aa-a99f-483f-9cc6-c34f1e7cad1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:37.247113 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8a7aa-a99f-483f-9cc6-c34f1e7cad1d service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:37.247530 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8a7aa-a99f-483f-9cc6-c34f1e7cad1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:37.247892 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8a7aa-a99f-483f-9cc6-c34f1e7cad1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:37.258869 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8a7aa-a99f-483f-9cc6-c34f1e7cad1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:37.259993 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8a7aa-a99f-483f-9cc6-c34f1e7cad1d service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:37.264816 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:37.274474 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1140/2266] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:27:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:27:37.285252 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83778d70-c9c4-41d9-b516-a9993c014e88 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:37.289391 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ecf4a6-0ed4-4912-a2cb-559386c260f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:37.290246 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecf4a6-0ed4-4912-a2cb-559386c260f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:37.290841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecf4a6-0ed4-4912-a2cb-559386c260f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:37.291191 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecf4a6-0ed4-4912-a2cb-559386c260f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:37.301263 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ecf4a6-0ed4-4912-a2cb-559386c260f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:37.302855 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ecf4a6-0ed4-4912-a2cb-559386c260f0 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:37.314855 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1127/2267] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:27:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:27:37.618536 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8a7aa-a99f-483f-9cc6-c34f1e7cad1d service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:37.620661 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b9a8a7aa-a99f-483f-9cc6-c34f1e7cad1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:37.637087 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8a7aa-a99f-483f-9cc6-c34f1e7cad1d service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:37.644409 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af878b-2e14-428e-8e9a-7dd9db13c06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:37.645108 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af878b-2e14-428e-8e9a-7dd9db13c06c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:37.645407 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af878b-2e14-428e-8e9a-7dd9db13c06c admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:37.645741 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af878b-2e14-428e-8e9a-7dd9db13c06c admin admin] PATH_INFO: `/v3/projects/21b8c922926a49019bf19698f84e95ca` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:37.647013 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af878b-2e14-428e-8e9a-7dd9db13c06c admin admin] RBAC: Authorizing `identity:delete_project(project_id=21b8c922926a49019bf19698f84e95ca)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:37.649144 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af878b-2e14-428e-8e9a-7dd9db13c06c admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:37.669923 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ecf4a6-0ed4-4912-a2cb-559386c260f0 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:37.671743 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e7ecf4a6-0ed4-4912-a2cb-559386c260f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:37.692285 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ecf4a6-0ed4-4912-a2cb-559386c260f0 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:37.708526 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-60af878b-2e14-428e-8e9a-7dd9db13c06c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21b8c922926a49019bf19698f84e95ca', 'request_id': 'req-60af878b-2e14-428e-8e9a-7dd9db13c06c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:37.714611 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-60af878b-2e14-428e-8e9a-7dd9db13c06c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21b8c922926a49019bf19698f84e95ca', 'request_id': 'req-60af878b-2e14-428e-8e9a-7dd9db13c06c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:37.721102 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-60af878b-2e14-428e-8e9a-7dd9db13c06c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21b8c922926a49019bf19698f84e95ca', 'request_id': 'req-60af878b-2e14-428e-8e9a-7dd9db13c06c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:37.734135 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-60af878b-2e14-428e-8e9a-7dd9db13c06c admin admin] The token cache is being invalidate because project 21b8c922926a49019bf19698f84e95ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:27:37.734425 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-60af878b-2e14-428e-8e9a-7dd9db13c06c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:37.735055 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-60af878b-2e14-428e-8e9a-7dd9db13c06c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:37.736557 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1141/2268] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:27:37 2022] DELETE /identity/v3/projects/21b8c922926a49019bf19698f84e95ca => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:37.738386 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:37.740570 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af878b-2e14-428e-8e9a-7dd9db13c06c admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:37.742141 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-60af878b-2e14-428e-8e9a-7dd9db13c06c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:37.758983 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618018b-4937-4399-89c3-cabd0492d392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:37.759830 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618018b-4937-4399-89c3-cabd0492d392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:37.760107 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618018b-4937-4399-89c3-cabd0492d392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:37.760487 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618018b-4937-4399-89c3-cabd0492d392 admin admin] PATH_INFO: `/v3/projects/3e86c2575df24477a133e7a493d7d04c` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:37.762131 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0618018b-4937-4399-89c3-cabd0492d392 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e86c2575df24477a133e7a493d7d04c)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:37.764674 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0618018b-4937-4399-89c3-cabd0492d392 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:37.818496 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0618018b-4937-4399-89c3-cabd0492d392 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e86c2575df24477a133e7a493d7d04c', 'request_id': 'req-0618018b-4937-4399-89c3-cabd0492d392'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:37.819179 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af878b-2e14-428e-8e9a-7dd9db13c06c admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:37.827231 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0618018b-4937-4399-89c3-cabd0492d392 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e86c2575df24477a133e7a493d7d04c', 'request_id': 'req-0618018b-4937-4399-89c3-cabd0492d392'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:37.834049 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0618018b-4937-4399-89c3-cabd0492d392 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e86c2575df24477a133e7a493d7d04c', 'request_id': 'req-0618018b-4937-4399-89c3-cabd0492d392'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:37.844708 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0618018b-4937-4399-89c3-cabd0492d392 admin admin] The token cache is being invalidate because project 3e86c2575df24477a133e7a493d7d04c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:27:37.844998 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0618018b-4937-4399-89c3-cabd0492d392 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:37.845741 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0618018b-4937-4399-89c3-cabd0492d392 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:37.847243 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1128/2269] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:27:37 2022] DELETE /identity/v3/projects/3e86c2575df24477a133e7a493d7d04c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:37.851090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618018b-4937-4399-89c3-cabd0492d392 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:37.852381 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0618018b-4937-4399-89c3-cabd0492d392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:37.881876 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ef6db-a6cc-4279-bd55-700608a0ea10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:37.882516 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ef6db-a6cc-4279-bd55-700608a0ea10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:37.882793 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ef6db-a6cc-4279-bd55-700608a0ea10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:37.883435 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ef6db-a6cc-4279-bd55-700608a0ea10 admin admin] PATH_INFO: `/v3/users/22ac1fca1c324ff69ca3f57857427eac` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:37.884247 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ef6db-a6cc-4279-bd55-700608a0ea10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22ac1fca1c324ff69ca3f57857427eac)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:37.886223 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ef6db-a6cc-4279-bd55-700608a0ea10 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:37.930067 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618018b-4937-4399-89c3-cabd0492d392 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:37.935569 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a803bc-fd00-4ebd-82a7-a4838cc14b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:37.936503 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a803bc-fd00-4ebd-82a7-a4838cc14b75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:37.936641 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:37.936767 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a803bc-fd00-4ebd-82a7-a4838cc14b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:37.937031 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a803bc-fd00-4ebd-82a7-a4838cc14b75 admin admin] PATH_INFO: `/v3/users/5e24e63f0cc4404f94734dc4e941bb97` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:37.939650 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a803bc-fd00-4ebd-82a7-a4838cc14b75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e24e63f0cc4404f94734dc4e941bb97)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:37.941682 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a803bc-fd00-4ebd-82a7-a4838cc14b75 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:37.953474 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-008ef6db-a6cc-4279-bd55-700608a0ea10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22ac1fca1c324ff69ca3f57857427eac'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:37.954169 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-008ef6db-a6cc-4279-bd55-700608a0ea10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22ac1fca1c324ff69ca3f57857427eac'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:37.961166 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-008ef6db-a6cc-4279-bd55-700608a0ea10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22ac1fca1c324ff69ca3f57857427eac'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:37.974558 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-008ef6db-a6cc-4279-bd55-700608a0ea10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22ac1fca1c324ff69ca3f57857427eac'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:37.975279 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-008ef6db-a6cc-4279-bd55-700608a0ea10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22ac1fca1c324ff69ca3f57857427eac'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:37.988734 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1142/2270] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:27:37 2022] DELETE /identity/v3/users/22ac1fca1c324ff69ca3f57857427eac => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:27:37.990768 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-88a803bc-fd00-4ebd-82a7-a4838cc14b75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e24e63f0cc4404f94734dc4e941bb97'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:37.991501 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-88a803bc-fd00-4ebd-82a7-a4838cc14b75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e24e63f0cc4404f94734dc4e941bb97'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:38.000634 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-88a803bc-fd00-4ebd-82a7-a4838cc14b75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e24e63f0cc4404f94734dc4e941bb97'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:38.013499 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-88a803bc-fd00-4ebd-82a7-a4838cc14b75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e24e63f0cc4404f94734dc4e941bb97'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:38.014357 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-88a803bc-fd00-4ebd-82a7-a4838cc14b75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e24e63f0cc4404f94734dc4e941bb97'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:38.016259 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:38.029956 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1129/2271] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:27:37 2022] DELETE /identity/v3/users/5e24e63f0cc4404f94734dc4e941bb97 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:27:38.362186 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ef6db-a6cc-4279-bd55-700608a0ea10 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:38.363762 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-008ef6db-a6cc-4279-bd55-700608a0ea10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:38.413232 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a803bc-fd00-4ebd-82a7-a4838cc14b75 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:38.414753 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-88a803bc-fd00-4ebd-82a7-a4838cc14b75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:38.468967 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ef6db-a6cc-4279-bd55-700608a0ea10 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:38.495973 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a803bc-fd00-4ebd-82a7-a4838cc14b75 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:38.500847 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7d1d1-2c69-49b5-a726-d855a3072358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:38.501499 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7d1d1-2c69-49b5-a726-d855a3072358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:38.501806 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7d1d1-2c69-49b5-a726-d855a3072358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:38.502076 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7d1d1-2c69-49b5-a726-d855a3072358 admin admin] PATH_INFO: `/v3/projects/6e0d7ef0159846b181c6a3af4afc60ce` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:38.503192 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7d1d1-2c69-49b5-a726-d855a3072358 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e0d7ef0159846b181c6a3af4afc60ce)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:38.505136 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7d1d1-2c69-49b5-a726-d855a3072358 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:38.527987 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001c93e-1ddb-430c-8222-ef1c0eca5013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:38.528888 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001c93e-1ddb-430c-8222-ef1c0eca5013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:38.529175 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001c93e-1ddb-430c-8222-ef1c0eca5013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:38.529456 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001c93e-1ddb-430c-8222-ef1c0eca5013 admin admin] PATH_INFO: `/v3/projects/5064988bcd7648d8a150182af08a0de2` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:38.530646 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4001c93e-1ddb-430c-8222-ef1c0eca5013 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5064988bcd7648d8a150182af08a0de2)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:38.532847 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4001c93e-1ddb-430c-8222-ef1c0eca5013 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:38.553321 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-cea7d1d1-2c69-49b5-a726-d855a3072358 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e0d7ef0159846b181c6a3af4afc60ce', 'request_id': 'req-cea7d1d1-2c69-49b5-a726-d855a3072358'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:38.561979 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-cea7d1d1-2c69-49b5-a726-d855a3072358 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e0d7ef0159846b181c6a3af4afc60ce', 'request_id': 'req-cea7d1d1-2c69-49b5-a726-d855a3072358'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:38.569995 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-cea7d1d1-2c69-49b5-a726-d855a3072358 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e0d7ef0159846b181c6a3af4afc60ce', 'request_id': 'req-cea7d1d1-2c69-49b5-a726-d855a3072358'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:38.582507 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-cea7d1d1-2c69-49b5-a726-d855a3072358 admin admin] The token cache is being invalidate because project 6e0d7ef0159846b181c6a3af4afc60ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:27:38.582793 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-cea7d1d1-2c69-49b5-a726-d855a3072358 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:38.583443 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-cea7d1d1-2c69-49b5-a726-d855a3072358 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:38.585246 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1130/2272] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:27:38 2022] DELETE /identity/v3/projects/6e0d7ef0159846b181c6a3af4afc60ce => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:27:38.588465 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4001c93e-1ddb-430c-8222-ef1c0eca5013 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5064988bcd7648d8a150182af08a0de2', 'request_id': 'req-4001c93e-1ddb-430c-8222-ef1c0eca5013'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:38.589802 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216b108-9978-4346-813f-343c55f62d12 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:38.590086 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216b108-9978-4346-813f-343c55f62d12 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:38.590390 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216b108-9978-4346-813f-343c55f62d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:38.593274 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:38.594617 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4001c93e-1ddb-430c-8222-ef1c0eca5013 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5064988bcd7648d8a150182af08a0de2', 'request_id': 'req-4001c93e-1ddb-430c-8222-ef1c0eca5013'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:38.602282 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4001c93e-1ddb-430c-8222-ef1c0eca5013 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5064988bcd7648d8a150182af08a0de2', 'request_id': 'req-4001c93e-1ddb-430c-8222-ef1c0eca5013'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:38.612038 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-6216b108-9978-4346-813f-343c55f62d12 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:38.613278 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6216b108-9978-4346-813f-343c55f62d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:38.615999 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4001c93e-1ddb-430c-8222-ef1c0eca5013 admin admin] The token cache is being invalidate because project 5064988bcd7648d8a150182af08a0de2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:27:38.616321 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4001c93e-1ddb-430c-8222-ef1c0eca5013 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:38.616945 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4001c93e-1ddb-430c-8222-ef1c0eca5013 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:38.618707 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1143/2273] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:27:38 2022] DELETE /identity/v3/projects/5064988bcd7648d8a150182af08a0de2 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:38.624562 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17897628-18b1-485c-8da9-b7bfea65f48c None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:38.624929 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17897628-18b1-485c-8da9-b7bfea65f48c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:38.625133 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17897628-18b1-485c-8da9-b7bfea65f48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:38.646619 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-17897628-18b1-485c-8da9-b7bfea65f48c None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:38.647840 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-17897628-18b1-485c-8da9-b7bfea65f48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:38.673826 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1131/2274] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:27:38.681689 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3df50-f455-4a77-b547-089187e06c23 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:38.681977 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3df50-f455-4a77-b547-089187e06c23 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:38.682255 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3df50-f455-4a77-b547-089187e06c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:38.703105 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-8dd3df50-f455-4a77-b547-089187e06c23 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:38.704270 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8dd3df50-f455-4a77-b547-089187e06c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:38.707409 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1144/2275] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:27:38.713991 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1132/2276] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:38.715136 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437da0a-bbe3-4ce3-b20a-21937363a0cf None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:38.715580 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437da0a-bbe3-4ce3-b20a-21937363a0cf None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:38.715961 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437da0a-bbe3-4ce3-b20a-21937363a0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:38.718310 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3df50-f455-4a77-b547-089187e06c23 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:38.728565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3df50-f455-4a77-b547-089187e06c23 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:38.734621 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6f37b-29ea-4ff6-a7a4-83adb69a192d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:38.735230 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6f37b-29ea-4ff6-a7a4-83adb69a192d admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:38.735508 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6f37b-29ea-4ff6-a7a4-83adb69a192d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:38.735779 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6f37b-29ea-4ff6-a7a4-83adb69a192d admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:38.736362 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e437da0a-bbe3-4ce3-b20a-21937363a0cf None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:38.736714 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e6f37b-29ea-4ff6-a7a4-83adb69a192d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:27:38.737027 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e6f37b-29ea-4ff6-a7a4-83adb69a192d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:38.737647 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e437da0a-bbe3-4ce3-b20a-21937363a0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:38.738790 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e6f37b-29ea-4ff6-a7a4-83adb69a192d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:38.746250 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1145/2277] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:38.750833 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437da0a-bbe3-4ce3-b20a-21937363a0cf None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:38.756763 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1133/2278] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:27:38.758292 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6f37b-29ea-4ff6-a7a4-83adb69a192d admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:38.760915 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437da0a-bbe3-4ce3-b20a-21937363a0cf None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:38.764773 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:38.765577 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58174351-cf05-4819-bcb8-153bf1457a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:38.766200 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58174351-cf05-4819-bcb8-153bf1457a6f admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:38.766470 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58174351-cf05-4819-bcb8-153bf1457a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:38.766771 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58174351-cf05-4819-bcb8-153bf1457a6f admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:38.767524 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58174351-cf05-4819-bcb8-153bf1457a6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:27:38.767892 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58174351-cf05-4819-bcb8-153bf1457a6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:38.769643 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58174351-cf05-4819-bcb8-153bf1457a6f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:38.771689 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6f37b-29ea-4ff6-a7a4-83adb69a192d admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:38.778496 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3cb2a0-c6ae-4432-8b93-e587fb6467ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:38.779169 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3cb2a0-c6ae-4432-8b93-e587fb6467ae admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:38.779519 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3cb2a0-c6ae-4432-8b93-e587fb6467ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:38.779798 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3cb2a0-c6ae-4432-8b93-e587fb6467ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:38.780431 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3cb2a0-c6ae-4432-8b93-e587fb6467ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:38.782669 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3cb2a0-c6ae-4432-8b93-e587fb6467ae admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:38.783313 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1146/2279] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:27:38.788154 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58174351-cf05-4819-bcb8-153bf1457a6f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:38.799008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58174351-cf05-4819-bcb8-153bf1457a6f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:38.805774 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa1c0c2-8139-4f2d-bedc-2639ee7c7f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:38.807464 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1c0c2-8139-4f2d-bedc-2639ee7c7f6d admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:38.807723 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1c0c2-8139-4f2d-bedc-2639ee7c7f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:38.808082 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1c0c2-8139-4f2d-bedc-2639ee7c7f6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:38.808772 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa1c0c2-8139-4f2d-bedc-2639ee7c7f6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:38.811860 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa1c0c2-8139-4f2d-bedc-2639ee7c7f6d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:38.818432 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1134/2280] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:27:38 2022] POST /identity/v3/projects => generated 361 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:27:38.819645 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3cb2a0-c6ae-4432-8b93-e587fb6467ae admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:38.840819 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1147/2281] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:27:38 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:27:38.845038 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa1c0c2-8139-4f2d-bedc-2639ee7c7f6d admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:38.893367 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3cb2a0-c6ae-4432-8b93-e587fb6467ae admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:38.914440 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa1c0c2-8139-4f2d-bedc-2639ee7c7f6d admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:38.919663 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c0232-6bba-4f73-b7d1-b05261927c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:38.920333 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c0232-6bba-4f73-b7d1-b05261927c47 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:38.920649 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c0232-6bba-4f73-b7d1-b05261927c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:38.920936 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c0232-6bba-4f73-b7d1-b05261927c47 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:38.921596 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0c0232-6bba-4f73-b7d1-b05261927c47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:38.923736 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0c0232-6bba-4f73-b7d1-b05261927c47 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:38.952963 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1148/2282] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:27:38 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:27:38.957327 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c0232-6bba-4f73-b7d1-b05261927c47 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:38.961172 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95843d-d89c-4a4e-9ab1-eae7b8f3eee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:38.961668 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95843d-d89c-4a4e-9ab1-eae7b8f3eee8 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:38.962024 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95843d-d89c-4a4e-9ab1-eae7b8f3eee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:38.962293 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95843d-d89c-4a4e-9ab1-eae7b8f3eee8 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:38.962955 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95843d-d89c-4a4e-9ab1-eae7b8f3eee8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:38.965027 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95843d-d89c-4a4e-9ab1-eae7b8f3eee8 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:38.969390 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c0232-6bba-4f73-b7d1-b05261927c47 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:38.975538 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36917ecf-9a54-4723-a681-020fa076959d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:38.976147 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36917ecf-9a54-4723-a681-020fa076959d admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:38.976559 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36917ecf-9a54-4723-a681-020fa076959d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:38.976975 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36917ecf-9a54-4723-a681-020fa076959d admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:38.977809 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36917ecf-9a54-4723-a681-020fa076959d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:38.979612 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36917ecf-9a54-4723-a681-020fa076959d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:38.993685 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1135/2283] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:27:38 2022] POST /identity/v3/users => generated 281 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:27:38.997596 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1149/2284] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:27:38.999555 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36917ecf-9a54-4723-a681-020fa076959d admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:38.999684 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95843d-d89c-4a4e-9ab1-eae7b8f3eee8 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:39.010037 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36917ecf-9a54-4723-a681-020fa076959d admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:39.010295 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95843d-d89c-4a4e-9ab1-eae7b8f3eee8 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:39.014874 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e80a44-f340-4340-8a28-6e39493b2b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:39.015392 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2243eb1c-6565-4204-a997-29647cecac24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:39.015622 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e80a44-f340-4340-8a28-6e39493b2b90 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:39.015969 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e80a44-f340-4340-8a28-6e39493b2b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:39.016087 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243eb1c-6565-4204-a997-29647cecac24 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:39.016251 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243eb1c-6565-4204-a997-29647cecac24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:39.016410 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e80a44-f340-4340-8a28-6e39493b2b90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:39.016523 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243eb1c-6565-4204-a997-29647cecac24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:39.017139 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2243eb1c-6565-4204-a997-29647cecac24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:39.017232 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e80a44-f340-4340-8a28-6e39493b2b90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:39.018814 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2243eb1c-6565-4204-a997-29647cecac24 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:39.018988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e80a44-f340-4340-8a28-6e39493b2b90 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:39.032766 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1136/2285] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:27:39.032968 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1150/2286] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:27:39.033819 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2243eb1c-6565-4204-a997-29647cecac24 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:39.034334 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e80a44-f340-4340-8a28-6e39493b2b90 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:39.044139 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2243eb1c-6565-4204-a997-29647cecac24 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:39.044377 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e80a44-f340-4340-8a28-6e39493b2b90 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:39.048704 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed78bb9-f597-45ed-94fb-6e0155ef0a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:39.048945 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcaa2e2-c5f5-4249-b385-e0acc4d066f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:39.049412 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed78bb9-f597-45ed-94fb-6e0155ef0a52 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:39.049632 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcaa2e2-c5f5-4249-b385-e0acc4d066f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:39.049748 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed78bb9-f597-45ed-94fb-6e0155ef0a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:39.049923 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcaa2e2-c5f5-4249-b385-e0acc4d066f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:39.050019 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed78bb9-f597-45ed-94fb-6e0155ef0a52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:39.050197 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcaa2e2-c5f5-4249-b385-e0acc4d066f9 admin admin] PATH_INFO: `/v3/projects/302af42675004d99a5e8474d4ce51412/users/4fb0de9bc62f4c528ae0420e2ad4cb0a/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:39.050617 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed78bb9-f597-45ed-94fb-6e0155ef0a52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:39.052210 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed78bb9-f597-45ed-94fb-6e0155ef0a52 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:39.059308 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:39.063140 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1137/2287] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:27:39.067443 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed78bb9-f597-45ed-94fb-6e0155ef0a52 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:39.068247 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcaa2e2-c5f5-4249-b385-e0acc4d066f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=302af42675004d99a5e8474d4ce51412, user_id=4fb0de9bc62f4c528ae0420e2ad4cb0a, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:39.071869 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcaa2e2-c5f5-4249-b385-e0acc4d066f9 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:39.077331 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed78bb9-f597-45ed-94fb-6e0155ef0a52 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:39.082389 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9aab52-9709-4c7b-95a9-04b7ab6a0ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:39.083095 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9aab52-9709-4c7b-95a9-04b7ab6a0ca4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:39.083372 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9aab52-9709-4c7b-95a9-04b7ab6a0ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:39.083669 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9aab52-9709-4c7b-95a9-04b7ab6a0ca4 admin admin] PATH_INFO: `/v3/projects/7f2393ac3ede4be9bf91e6409efe5c2a/users/1af0e718da4f4bf88895822a9425da3a/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:39.085597 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1151/2288] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:27:39 2022] PUT /identity/v3/projects/302af42675004d99a5e8474d4ce51412/users/4fb0de9bc62f4c528ae0420e2ad4cb0a/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:27:39.097355 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd8490-661a-4d84-9271-0b340d9f05dd None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:39.097677 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd8490-661a-4d84-9271-0b340d9f05dd None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:39.097952 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd8490-661a-4d84-9271-0b340d9f05dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:39.101216 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9aab52-9709-4c7b-95a9-04b7ab6a0ca4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f2393ac3ede4be9bf91e6409efe5c2a, user_id=1af0e718da4f4bf88895822a9425da3a, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:39.103943 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9aab52-9709-4c7b-95a9-04b7ab6a0ca4 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:39.120805 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1138/2289] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:27:39 2022] PUT /identity/v3/projects/7f2393ac3ede4be9bf91e6409efe5c2a/users/1af0e718da4f4bf88895822a9425da3a/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:27:39.131536 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e928560-d409-458e-8992-0b7656bf1f1d None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:39.131734 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-cfbd8490-661a-4d84-9271-0b340d9f05dd None None] MFA Rules not processed for user `4fb0de9bc62f4c528ae0420e2ad4cb0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:39.131948 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e928560-d409-458e-8992-0b7656bf1f1d None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:39.132311 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e928560-d409-458e-8992-0b7656bf1f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:39.133308 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cfbd8490-661a-4d84-9271-0b340d9f05dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:39.164410 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-2e928560-d409-458e-8992-0b7656bf1f1d None None] MFA Rules not processed for user `1af0e718da4f4bf88895822a9425da3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:39.165692 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2e928560-d409-458e-8992-0b7656bf1f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:39.186323 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:39.211874 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1152/2290] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:39.217860 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd8490-661a-4d84-9271-0b340d9f05dd None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:39.238663 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1139/2291] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:39.275480 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e928560-d409-458e-8992-0b7656bf1f1d None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:39.277062 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2e928560-d409-458e-8992-0b7656bf1f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:39.289577 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd8490-661a-4d84-9271-0b340d9f05dd None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:39.301525 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc92796-1c22-4a58-957b-90917b9e5847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:39.302462 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc92796-1c22-4a58-957b-90917b9e5847 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:39.302932 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc92796-1c22-4a58-957b-90917b9e5847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:39.303291 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc92796-1c22-4a58-957b-90917b9e5847 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:39.304021 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc92796-1c22-4a58-957b-90917b9e5847 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:39.306385 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc92796-1c22-4a58-957b-90917b9e5847 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:39.339706 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1153/2292] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:27:39 2022] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:27:39.344494 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc92796-1c22-4a58-957b-90917b9e5847 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:39.350593 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e928560-d409-458e-8992-0b7656bf1f1d None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:39.403824 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1140dd0d-c050-4351-b132-cf688e812464 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:39.404471 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140dd0d-c050-4351-b132-cf688e812464 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:39.404779 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140dd0d-c050-4351-b132-cf688e812464 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:39.405060 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140dd0d-c050-4351-b132-cf688e812464 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:39.412291 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc92796-1c22-4a58-957b-90917b9e5847 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:39.417107 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb0d08-e4bf-41e0-b102-13bfbe9f3744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:39.417746 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb0d08-e4bf-41e0-b102-13bfbe9f3744 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:39.418025 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb0d08-e4bf-41e0-b102-13bfbe9f3744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:39.418301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb0d08-e4bf-41e0-b102-13bfbe9f3744 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:39.419160 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb0d08-e4bf-41e0-b102-13bfbe9f3744 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:39.421083 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb0d08-e4bf-41e0-b102-13bfbe9f3744 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:39.430915 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:39.447887 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1154/2293] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:27:39 2022] POST /identity/v3/users => generated 298 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:27:39.457688 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5ea25-4f1a-41d3-8545-1a5d22636334 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:39.457977 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5ea25-4f1a-41d3-8545-1a5d22636334 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:39.458241 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5ea25-4f1a-41d3-8545-1a5d22636334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:39.471934 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1140dd0d-c050-4351-b132-cf688e812464 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:39.473317 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1140dd0d-c050-4351-b132-cf688e812464 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:39.479093 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-12f5ea25-4f1a-41d3-8545-1a5d22636334 None None] MFA Rules not processed for user `cdb0e2b312244e9fbfa41fedd8a4f7fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:39.480310 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-12f5ea25-4f1a-41d3-8545-1a5d22636334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:39.483122 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1140/2294] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:27:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:27:39.483963 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1140dd0d-c050-4351-b132-cf688e812464 service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:39.494621 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1140dd0d-c050-4351-b132-cf688e812464 service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:39.499971 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05840c73-d5da-4052-9d0c-dd899f49ccd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:39.500578 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05840c73-d5da-4052-9d0c-dd899f49ccd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:39.500860 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05840c73-d5da-4052-9d0c-dd899f49ccd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:39.501132 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05840c73-d5da-4052-9d0c-dd899f49ccd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:39.501810 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05840c73-d5da-4052-9d0c-dd899f49ccd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:39.503455 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05840c73-d5da-4052-9d0c-dd899f49ccd4 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:39.514670 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1141/2295] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:27:39.515453 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05840c73-d5da-4052-9d0c-dd899f49ccd4 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:39.525241 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05840c73-d5da-4052-9d0c-dd899f49ccd4 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:39.530479 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974acc4-ed55-416f-83c9-2153a4086b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:39.531220 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974acc4-ed55-416f-83c9-2153a4086b11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:39.531505 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974acc4-ed55-416f-83c9-2153a4086b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:39.531773 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974acc4-ed55-416f-83c9-2153a4086b11 admin admin] PATH_INFO: `/v3/users/1af0e718da4f4bf88895822a9425da3a` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:39.532917 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974acc4-ed55-416f-83c9-2153a4086b11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1af0e718da4f4bf88895822a9425da3a)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:39.534885 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974acc4-ed55-416f-83c9-2153a4086b11 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:39.549211 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:39.550287 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1155/2296] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:27:39.554855 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5ea25-4f1a-41d3-8545-1a5d22636334 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:39.571914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5ea25-4f1a-41d3-8545-1a5d22636334 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:39.578523 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7ba14-02b6-44f5-841b-1c9116681f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:39.579208 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7ba14-02b6-44f5-841b-1c9116681f86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:39.579492 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7ba14-02b6-44f5-841b-1c9116681f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:39.579766 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7ba14-02b6-44f5-841b-1c9116681f86 admin admin] PATH_INFO: `/v3/projects/d0ae7059577a4a26807251ace94bd25b/users/ebbdbf2e30e9463e8c0f8fef16321b81/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:39.594630 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6974acc4-ed55-416f-83c9-2153a4086b11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1af0e718da4f4bf88895822a9425da3a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:39.595473 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6974acc4-ed55-416f-83c9-2153a4086b11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1af0e718da4f4bf88895822a9425da3a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:39.597337 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b7ba14-02b6-44f5-841b-1c9116681f86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0ae7059577a4a26807251ace94bd25b, user_id=ebbdbf2e30e9463e8c0f8fef16321b81, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:39.600131 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b7ba14-02b6-44f5-841b-1c9116681f86 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:39.603541 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6974acc4-ed55-416f-83c9-2153a4086b11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1af0e718da4f4bf88895822a9425da3a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:39.618004 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1156/2297] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:27:39 2022] PUT /identity/v3/projects/d0ae7059577a4a26807251ace94bd25b/users/ebbdbf2e30e9463e8c0f8fef16321b81/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:39.618833 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6974acc4-ed55-416f-83c9-2153a4086b11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1af0e718da4f4bf88895822a9425da3a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:39.619635 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6974acc4-ed55-416f-83c9-2153a4086b11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1af0e718da4f4bf88895822a9425da3a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:39.622138 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7ba14-02b6-44f5-841b-1c9116681f86 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:39.624721 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-08b7ba14-02b6-44f5-841b-1c9116681f86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:39.634804 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1142/2298] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:27:39 2022] DELETE /identity/v3/users/1af0e718da4f4bf88895822a9425da3a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:39.639428 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004060b-e169-43ee-8248-5a4b5dd27b9a None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:39.639717 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004060b-e169-43ee-8248-5a4b5dd27b9a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:39.639998 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004060b-e169-43ee-8248-5a4b5dd27b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:39.659881 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-b004060b-e169-43ee-8248-5a4b5dd27b9a None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:39.661101 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b004060b-e169-43ee-8248-5a4b5dd27b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:39.700467 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7ba14-02b6-44f5-841b-1c9116681f86 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:39.731485 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1143/2299] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:27:39.742103 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b004060b-e169-43ee-8248-5a4b5dd27b9a None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:39.743816 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b004060b-e169-43ee-8248-5a4b5dd27b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:39.763349 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c69efff-7c34-4d01-8fb4-0bf221f88105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:39.763962 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69efff-7c34-4d01-8fb4-0bf221f88105 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:39.764239 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69efff-7c34-4d01-8fb4-0bf221f88105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:39.764508 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69efff-7c34-4d01-8fb4-0bf221f88105 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:39.765152 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c69efff-7c34-4d01-8fb4-0bf221f88105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:39.766827 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c69efff-7c34-4d01-8fb4-0bf221f88105 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:39.777253 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1157/2300] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 13:27:39.781522 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c69efff-7c34-4d01-8fb4-0bf221f88105 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:39.794263 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c69efff-7c34-4d01-8fb4-0bf221f88105 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:39.799233 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06075445-2ad0-45fc-92d9-19b569706a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:39.799907 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06075445-2ad0-45fc-92d9-19b569706a80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:39.800190 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06075445-2ad0-45fc-92d9-19b569706a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:39.800459 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06075445-2ad0-45fc-92d9-19b569706a80 admin admin] PATH_INFO: `/v3/projects/d0ae7059577a4a26807251ace94bd25b/users/ebbdbf2e30e9463e8c0f8fef16321b81/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:39.802468 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06075445-2ad0-45fc-92d9-19b569706a80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0ae7059577a4a26807251ace94bd25b, user_id=ebbdbf2e30e9463e8c0f8fef16321b81, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:39.807210 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06075445-2ad0-45fc-92d9-19b569706a80 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:39.816642 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b004060b-e169-43ee-8248-5a4b5dd27b9a None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:39.820699 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1158/2301] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:27:39 2022] PUT /identity/v3/projects/d0ae7059577a4a26807251ace94bd25b/users/ebbdbf2e30e9463e8c0f8fef16321b81/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:27:39.832083 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3afb8-97c6-4ed6-b59a-b9f8bd07b9e8 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:39.832597 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3afb8-97c6-4ed6-b59a-b9f8bd07b9e8 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:39.832976 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3afb8-97c6-4ed6-b59a-b9f8bd07b9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:39.842411 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:39.866995 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:39.869297 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-4fa3afb8-97c6-4ed6-b59a-b9f8bd07b9e8 None None] MFA Rules not processed for user `ebbdbf2e30e9463e8c0f8fef16321b81`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:39.870691 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4fa3afb8-97c6-4ed6-b59a-b9f8bd07b9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:39.872283 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcfd3df-e20f-490b-8080-62312cc3093b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:39.873100 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfd3df-e20f-490b-8080-62312cc3093b service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:39.873984 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfd3df-e20f-490b-8080-62312cc3093b service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:39.874449 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfd3df-e20f-490b-8080-62312cc3093b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:39.945222 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcfd3df-e20f-490b-8080-62312cc3093b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:39.947050 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcfd3df-e20f-490b-8080-62312cc3093b service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:39.950186 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1159/2302] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:39 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:27:39.961659 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1144/2303] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:27:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:27:39.966300 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3afb8-97c6-4ed6-b59a-b9f8bd07b9e8 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:39.967771 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4fa3afb8-97c6-4ed6-b59a-b9f8bd07b9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:40.053572 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3afb8-97c6-4ed6-b59a-b9f8bd07b9e8 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:40.059728 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8cc16-9ea7-42f6-9b39-5db0825565dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:40.059728 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8cc16-9ea7-42f6-9b39-5db0825565dc service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:40.059728 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8cc16-9ea7-42f6-9b39-5db0825565dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:40.059728 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8cc16-9ea7-42f6-9b39-5db0825565dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:40.060080 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-02d8cc16-9ea7-42f6-9b39-5db0825565dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:40.124764 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8cc16-9ea7-42f6-9b39-5db0825565dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:40.126828 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8cc16-9ea7-42f6-9b39-5db0825565dc service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:40.135763 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1160/2304] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:27:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:27:40.304492 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcfd3df-e20f-490b-8080-62312cc3093b service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:40.307001 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7fcfd3df-e20f-490b-8080-62312cc3093b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:40.344698 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcfd3df-e20f-490b-8080-62312cc3093b service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:40.353318 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe8e35-5a19-4493-9db9-662f8a987526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:40.354281 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe8e35-5a19-4493-9db9-662f8a987526 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:40.355229 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe8e35-5a19-4493-9db9-662f8a987526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:40.355471 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe8e35-5a19-4493-9db9-662f8a987526 admin admin] PATH_INFO: `/v3/projects/7f2393ac3ede4be9bf91e6409efe5c2a` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:40.357598 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebe8e35-5a19-4493-9db9-662f8a987526 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f2393ac3ede4be9bf91e6409efe5c2a)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:40.359718 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebe8e35-5a19-4493-9db9-662f8a987526 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:40.422649 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-aebe8e35-5a19-4493-9db9-662f8a987526 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f2393ac3ede4be9bf91e6409efe5c2a', 'request_id': 'req-aebe8e35-5a19-4493-9db9-662f8a987526'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:40.433421 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-aebe8e35-5a19-4493-9db9-662f8a987526 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f2393ac3ede4be9bf91e6409efe5c2a', 'request_id': 'req-aebe8e35-5a19-4493-9db9-662f8a987526'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:40.442345 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-aebe8e35-5a19-4493-9db9-662f8a987526 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f2393ac3ede4be9bf91e6409efe5c2a', 'request_id': 'req-aebe8e35-5a19-4493-9db9-662f8a987526'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:40.454874 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-aebe8e35-5a19-4493-9db9-662f8a987526 admin admin] The token cache is being invalidate because project 7f2393ac3ede4be9bf91e6409efe5c2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:27:40.455298 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-aebe8e35-5a19-4493-9db9-662f8a987526 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:40.455976 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-aebe8e35-5a19-4493-9db9-662f8a987526 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:40.458623 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1145/2305] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:27:40 2022] DELETE /identity/v3/projects/7f2393ac3ede4be9bf91e6409efe5c2a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:40.463850 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81141ec-a132-47da-8da9-4c854d092b81 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:40.464903 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81141ec-a132-47da-8da9-4c854d092b81 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:40.465125 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81141ec-a132-47da-8da9-4c854d092b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:40.489611 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e81141ec-a132-47da-8da9-4c854d092b81 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:40.490865 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e81141ec-a132-47da-8da9-4c854d092b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:40.538142 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:40.576222 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1161/2306] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:40.584390 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa678a1-12a5-4c72-b0d7-802ccf0856d3 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:40.584678 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa678a1-12a5-4c72-b0d7-802ccf0856d3 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:40.584983 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa678a1-12a5-4c72-b0d7-802ccf0856d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:40.618720 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-9fa678a1-12a5-4c72-b0d7-802ccf0856d3 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:40.620142 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-9fa678a1-12a5-4c72-b0d7-802ccf0856d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:40.628531 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1146/2307] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:40.633079 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81141ec-a132-47da-8da9-4c854d092b81 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:40.644772 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81141ec-a132-47da-8da9-4c854d092b81 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:40.649813 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6079f-070e-4e94-a337-0b72500eb736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:40.650475 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6079f-070e-4e94-a337-0b72500eb736 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:40.650884 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6079f-070e-4e94-a337-0b72500eb736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:40.651164 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6079f-070e-4e94-a337-0b72500eb736 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:40.651827 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6079f-070e-4e94-a337-0b72500eb736 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:27:40.652710 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6079f-070e-4e94-a337-0b72500eb736 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:40.655433 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6079f-070e-4e94-a337-0b72500eb736 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:40.670477 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1162/2308] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:27:40.675032 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa678a1-12a5-4c72-b0d7-802ccf0856d3 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:40.685308 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa678a1-12a5-4c72-b0d7-802ccf0856d3 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:40.690349 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c33bd8-9e92-4653-838f-a42ccce71cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:40.690950 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c33bd8-9e92-4653-838f-a42ccce71cdb admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:40.691234 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c33bd8-9e92-4653-838f-a42ccce71cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:40.691516 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c33bd8-9e92-4653-838f-a42ccce71cdb admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:40.692148 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c33bd8-9e92-4653-838f-a42ccce71cdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:40.694128 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c33bd8-9e92-4653-838f-a42ccce71cdb admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:40.723889 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1147/2309] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:27:40 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:27:40.728477 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6079f-070e-4e94-a337-0b72500eb736 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:40.738468 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6079f-070e-4e94-a337-0b72500eb736 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:40.805892 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26499cea-9b22-4f33-a706-2bba1d637947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:40.806791 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26499cea-9b22-4f33-a706-2bba1d637947 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:40.806965 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26499cea-9b22-4f33-a706-2bba1d637947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:40.807358 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26499cea-9b22-4f33-a706-2bba1d637947 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:40.808156 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26499cea-9b22-4f33-a706-2bba1d637947 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:40.810739 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26499cea-9b22-4f33-a706-2bba1d637947 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:40.838069 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1163/2310] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:27:40 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:27:40.842244 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c33bd8-9e92-4653-838f-a42ccce71cdb admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:40.852939 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c33bd8-9e92-4653-838f-a42ccce71cdb admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:40.858781 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f65c23-9198-41c4-9e99-51e7740a8587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:40.859394 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f65c23-9198-41c4-9e99-51e7740a8587 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:40.859669 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f65c23-9198-41c4-9e99-51e7740a8587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:40.859938 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f65c23-9198-41c4-9e99-51e7740a8587 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:40.861080 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f65c23-9198-41c4-9e99-51e7740a8587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:40.862905 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f65c23-9198-41c4-9e99-51e7740a8587 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:40.875171 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1148/2311] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:27:40.879130 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26499cea-9b22-4f33-a706-2bba1d637947 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:40.890443 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26499cea-9b22-4f33-a706-2bba1d637947 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:40.897483 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a710cb-996d-4971-ba86-2f4b886a6e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:40.898057 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a710cb-996d-4971-ba86-2f4b886a6e68 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:40.898338 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a710cb-996d-4971-ba86-2f4b886a6e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:40.898584 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a710cb-996d-4971-ba86-2f4b886a6e68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:40.899433 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a710cb-996d-4971-ba86-2f4b886a6e68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:40.901485 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a710cb-996d-4971-ba86-2f4b886a6e68 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:40.918244 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1164/2312] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:27:40.919643 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f65c23-9198-41c4-9e99-51e7740a8587 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:40.930482 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f65c23-9198-41c4-9e99-51e7740a8587 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:40.935194 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6232d4ec-effa-4a0d-ac98-9a57db31a7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:40.935858 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232d4ec-effa-4a0d-ac98-9a57db31a7ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:40.936454 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232d4ec-effa-4a0d-ac98-9a57db31a7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:40.936726 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232d4ec-effa-4a0d-ac98-9a57db31a7ac admin admin] PATH_INFO: `/v3/projects/a11e6b771b0a424c85acb3343297434f/users/2bdd5350dc824a2a892c4a6662ed90e2/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:40.953553 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6232d4ec-effa-4a0d-ac98-9a57db31a7ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=a11e6b771b0a424c85acb3343297434f, user_id=2bdd5350dc824a2a892c4a6662ed90e2, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:40.956447 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6232d4ec-effa-4a0d-ac98-9a57db31a7ac admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:40.970803 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1149/2313] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:27:40 2022] PUT /identity/v3/projects/a11e6b771b0a424c85acb3343297434f/users/2bdd5350dc824a2a892c4a6662ed90e2/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:27:40.976250 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aae847-d1f4-439d-b987-e96500dcc4a7 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:40.976753 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aae847-d1f4-439d-b987-e96500dcc4a7 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:40.976847 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aae847-d1f4-439d-b987-e96500dcc4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:40.997997 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-27aae847-d1f4-439d-b987-e96500dcc4a7 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:40.999211 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-27aae847-d1f4-439d-b987-e96500dcc4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:41.059403 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1165/2314] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:41.070373 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6232d4ec-effa-4a0d-ac98-9a57db31a7ac admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:41.072758 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6232d4ec-effa-4a0d-ac98-9a57db31a7ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:41.096142 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:41.144783 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6232d4ec-effa-4a0d-ac98-9a57db31a7ac admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:41.156842 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca314885-f9e6-4f5e-88da-11dd1a8b7186 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:41.157469 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca314885-f9e6-4f5e-88da-11dd1a8b7186 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:41.157770 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca314885-f9e6-4f5e-88da-11dd1a8b7186 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:41.158038 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca314885-f9e6-4f5e-88da-11dd1a8b7186 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:41.168220 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca314885-f9e6-4f5e-88da-11dd1a8b7186 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:41.170004 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca314885-f9e6-4f5e-88da-11dd1a8b7186 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:41.179745 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1150/2315] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:27:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:27:41.833088 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd75e5-9e52-4907-88a2-fc4cf54b0378 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:41.833308 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd75e5-9e52-4907-88a2-fc4cf54b0378 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:41.833507 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd75e5-9e52-4907-88a2-fc4cf54b0378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:41.861351 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-99bd75e5-9e52-4907-88a2-fc4cf54b0378 None None] MFA Rules not processed for user `2bdd5350dc824a2a892c4a6662ed90e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:41.862620 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-99bd75e5-9e52-4907-88a2-fc4cf54b0378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:41.908267 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:41.940829 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1166/2316] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:41.951783 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca314885-f9e6-4f5e-88da-11dd1a8b7186 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:41.953369 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ca314885-f9e6-4f5e-88da-11dd1a8b7186 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:42.037979 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca314885-f9e6-4f5e-88da-11dd1a8b7186 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:42.043812 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a290c51-c06d-4e74-94a0-def2bd817740 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:42.044649 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a290c51-c06d-4e74-94a0-def2bd817740 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:42.045103 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a290c51-c06d-4e74-94a0-def2bd817740 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:42.045419 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a290c51-c06d-4e74-94a0-def2bd817740 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:42.054288 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a290c51-c06d-4e74-94a0-def2bd817740 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:42.055733 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a290c51-c06d-4e74-94a0-def2bd817740 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:42.065592 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1151/2317] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:27:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:27:43.476945 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b4626-1399-4974-bbb5-db16988f5f6e None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:43.477687 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b4626-1399-4974-bbb5-db16988f5f6e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:43.477907 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b4626-1399-4974-bbb5-db16988f5f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:43.499950 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-779b4626-1399-4974-bbb5-db16988f5f6e None None] MFA Rules not processed for user `2bdd5350dc824a2a892c4a6662ed90e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:43.501386 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-779b4626-1399-4974-bbb5-db16988f5f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:43.508458 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1167/2318] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:44.140015 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a290c51-c06d-4e74-94a0-def2bd817740 service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:44.141718 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8a290c51-c06d-4e74-94a0-def2bd817740 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:44.212518 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a290c51-c06d-4e74-94a0-def2bd817740 service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:44.218776 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579b0de-b007-4851-b24e-bfb1235b7c2e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbcd6da4e42248a3b38101104fbc03cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:44.219390 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579b0de-b007-4851-b24e-bfb1235b7c2e service placement] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:44.219663 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579b0de-b007-4851-b24e-bfb1235b7c2e service placement] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:44.219930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579b0de-b007-4851-b24e-bfb1235b7c2e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:44.222013 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e579b0de-b007-4851-b24e-bfb1235b7c2e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:44.236706 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e579b0de-b007-4851-b24e-bfb1235b7c2e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:44.238593 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e579b0de-b007-4851-b24e-bfb1235b7c2e service placement] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:44.264574 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1152/2319] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:27:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:27:44.602799 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b4626-1399-4974-bbb5-db16988f5f6e None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:44.604214 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-779b4626-1399-4974-bbb5-db16988f5f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:44.616432 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b4626-1399-4974-bbb5-db16988f5f6e None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:44.620047 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947d9fa-8663-4e6b-875c-5b7ac3e41c57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:44.620666 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947d9fa-8663-4e6b-875c-5b7ac3e41c57 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:44.620948 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947d9fa-8663-4e6b-875c-5b7ac3e41c57 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:44.621325 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947d9fa-8663-4e6b-875c-5b7ac3e41c57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:44.623217 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e947d9fa-8663-4e6b-875c-5b7ac3e41c57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:44.699763 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e947d9fa-8663-4e6b-875c-5b7ac3e41c57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:44.701394 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e947d9fa-8663-4e6b-875c-5b7ac3e41c57 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:44.711164 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1168/2320] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:27:44 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:27:49.866424 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579b0de-b007-4851-b24e-bfb1235b7c2e service placement] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:49.867898 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e579b0de-b007-4851-b24e-bfb1235b7c2e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:49.882135 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579b0de-b007-4851-b24e-bfb1235b7c2e service placement] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:49.888009 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de3356-b3b1-4613-953d-002f13d24071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:49.888982 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de3356-b3b1-4613-953d-002f13d24071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:49.889464 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de3356-b3b1-4613-953d-002f13d24071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:49.889978 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de3356-b3b1-4613-953d-002f13d24071 admin admin] PATH_INFO: `/v3/users/4fb0de9bc62f4c528ae0420e2ad4cb0a` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:49.892574 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0de3356-b3b1-4613-953d-002f13d24071 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fb0de9bc62f4c528ae0420e2ad4cb0a)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:49.895041 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0de3356-b3b1-4613-953d-002f13d24071 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:49.947891 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-b0de3356-b3b1-4613-953d-002f13d24071 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fb0de9bc62f4c528ae0420e2ad4cb0a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:49.948820 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-b0de3356-b3b1-4613-953d-002f13d24071 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fb0de9bc62f4c528ae0420e2ad4cb0a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:49.950328 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:49.959237 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-b0de3356-b3b1-4613-953d-002f13d24071 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fb0de9bc62f4c528ae0420e2ad4cb0a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:49.971657 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-b0de3356-b3b1-4613-953d-002f13d24071 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fb0de9bc62f4c528ae0420e2ad4cb0a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:49.972369 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-b0de3356-b3b1-4613-953d-002f13d24071 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fb0de9bc62f4c528ae0420e2ad4cb0a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:49.987133 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1153/2321] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:27:49 2022] DELETE /identity/v3/users/4fb0de9bc62f4c528ae0420e2ad4cb0a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:49.991797 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d094f0-e463-4924-9d5c-06349d960155 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:49.992356 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d094f0-e463-4924-9d5c-06349d960155 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:49.992356 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d094f0-e463-4924-9d5c-06349d960155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:50.012687 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-05d094f0-e463-4924-9d5c-06349d960155 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:50.013952 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-05d094f0-e463-4924-9d5c-06349d960155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:50.080495 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1169/2322] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:50.090849 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de3356-b3b1-4613-953d-002f13d24071 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:50.092304 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b0de3356-b3b1-4613-953d-002f13d24071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:50.152775 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de3356-b3b1-4613-953d-002f13d24071 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:50.156906 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408d78d-8882-41dc-ae3f-48ee45d13559 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:50.157521 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408d78d-8882-41dc-ae3f-48ee45d13559 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:50.157829 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408d78d-8882-41dc-ae3f-48ee45d13559 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:50.158100 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408d78d-8882-41dc-ae3f-48ee45d13559 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:50.167673 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408d78d-8882-41dc-ae3f-48ee45d13559 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:50.169192 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408d78d-8882-41dc-ae3f-48ee45d13559 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:50.178988 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1154/2323] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:27:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:27:50.459870 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d094f0-e463-4924-9d5c-06349d960155 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:50.461389 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-05d094f0-e463-4924-9d5c-06349d960155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:50.474160 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d094f0-e463-4924-9d5c-06349d960155 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:50.479769 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b61198d-791c-41d3-bef0-7a018c3a0d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:50.480410 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61198d-791c-41d3-bef0-7a018c3a0d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:50.480814 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61198d-791c-41d3-bef0-7a018c3a0d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:50.481124 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61198d-791c-41d3-bef0-7a018c3a0d4c admin admin] PATH_INFO: `/v3/projects/302af42675004d99a5e8474d4ce51412` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:50.482453 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b61198d-791c-41d3-bef0-7a018c3a0d4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=302af42675004d99a5e8474d4ce51412)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:50.484558 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b61198d-791c-41d3-bef0-7a018c3a0d4c admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:50.535417 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6b61198d-791c-41d3-bef0-7a018c3a0d4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '302af42675004d99a5e8474d4ce51412', 'request_id': 'req-6b61198d-791c-41d3-bef0-7a018c3a0d4c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:50.541102 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6b61198d-791c-41d3-bef0-7a018c3a0d4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '302af42675004d99a5e8474d4ce51412', 'request_id': 'req-6b61198d-791c-41d3-bef0-7a018c3a0d4c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:50.543074 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:50.548513 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6b61198d-791c-41d3-bef0-7a018c3a0d4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '302af42675004d99a5e8474d4ce51412', 'request_id': 'req-6b61198d-791c-41d3-bef0-7a018c3a0d4c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:50.564411 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6b61198d-791c-41d3-bef0-7a018c3a0d4c admin admin] The token cache is being invalidate because project 302af42675004d99a5e8474d4ce51412 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:27:50.564762 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6b61198d-791c-41d3-bef0-7a018c3a0d4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:50.565491 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6b61198d-791c-41d3-bef0-7a018c3a0d4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:50.567524 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1170/2324] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:27:50 2022] DELETE /identity/v3/projects/302af42675004d99a5e8474d4ce51412 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:50.571879 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408d78d-8882-41dc-ae3f-48ee45d13559 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:50.584663 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408d78d-8882-41dc-ae3f-48ee45d13559 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:50.647083 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8162d2-d733-40ad-b8a8-8bf14d95532d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:50.647986 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8162d2-d733-40ad-b8a8-8bf14d95532d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:50.648398 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8162d2-d733-40ad-b8a8-8bf14d95532d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:50.648681 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8162d2-d733-40ad-b8a8-8bf14d95532d admin admin] PATH_INFO: `/v3/users/ebbdbf2e30e9463e8c0f8fef16321b81` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:50.649856 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8162d2-d733-40ad-b8a8-8bf14d95532d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebbdbf2e30e9463e8c0f8fef16321b81)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:50.651881 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8162d2-d733-40ad-b8a8-8bf14d95532d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:50.702889 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-fa8162d2-d733-40ad-b8a8-8bf14d95532d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebbdbf2e30e9463e8c0f8fef16321b81'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:50.703571 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-fa8162d2-d733-40ad-b8a8-8bf14d95532d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebbdbf2e30e9463e8c0f8fef16321b81'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:50.711300 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-fa8162d2-d733-40ad-b8a8-8bf14d95532d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebbdbf2e30e9463e8c0f8fef16321b81'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:50.723387 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:50.725971 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-fa8162d2-d733-40ad-b8a8-8bf14d95532d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebbdbf2e30e9463e8c0f8fef16321b81'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:50.726806 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-fa8162d2-d733-40ad-b8a8-8bf14d95532d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebbdbf2e30e9463e8c0f8fef16321b81'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:50.741691 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1155/2325] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:27:50 2022] DELETE /identity/v3/users/ebbdbf2e30e9463e8c0f8fef16321b81 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:51.023967 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b61198d-791c-41d3-bef0-7a018c3a0d4c admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:51.025524 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6b61198d-791c-41d3-bef0-7a018c3a0d4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:51.043810 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b61198d-791c-41d3-bef0-7a018c3a0d4c admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:51.109190 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372fdcc1-0375-43cf-b932-ea1ee68ec49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:51.109863 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fdcc1-0375-43cf-b932-ea1ee68ec49e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:51.110141 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fdcc1-0375-43cf-b932-ea1ee68ec49e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:51.110411 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fdcc1-0375-43cf-b932-ea1ee68ec49e admin admin] PATH_INFO: `/v3/projects/d0ae7059577a4a26807251ace94bd25b` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:51.111550 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372fdcc1-0375-43cf-b932-ea1ee68ec49e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0ae7059577a4a26807251ace94bd25b)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:51.113459 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372fdcc1-0375-43cf-b932-ea1ee68ec49e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:51.165806 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-372fdcc1-0375-43cf-b932-ea1ee68ec49e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0ae7059577a4a26807251ace94bd25b', 'request_id': 'req-372fdcc1-0375-43cf-b932-ea1ee68ec49e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:51.172528 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-372fdcc1-0375-43cf-b932-ea1ee68ec49e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0ae7059577a4a26807251ace94bd25b', 'request_id': 'req-372fdcc1-0375-43cf-b932-ea1ee68ec49e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:51.179464 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-372fdcc1-0375-43cf-b932-ea1ee68ec49e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0ae7059577a4a26807251ace94bd25b', 'request_id': 'req-372fdcc1-0375-43cf-b932-ea1ee68ec49e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:51.194737 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-372fdcc1-0375-43cf-b932-ea1ee68ec49e admin admin] The token cache is being invalidate because project d0ae7059577a4a26807251ace94bd25b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:27:51.195021 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-372fdcc1-0375-43cf-b932-ea1ee68ec49e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:51.195777 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-372fdcc1-0375-43cf-b932-ea1ee68ec49e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:51.203465 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1171/2326] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:27:51 2022] DELETE /identity/v3/projects/d0ae7059577a4a26807251ace94bd25b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:51.203666 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b27756-efcd-47c5-9eea-2cceb2641350 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:51.204107 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b27756-efcd-47c5-9eea-2cceb2641350 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:51.204469 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b27756-efcd-47c5-9eea-2cceb2641350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:51.227923 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-20b27756-efcd-47c5-9eea-2cceb2641350 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:51.229213 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-20b27756-efcd-47c5-9eea-2cceb2641350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:51.293800 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1156/2327] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:51.303303 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497815f1-a14c-401d-81fc-685f840e22cc None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:51.303590 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497815f1-a14c-401d-81fc-685f840e22cc None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:51.303868 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497815f1-a14c-401d-81fc-685f840e22cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:51.325276 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-497815f1-a14c-401d-81fc-685f840e22cc None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:51.326512 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-497815f1-a14c-401d-81fc-685f840e22cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:51.334494 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1172/2328] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:51.338789 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b27756-efcd-47c5-9eea-2cceb2641350 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:51.349507 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b27756-efcd-47c5-9eea-2cceb2641350 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:51.354662 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3bd32-9295-45e6-9a92-985b70cbe2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:51.355268 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3bd32-9295-45e6-9a92-985b70cbe2e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:51.355543 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3bd32-9295-45e6-9a92-985b70cbe2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:51.356141 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3bd32-9295-45e6-9a92-985b70cbe2e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:51.356799 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d3bd32-9295-45e6-9a92-985b70cbe2e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:27:51.357102 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d3bd32-9295-45e6-9a92-985b70cbe2e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:51.358833 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d3bd32-9295-45e6-9a92-985b70cbe2e6 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:51.371180 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1157/2329] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:27:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:27:51.375770 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497815f1-a14c-401d-81fc-685f840e22cc None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:51.385388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497815f1-a14c-401d-81fc-685f840e22cc None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:51.390933 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5cc74-2376-4b8d-a9e0-d8b11a4a89b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:51.391533 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5cc74-2376-4b8d-a9e0-d8b11a4a89b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:51.391808 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5cc74-2376-4b8d-a9e0-d8b11a4a89b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:51.392073 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5cc74-2376-4b8d-a9e0-d8b11a4a89b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:51.392698 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e5cc74-2376-4b8d-a9e0-d8b11a4a89b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:51.394668 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e5cc74-2376-4b8d-a9e0-d8b11a4a89b4 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:51.423288 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1173/2330] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:27:51 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:27:51.427382 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3bd32-9295-45e6-9a92-985b70cbe2e6 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:51.438102 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3bd32-9295-45e6-9a92-985b70cbe2e6 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:51.497749 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5a7d4-6b83-44ef-93d0-288f082c0e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:51.498361 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5a7d4-6b83-44ef-93d0-288f082c0e0f admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:51.498637 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5a7d4-6b83-44ef-93d0-288f082c0e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:51.498907 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5a7d4-6b83-44ef-93d0-288f082c0e0f admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:51.499541 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f5a7d4-6b83-44ef-93d0-288f082c0e0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:51.501477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f5a7d4-6b83-44ef-93d0-288f082c0e0f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:51.525258 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1158/2331] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:27:51 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:27:51.528873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5cc74-2376-4b8d-a9e0-d8b11a4a89b4 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:51.539265 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5cc74-2376-4b8d-a9e0-d8b11a4a89b4 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:51.544518 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2e8c6-6df0-4357-b89a-b54e25657adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:51.545143 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2e8c6-6df0-4357-b89a-b54e25657adc admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:51.545421 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2e8c6-6df0-4357-b89a-b54e25657adc admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:51.545732 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2e8c6-6df0-4357-b89a-b54e25657adc admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:51.546370 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2e8c6-6df0-4357-b89a-b54e25657adc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:51.548054 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2e8c6-6df0-4357-b89a-b54e25657adc admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:51.559627 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1174/2332] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:27:51.565515 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5a7d4-6b83-44ef-93d0-288f082c0e0f admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:51.578954 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5a7d4-6b83-44ef-93d0-288f082c0e0f admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:51.584416 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554fb40-89a8-4e3c-8415-881155a7f01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:51.585024 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554fb40-89a8-4e3c-8415-881155a7f01b admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:51.585303 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554fb40-89a8-4e3c-8415-881155a7f01b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:51.585606 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554fb40-89a8-4e3c-8415-881155a7f01b admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:51.586257 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554fb40-89a8-4e3c-8415-881155a7f01b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:51.587867 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554fb40-89a8-4e3c-8415-881155a7f01b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:51.599216 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1159/2333] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:27:51.603618 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2e8c6-6df0-4357-b89a-b54e25657adc admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:51.613991 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2e8c6-6df0-4357-b89a-b54e25657adc admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:51.618744 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506c19b-3a9c-429c-a165-5dc23f077aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:51.619391 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506c19b-3a9c-429c-a165-5dc23f077aee admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:51.619668 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506c19b-3a9c-429c-a165-5dc23f077aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:51.619935 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506c19b-3a9c-429c-a165-5dc23f077aee admin admin] PATH_INFO: `/v3/projects/2b8aa4bc98ab44658fb2cd6b59115d3d/users/9f2b53ce7d324a418fa8a1ee7187b46b/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:51.635254 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d506c19b-3a9c-429c-a165-5dc23f077aee admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b8aa4bc98ab44658fb2cd6b59115d3d, user_id=9f2b53ce7d324a418fa8a1ee7187b46b, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:51.638026 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d506c19b-3a9c-429c-a165-5dc23f077aee admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:51.652437 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1175/2334] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:27:51 2022] PUT /identity/v3/projects/2b8aa4bc98ab44658fb2cd6b59115d3d/users/9f2b53ce7d324a418fa8a1ee7187b46b/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:51.721317 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b3a69-78b7-47e5-a5c8-c6e161fc892c None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:51.721625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b3a69-78b7-47e5-a5c8-c6e161fc892c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:51.721899 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b3a69-78b7-47e5-a5c8-c6e161fc892c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:51.751095 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-994b3a69-78b7-47e5-a5c8-c6e161fc892c None None] MFA Rules not processed for user `9f2b53ce7d324a418fa8a1ee7187b46b`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:51.752283 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-994b3a69-78b7-47e5-a5c8-c6e161fc892c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:51.795170 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:51.822321 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1160/2335] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:51.827053 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506c19b-3a9c-429c-a165-5dc23f077aee admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:51.845007 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:51.900461 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506c19b-3a9c-429c-a165-5dc23f077aee admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:51.905504 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371be0d-47a8-4d32-8007-7eed710c6a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:51.906143 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371be0d-47a8-4d32-8007-7eed710c6a01 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:51.906419 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371be0d-47a8-4d32-8007-7eed710c6a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:51.906686 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371be0d-47a8-4d32-8007-7eed710c6a01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:51.907312 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371be0d-47a8-4d32-8007-7eed710c6a01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:51.909196 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371be0d-47a8-4d32-8007-7eed710c6a01 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:51.937592 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1176/2336] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:27:51 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:27:51.943323 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b3a69-78b7-47e5-a5c8-c6e161fc892c None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:51.954496 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b3a69-78b7-47e5-a5c8-c6e161fc892c None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:52.019677 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3e387-5ba9-45f9-bd83-2a7e746f041a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:52.020305 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3e387-5ba9-45f9-bd83-2a7e746f041a admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:52.020579 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3e387-5ba9-45f9-bd83-2a7e746f041a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:52.020849 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3e387-5ba9-45f9-bd83-2a7e746f041a admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:52.021497 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f3e387-5ba9-45f9-bd83-2a7e746f041a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:52.023453 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f3e387-5ba9-45f9-bd83-2a7e746f041a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:52.046284 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1161/2337] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:27:51 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:27:52.050532 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371be0d-47a8-4d32-8007-7eed710c6a01 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:52.062265 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371be0d-47a8-4d32-8007-7eed710c6a01 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:52.066933 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04229ed-f9a3-4f2c-a131-d038e0d1010d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:52.067528 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04229ed-f9a3-4f2c-a131-d038e0d1010d admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:52.067802 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04229ed-f9a3-4f2c-a131-d038e0d1010d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:52.068068 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04229ed-f9a3-4f2c-a131-d038e0d1010d admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:52.068700 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04229ed-f9a3-4f2c-a131-d038e0d1010d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:52.070346 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04229ed-f9a3-4f2c-a131-d038e0d1010d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:52.080965 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1177/2338] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:27:52.085471 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3e387-5ba9-45f9-bd83-2a7e746f041a admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:52.096378 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3e387-5ba9-45f9-bd83-2a7e746f041a admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:52.101856 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345da96-99e5-44cd-9a13-e80808be9173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:52.102455 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345da96-99e5-44cd-9a13-e80808be9173 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:52.102733 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345da96-99e5-44cd-9a13-e80808be9173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:52.103002 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345da96-99e5-44cd-9a13-e80808be9173 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:52.103640 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0345da96-99e5-44cd-9a13-e80808be9173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:52.105248 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0345da96-99e5-44cd-9a13-e80808be9173 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:52.115487 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1162/2339] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:27:52.119639 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04229ed-f9a3-4f2c-a131-d038e0d1010d admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:52.129846 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04229ed-f9a3-4f2c-a131-d038e0d1010d admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:52.134834 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba982b-a5c1-4d19-9aa5-85798fad44e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:52.135493 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba982b-a5c1-4d19-9aa5-85798fad44e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:52.135810 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba982b-a5c1-4d19-9aa5-85798fad44e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:52.136081 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba982b-a5c1-4d19-9aa5-85798fad44e5 admin admin] PATH_INFO: `/v3/projects/78bb98288ec2457f890a74499e1fa1ea/users/bd6de2016e44432db96804982fa3fe83/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:52.152344 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba982b-a5c1-4d19-9aa5-85798fad44e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78bb98288ec2457f890a74499e1fa1ea, user_id=bd6de2016e44432db96804982fa3fe83, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:52.155098 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba982b-a5c1-4d19-9aa5-85798fad44e5 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:52.170175 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1178/2340] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:27:52 2022] PUT /identity/v3/projects/78bb98288ec2457f890a74499e1fa1ea/users/bd6de2016e44432db96804982fa3fe83/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:52.182064 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b0149-ee4c-4162-8a01-d4b6fdb1d071 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:52.182435 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b0149-ee4c-4162-8a01-d4b6fdb1d071 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:52.182787 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b0149-ee4c-4162-8a01-d4b6fdb1d071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:52.217160 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-4b0b0149-ee4c-4162-8a01-d4b6fdb1d071 None None] MFA Rules not processed for user `bd6de2016e44432db96804982fa3fe83`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:52.218292 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-4b0b0149-ee4c-4162-8a01-d4b6fdb1d071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:52.285038 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1163/2341] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:52.289692 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba982b-a5c1-4d19-9aa5-85798fad44e5 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:52.352420 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba982b-a5c1-4d19-9aa5-85798fad44e5 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:52.357176 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fa393-dbc0-4c92-b853-0c09e1fab322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:52.357806 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fa393-dbc0-4c92-b853-0c09e1fab322 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:52.358078 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fa393-dbc0-4c92-b853-0c09e1fab322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:52.358344 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fa393-dbc0-4c92-b853-0c09e1fab322 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:52.358983 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3fa393-dbc0-4c92-b853-0c09e1fab322 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:52.360898 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3fa393-dbc0-4c92-b853-0c09e1fab322 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:52.388407 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1179/2342] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:27:52 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:27:52.392648 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b0149-ee4c-4162-8a01-d4b6fdb1d071 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:52.404048 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b0149-ee4c-4162-8a01-d4b6fdb1d071 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:52.451316 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:52.462419 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae4057-0ed1-4755-b448-35f004f4e62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:52.463062 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae4057-0ed1-4755-b448-35f004f4e62f admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:52.463339 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae4057-0ed1-4755-b448-35f004f4e62f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:52.463609 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae4057-0ed1-4755-b448-35f004f4e62f admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:52.464259 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae4057-0ed1-4755-b448-35f004f4e62f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:52.466337 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae4057-0ed1-4755-b448-35f004f4e62f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:52.490106 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1164/2343] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:27:52 2022] POST /identity/v3/users => generated 298 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:27:52.493851 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fa393-dbc0-4c92-b853-0c09e1fab322 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:52.504844 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fa393-dbc0-4c92-b853-0c09e1fab322 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:52.509950 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d6d6c-9e31-4501-a3d2-6ae6e08326a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:52.510551 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d6d6c-9e31-4501-a3d2-6ae6e08326a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:52.510825 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d6d6c-9e31-4501-a3d2-6ae6e08326a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:52.511091 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d6d6c-9e31-4501-a3d2-6ae6e08326a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:52.511729 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d6d6c-9e31-4501-a3d2-6ae6e08326a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:52.513436 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d6d6c-9e31-4501-a3d2-6ae6e08326a5 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:52.526153 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1180/2344] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 13:27:52.531623 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae4057-0ed1-4755-b448-35f004f4e62f admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:52.543119 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae4057-0ed1-4755-b448-35f004f4e62f admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:52.548706 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4de0ac-8999-41b8-ab99-34fe55191542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:52.549376 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4de0ac-8999-41b8-ab99-34fe55191542 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:52.549693 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4de0ac-8999-41b8-ab99-34fe55191542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:52.549958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4de0ac-8999-41b8-ab99-34fe55191542 admin admin] PATH_INFO: `/v3/projects/fd67860e27e34bb28f4111894666cadc/users/650f9f342af74d2a8d26418be9102e4f/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:52.574845 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4de0ac-8999-41b8-ab99-34fe55191542 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd67860e27e34bb28f4111894666cadc, user_id=650f9f342af74d2a8d26418be9102e4f, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:52.578157 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4de0ac-8999-41b8-ab99-34fe55191542 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:52.597102 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1165/2345] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:27:52 2022] PUT /identity/v3/projects/fd67860e27e34bb28f4111894666cadc/users/650f9f342af74d2a8d26418be9102e4f/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:52.598474 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d6d6c-9e31-4501-a3d2-6ae6e08326a5 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:52.609670 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d6d6c-9e31-4501-a3d2-6ae6e08326a5 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:52.651902 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:52.671437 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e0745-8920-43ed-95f4-a71250fc26ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:52.672629 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e0745-8920-43ed-95f4-a71250fc26ae admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:52.672629 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e0745-8920-43ed-95f4-a71250fc26ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:52.672629 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e0745-8920-43ed-95f4-a71250fc26ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:52.673236 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e0745-8920-43ed-95f4-a71250fc26ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:52.674908 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e0745-8920-43ed-95f4-a71250fc26ae admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:52.685476 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1181/2346] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:27:52.689877 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4de0ac-8999-41b8-ab99-34fe55191542 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:52.703805 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4de0ac-8999-41b8-ab99-34fe55191542 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:52.709057 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2255382-b49d-455c-9ec2-0d4189e65285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:52.709756 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2255382-b49d-455c-9ec2-0d4189e65285 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:52.710080 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2255382-b49d-455c-9ec2-0d4189e65285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:52.710353 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2255382-b49d-455c-9ec2-0d4189e65285 admin admin] PATH_INFO: `/v3/projects/fd67860e27e34bb28f4111894666cadc/users/650f9f342af74d2a8d26418be9102e4f/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:52.712523 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2255382-b49d-455c-9ec2-0d4189e65285 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd67860e27e34bb28f4111894666cadc, user_id=650f9f342af74d2a8d26418be9102e4f, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:52.716922 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2255382-b49d-455c-9ec2-0d4189e65285 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:52.729853 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1166/2347] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:27:52 2022] PUT /identity/v3/projects/fd67860e27e34bb28f4111894666cadc/users/650f9f342af74d2a8d26418be9102e4f/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:52.741461 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae3d02-c5c4-4804-85fd-63e65839cd57 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:52.741790 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae3d02-c5c4-4804-85fd-63e65839cd57 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:52.741976 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae3d02-c5c4-4804-85fd-63e65839cd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:52.771146 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-17ae3d02-c5c4-4804-85fd-63e65839cd57 None None] MFA Rules not processed for user `650f9f342af74d2a8d26418be9102e4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:52.772430 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-17ae3d02-c5c4-4804-85fd-63e65839cd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:52.848612 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1182/2348] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:52 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:52.860909 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2255382-b49d-455c-9ec2-0d4189e65285 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:52.862672 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b2255382-b49d-455c-9ec2-0d4189e65285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:52.923467 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2255382-b49d-455c-9ec2-0d4189e65285 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:52.927243 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8dcff1-3139-45b9-b42d-5c08c6235625 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:52.927853 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8dcff1-3139-45b9-b42d-5c08c6235625 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:52.928124 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8dcff1-3139-45b9-b42d-5c08c6235625 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:52.928385 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8dcff1-3139-45b9-b42d-5c08c6235625 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:52.985968 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8dcff1-3139-45b9-b42d-5c08c6235625 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:52.987444 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8dcff1-3139-45b9-b42d-5c08c6235625 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:52.997594 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1167/2349] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:27:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:27:54.531108 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae3d02-c5c4-4804-85fd-63e65839cd57 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:54.541880 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae3d02-c5c4-4804-85fd-63e65839cd57 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:54.545910 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a8447-ec86-4ba5-8a87-d08e4fd41bdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:54.546509 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a8447-ec86-4ba5-8a87-d08e4fd41bdf service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:54.546784 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a8447-ec86-4ba5-8a87-d08e4fd41bdf service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:54.547051 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a8447-ec86-4ba5-8a87-d08e4fd41bdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:54.614504 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7a8447-ec86-4ba5-8a87-d08e4fd41bdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:54.615955 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7a8447-ec86-4ba5-8a87-d08e4fd41bdf service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:54.625564 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1183/2350] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:27:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:27:55.226912 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8dcff1-3139-45b9-b42d-5c08c6235625 service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:55.235883 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8dcff1-3139-45b9-b42d-5c08c6235625 service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:55.239917 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f1a926-aea9-437d-97b5-ca8013c478cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:55.240546 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1a926-aea9-437d-97b5-ca8013c478cd service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:55.240824 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1a926-aea9-437d-97b5-ca8013c478cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:55.241144 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1a926-aea9-437d-97b5-ca8013c478cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:55.251439 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f1a926-aea9-437d-97b5-ca8013c478cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:55.253140 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f1a926-aea9-437d-97b5-ca8013c478cd service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:55.265161 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1168/2351] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:27:55 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:27:56.545284 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97edb8e4-0356-4aa2-a32b-e46683c5d92a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:56.545889 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97edb8e4-0356-4aa2-a32b-e46683c5d92a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:56.545889 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97edb8e4-0356-4aa2-a32b-e46683c5d92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:56.570447 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-97edb8e4-0356-4aa2-a32b-e46683c5d92a None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:56.571957 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-97edb8e4-0356-4aa2-a32b-e46683c5d92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:56.627373 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:56.635963 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1184/2352] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Oct 27 13:27:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:27:56.652334 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f1a926-aea9-437d-97b5-ca8013c478cd service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:56.654223 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-98f1a926-aea9-437d-97b5-ca8013c478cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:56.711246 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:56.740408 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f1a926-aea9-437d-97b5-ca8013c478cd service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:56.747482 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce92f46-0e1f-4c86-9f8d-0eb9ba56ea39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719e4bf834d6490b96066e55a26fb159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:56.748088 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce92f46-0e1f-4c86-9f8d-0eb9ba56ea39 service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:56.748360 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce92f46-0e1f-4c86-9f8d-0eb9ba56ea39 service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:56.748623 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce92f46-0e1f-4c86-9f8d-0eb9ba56ea39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:56.757505 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce92f46-0e1f-4c86-9f8d-0eb9ba56ea39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:56.759150 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce92f46-0e1f-4c86-9f8d-0eb9ba56ea39 service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:56.770248 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1169/2353] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:27:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:27:59.221995 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97edb8e4-0356-4aa2-a32b-e46683c5d92a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:59.231707 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97edb8e4-0356-4aa2-a32b-e46683c5d92a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:59.236250 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a00f7f-5a17-4def-8b16-0d3a57a96211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:59.236866 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a00f7f-5a17-4def-8b16-0d3a57a96211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:59.237139 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a00f7f-5a17-4def-8b16-0d3a57a96211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:59.237408 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a00f7f-5a17-4def-8b16-0d3a57a96211 admin admin] PATH_INFO: `/v3/users/9f2b53ce7d324a418fa8a1ee7187b46b` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:59.238551 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a00f7f-5a17-4def-8b16-0d3a57a96211 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f2b53ce7d324a418fa8a1ee7187b46b)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:59.240442 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a00f7f-5a17-4def-8b16-0d3a57a96211 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:59.291252 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e1a00f7f-5a17-4def-8b16-0d3a57a96211 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f2b53ce7d324a418fa8a1ee7187b46b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:59.291898 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e1a00f7f-5a17-4def-8b16-0d3a57a96211 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f2b53ce7d324a418fa8a1ee7187b46b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:59.299595 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e1a00f7f-5a17-4def-8b16-0d3a57a96211 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f2b53ce7d324a418fa8a1ee7187b46b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:59.312380 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e1a00f7f-5a17-4def-8b16-0d3a57a96211 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f2b53ce7d324a418fa8a1ee7187b46b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:59.313018 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e1a00f7f-5a17-4def-8b16-0d3a57a96211 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f2b53ce7d324a418fa8a1ee7187b46b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:27:59.327484 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1185/2354] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:27:59 2022] DELETE /identity/v3/users/9f2b53ce7d324a418fa8a1ee7187b46b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:27:59.332063 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a025c-0815-4d3c-9284-428f544d37ee None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:59.332554 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a025c-0815-4d3c-9284-428f544d37ee None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:59.332671 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a025c-0815-4d3c-9284-428f544d37ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:59.356636 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-331a025c-0815-4d3c-9284-428f544d37ee None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:27:59.358220 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-331a025c-0815-4d3c-9284-428f544d37ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:59.421098 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1170/2355] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:27:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:27:59.430810 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a00f7f-5a17-4def-8b16-0d3a57a96211 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:59.432427 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e1a00f7f-5a17-4def-8b16-0d3a57a96211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:59.492687 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a00f7f-5a17-4def-8b16-0d3a57a96211 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:27:59.497295 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5ac11-a71d-4749-95cd-e3174b0504ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:27:59.498083 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5ac11-a71d-4749-95cd-e3174b0504ca service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:27:59.498426 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5ac11-a71d-4749-95cd-e3174b0504ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:27:59.498753 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5ac11-a71d-4749-95cd-e3174b0504ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:27:59.509888 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d5ac11-a71d-4749-95cd-e3174b0504ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:27:59.511274 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d5ac11-a71d-4749-95cd-e3174b0504ca service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:27:59.521897 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1186/2356] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:27:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:27:59.979811 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a025c-0815-4d3c-9284-428f544d37ee None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:27:59.981554 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-331a025c-0815-4d3c-9284-428f544d37ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:27:59.999441 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a025c-0815-4d3c-9284-428f544d37ee None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:00.004630 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66282dba-1e52-41b4-bd9a-f0e655a22326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:00.005582 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66282dba-1e52-41b4-bd9a-f0e655a22326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:00.006333 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66282dba-1e52-41b4-bd9a-f0e655a22326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:00.006742 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66282dba-1e52-41b4-bd9a-f0e655a22326 admin admin] PATH_INFO: `/v3/projects/2b8aa4bc98ab44658fb2cd6b59115d3d` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:00.008162 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66282dba-1e52-41b4-bd9a-f0e655a22326 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b8aa4bc98ab44658fb2cd6b59115d3d)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:00.010554 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66282dba-1e52-41b4-bd9a-f0e655a22326 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:00.063615 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-66282dba-1e52-41b4-bd9a-f0e655a22326 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b8aa4bc98ab44658fb2cd6b59115d3d', 'request_id': 'req-66282dba-1e52-41b4-bd9a-f0e655a22326'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:00.073097 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-66282dba-1e52-41b4-bd9a-f0e655a22326 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b8aa4bc98ab44658fb2cd6b59115d3d', 'request_id': 'req-66282dba-1e52-41b4-bd9a-f0e655a22326'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:00.080887 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-66282dba-1e52-41b4-bd9a-f0e655a22326 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b8aa4bc98ab44658fb2cd6b59115d3d', 'request_id': 'req-66282dba-1e52-41b4-bd9a-f0e655a22326'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:00.092206 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-66282dba-1e52-41b4-bd9a-f0e655a22326 admin admin] The token cache is being invalidate because project 2b8aa4bc98ab44658fb2cd6b59115d3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:28:00.092495 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-66282dba-1e52-41b4-bd9a-f0e655a22326 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:00.093169 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-66282dba-1e52-41b4-bd9a-f0e655a22326 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:00.094718 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1171/2357] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:27:59 2022] DELETE /identity/v3/projects/2b8aa4bc98ab44658fb2cd6b59115d3d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:28:00.099177 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5ac11-a71d-4749-95cd-e3174b0504ca service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:00.109739 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5ac11-a71d-4749-95cd-e3174b0504ca service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:00.188884 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e61f35-2f2e-4218-ba45-d185de7f4eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:00.189655 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e61f35-2f2e-4218-ba45-d185de7f4eab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:00.189940 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e61f35-2f2e-4218-ba45-d185de7f4eab admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:00.190232 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e61f35-2f2e-4218-ba45-d185de7f4eab admin admin] PATH_INFO: `/v3/users/bd6de2016e44432db96804982fa3fe83` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:00.191350 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e61f35-2f2e-4218-ba45-d185de7f4eab admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd6de2016e44432db96804982fa3fe83)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:00.193271 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e61f35-2f2e-4218-ba45-d185de7f4eab admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:00.211069 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:28:00.261698 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d3e61f35-2f2e-4218-ba45-d185de7f4eab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd6de2016e44432db96804982fa3fe83'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:00.262726 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d3e61f35-2f2e-4218-ba45-d185de7f4eab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd6de2016e44432db96804982fa3fe83'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:00.274127 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d3e61f35-2f2e-4218-ba45-d185de7f4eab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd6de2016e44432db96804982fa3fe83'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:00.289606 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d3e61f35-2f2e-4218-ba45-d185de7f4eab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd6de2016e44432db96804982fa3fe83'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:00.290357 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d3e61f35-2f2e-4218-ba45-d185de7f4eab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd6de2016e44432db96804982fa3fe83'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:00.306749 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1187/2358] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:28:00 2022] DELETE /identity/v3/users/bd6de2016e44432db96804982fa3fe83 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:28:00.646306 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66282dba-1e52-41b4-bd9a-f0e655a22326 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:00.647843 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-66282dba-1e52-41b4-bd9a-f0e655a22326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:28:00.663047 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66282dba-1e52-41b4-bd9a-f0e655a22326 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:00.683011 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7505c-0799-4a3e-87c1-163595182ad0 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:00.683812 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7505c-0799-4a3e-87c1-163595182ad0 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:00.684269 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7505c-0799-4a3e-87c1-163595182ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:00.706037 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-65e7505c-0799-4a3e-87c1-163595182ad0 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:28:00.707253 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-65e7505c-0799-4a3e-87c1-163595182ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:28:00.718454 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:28:00.729375 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb7673-2ee7-4650-afe7-cd2b06423e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:00.730209 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb7673-2ee7-4650-afe7-cd2b06423e18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:00.730655 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb7673-2ee7-4650-afe7-cd2b06423e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:00.731402 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb7673-2ee7-4650-afe7-cd2b06423e18 admin admin] PATH_INFO: `/v3/projects/78bb98288ec2457f890a74499e1fa1ea` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:00.732602 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeb7673-2ee7-4650-afe7-cd2b06423e18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78bb98288ec2457f890a74499e1fa1ea)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:00.734661 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeb7673-2ee7-4650-afe7-cd2b06423e18 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:00.771898 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1188/2359] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Oct 27 13:28:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:28:00.783420 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-cdeb7673-2ee7-4650-afe7-cd2b06423e18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78bb98288ec2457f890a74499e1fa1ea', 'request_id': 'req-cdeb7673-2ee7-4650-afe7-cd2b06423e18'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:00.787401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7505c-0799-4a3e-87c1-163595182ad0 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:00.789301 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-65e7505c-0799-4a3e-87c1-163595182ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:28:00.792288 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-cdeb7673-2ee7-4650-afe7-cd2b06423e18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78bb98288ec2457f890a74499e1fa1ea', 'request_id': 'req-cdeb7673-2ee7-4650-afe7-cd2b06423e18'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:00.800278 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-cdeb7673-2ee7-4650-afe7-cd2b06423e18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78bb98288ec2457f890a74499e1fa1ea', 'request_id': 'req-cdeb7673-2ee7-4650-afe7-cd2b06423e18'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:00.812501 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-cdeb7673-2ee7-4650-afe7-cd2b06423e18 admin admin] The token cache is being invalidate because project 78bb98288ec2457f890a74499e1fa1ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:28:00.812788 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-cdeb7673-2ee7-4650-afe7-cd2b06423e18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:00.813440 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-cdeb7673-2ee7-4650-afe7-cd2b06423e18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:00.815169 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1172/2360] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:28:00 2022] DELETE /identity/v3/projects/78bb98288ec2457f890a74499e1fa1ea => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:28:00.818869 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb7673-2ee7-4650-afe7-cd2b06423e18 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:00.820165 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-cdeb7673-2ee7-4650-afe7-cd2b06423e18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:28:00.876261 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7505c-0799-4a3e-87c1-163595182ad0 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:00.884235 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb7673-2ee7-4650-afe7-cd2b06423e18 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:00.890305 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21a466-c164-4caf-ac75-7aa45f0a9228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:00.891032 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21a466-c164-4caf-ac75-7aa45f0a9228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:00.891372 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21a466-c164-4caf-ac75-7aa45f0a9228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:00.891814 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21a466-c164-4caf-ac75-7aa45f0a9228 admin admin] PATH_INFO: `/v3/users/650f9f342af74d2a8d26418be9102e4f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:00.893113 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab21a466-c164-4caf-ac75-7aa45f0a9228 admin admin] RBAC: Authorizing `identity:delete_user(user_id=650f9f342af74d2a8d26418be9102e4f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:00.895188 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab21a466-c164-4caf-ac75-7aa45f0a9228 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:00.908726 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:28:00.950472 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8e02db-27af-4202-8fb8-11376860eacc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719e4bf834d6490b96066e55a26fb159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:00.951385 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e02db-27af-4202-8fb8-11376860eacc service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:00.951658 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e02db-27af-4202-8fb8-11376860eacc service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:00.951940 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e02db-27af-4202-8fb8-11376860eacc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:00.952574 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ab21a466-c164-4caf-ac75-7aa45f0a9228 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '650f9f342af74d2a8d26418be9102e4f'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:00.953368 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ab21a466-c164-4caf-ac75-7aa45f0a9228 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '650f9f342af74d2a8d26418be9102e4f'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:00.953873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cc8e02db-27af-4202-8fb8-11376860eacc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:28:00.961823 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ab21a466-c164-4caf-ac75-7aa45f0a9228 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '650f9f342af74d2a8d26418be9102e4f'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:00.966746 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8e02db-27af-4202-8fb8-11376860eacc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:00.968363 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8e02db-27af-4202-8fb8-11376860eacc service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:00.977680 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ab21a466-c164-4caf-ac75-7aa45f0a9228 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '650f9f342af74d2a8d26418be9102e4f'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:00.978273 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ab21a466-c164-4caf-ac75-7aa45f0a9228 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '650f9f342af74d2a8d26418be9102e4f'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:00.979962 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1189/2361] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:28:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:28:00.995552 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1173/2362] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:28:00 2022] DELETE /identity/v3/users/650f9f342af74d2a8d26418be9102e4f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:28:01.285732 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8e02db-27af-4202-8fb8-11376860eacc service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:01.298608 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8e02db-27af-4202-8fb8-11376860eacc service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:01.360714 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d77ab4-8ec5-4697-a436-ee63df12e4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:01.361358 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d77ab4-8ec5-4697-a436-ee63df12e4af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:01.361658 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d77ab4-8ec5-4697-a436-ee63df12e4af admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:01.361973 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d77ab4-8ec5-4697-a436-ee63df12e4af admin admin] PATH_INFO: `/v3/projects/fd67860e27e34bb28f4111894666cadc` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:01.363042 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d77ab4-8ec5-4697-a436-ee63df12e4af admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd67860e27e34bb28f4111894666cadc)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:01.364923 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d77ab4-8ec5-4697-a436-ee63df12e4af admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:01.391602 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec43310-4412-4c94-a836-3fff39c236b0 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:01.391918 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec43310-4412-4c94-a836-3fff39c236b0 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:01.392166 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec43310-4412-4c94-a836-3fff39c236b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:01.400827 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:28:01.415677 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-2ec43310-4412-4c94-a836-3fff39c236b0 None None] MFA Rules not processed for user `2bdd5350dc824a2a892c4a6662ed90e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:28:01.416882 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2ec43310-4412-4c94-a836-3fff39c236b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:28:01.417823 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-76d77ab4-8ec5-4697-a436-ee63df12e4af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd67860e27e34bb28f4111894666cadc', 'request_id': 'req-76d77ab4-8ec5-4697-a436-ee63df12e4af'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:01.424000 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-76d77ab4-8ec5-4697-a436-ee63df12e4af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd67860e27e34bb28f4111894666cadc', 'request_id': 'req-76d77ab4-8ec5-4697-a436-ee63df12e4af'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:01.430591 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-76d77ab4-8ec5-4697-a436-ee63df12e4af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd67860e27e34bb28f4111894666cadc', 'request_id': 'req-76d77ab4-8ec5-4697-a436-ee63df12e4af'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:01.444349 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-76d77ab4-8ec5-4697-a436-ee63df12e4af admin admin] The token cache is being invalidate because project fd67860e27e34bb28f4111894666cadc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:28:01.444619 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-76d77ab4-8ec5-4697-a436-ee63df12e4af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:01.445246 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-76d77ab4-8ec5-4697-a436-ee63df12e4af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:01.446982 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1190/2363] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:28:01 2022] DELETE /identity/v3/projects/fd67860e27e34bb28f4111894666cadc => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:28:01.452109 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4be9c9-33ef-41a4-b3c9-647d5f84528d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:01.452393 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4be9c9-33ef-41a4-b3c9-647d5f84528d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:01.452668 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4be9c9-33ef-41a4-b3c9-647d5f84528d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:01.473317 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-2b4be9c9-33ef-41a4-b3c9-647d5f84528d None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:28:01.474548 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2b4be9c9-33ef-41a4-b3c9-647d5f84528d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:28:01.475702 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1174/2364] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:28:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:28:01.520280 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:28:01.538193 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1191/2365] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:28:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:28:01.546477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5efa64-3e2c-40a1-8d27-ff4f1f2e656e None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:01.546763 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5efa64-3e2c-40a1-8d27-ff4f1f2e656e None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:01.547062 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5efa64-3e2c-40a1-8d27-ff4f1f2e656e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:01.567686 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-7d5efa64-3e2c-40a1-8d27-ff4f1f2e656e None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:28:01.568882 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7d5efa64-3e2c-40a1-8d27-ff4f1f2e656e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:28:01.577984 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1175/2366] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:28:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:28:01.582508 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4be9c9-33ef-41a4-b3c9-647d5f84528d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:01.592469 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4be9c9-33ef-41a4-b3c9-647d5f84528d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:01.597064 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d9056-0bc8-4037-9860-283991a7725a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:01.598731 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d9056-0bc8-4037-9860-283991a7725a admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:01.598731 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d9056-0bc8-4037-9860-283991a7725a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:01.598731 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d9056-0bc8-4037-9860-283991a7725a admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:01.599288 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d9056-0bc8-4037-9860-283991a7725a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:28:01.599596 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d9056-0bc8-4037-9860-283991a7725a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:01.601360 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d9056-0bc8-4037-9860-283991a7725a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:01.614334 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1192/2367] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:28:01.619062 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5efa64-3e2c-40a1-8d27-ff4f1f2e656e None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:01.636212 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5efa64-3e2c-40a1-8d27-ff4f1f2e656e None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:01.641854 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf134675-6211-4885-b648-a76de0fecdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:01.642481 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf134675-6211-4885-b648-a76de0fecdb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:01.642760 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf134675-6211-4885-b648-a76de0fecdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:01.643035 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf134675-6211-4885-b648-a76de0fecdb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:01.643727 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf134675-6211-4885-b648-a76de0fecdb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:01.645667 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf134675-6211-4885-b648-a76de0fecdb6 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:01.679698 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1176/2368] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:28:01 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:28:01.680809 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d9056-0bc8-4037-9860-283991a7725a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:01.691770 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d9056-0bc8-4037-9860-283991a7725a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:01.749742 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204842e-9657-462f-94b8-981a447dcea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:01.750287 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204842e-9657-462f-94b8-981a447dcea0 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:01.750567 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204842e-9657-462f-94b8-981a447dcea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:01.750842 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204842e-9657-462f-94b8-981a447dcea0 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:01.751504 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e204842e-9657-462f-94b8-981a447dcea0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:01.753443 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e204842e-9657-462f-94b8-981a447dcea0 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:01.778003 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1193/2369] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:28:01 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:28:01.782370 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf134675-6211-4885-b648-a76de0fecdb6 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:01.795329 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf134675-6211-4885-b648-a76de0fecdb6 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:01.800623 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95aa062-cc46-43fa-bcaf-41ff8eb94b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:01.801654 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95aa062-cc46-43fa-bcaf-41ff8eb94b66 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:01.802089 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95aa062-cc46-43fa-bcaf-41ff8eb94b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:01.802518 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95aa062-cc46-43fa-bcaf-41ff8eb94b66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:01.803355 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95aa062-cc46-43fa-bcaf-41ff8eb94b66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:01.805224 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95aa062-cc46-43fa-bcaf-41ff8eb94b66 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:01.817428 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1177/2370] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:28:01.821702 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204842e-9657-462f-94b8-981a447dcea0 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:01.832578 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204842e-9657-462f-94b8-981a447dcea0 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:01.837921 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417cdecd-6eb1-454c-adfa-e2afc9529aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:01.838549 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417cdecd-6eb1-454c-adfa-e2afc9529aee admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:01.838827 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417cdecd-6eb1-454c-adfa-e2afc9529aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:01.839097 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417cdecd-6eb1-454c-adfa-e2afc9529aee admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:01.839777 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417cdecd-6eb1-454c-adfa-e2afc9529aee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:01.841568 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417cdecd-6eb1-454c-adfa-e2afc9529aee admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:01.852609 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1194/2371] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:28:01.857030 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95aa062-cc46-43fa-bcaf-41ff8eb94b66 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:01.867096 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95aa062-cc46-43fa-bcaf-41ff8eb94b66 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:01.872192 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78199e16-3699-4e9c-a1d3-9d6690af96cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:01.872904 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78199e16-3699-4e9c-a1d3-9d6690af96cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:01.873185 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78199e16-3699-4e9c-a1d3-9d6690af96cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:01.873455 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78199e16-3699-4e9c-a1d3-9d6690af96cd admin admin] PATH_INFO: `/v3/projects/72e633e959f94b839a3865267e6e684b/users/3f2b905999294b31b3cb981184a22bd1/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:01.890413 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78199e16-3699-4e9c-a1d3-9d6690af96cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=72e633e959f94b839a3865267e6e684b, user_id=3f2b905999294b31b3cb981184a22bd1, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:01.892833 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78199e16-3699-4e9c-a1d3-9d6690af96cd admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:01.907910 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1178/2372] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:28:01 2022] PUT /identity/v3/projects/72e633e959f94b839a3865267e6e684b/users/3f2b905999294b31b3cb981184a22bd1/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:28:01.913320 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df858d7-f404-4aef-945a-79fcc0719233 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:01.913645 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df858d7-f404-4aef-945a-79fcc0719233 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:01.913923 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df858d7-f404-4aef-945a-79fcc0719233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:01.934016 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-5df858d7-f404-4aef-945a-79fcc0719233 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:28:01.935230 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5df858d7-f404-4aef-945a-79fcc0719233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:28:01.996757 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1195/2373] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:28:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:28:02.006581 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78199e16-3699-4e9c-a1d3-9d6690af96cd admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:02.008330 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-78199e16-3699-4e9c-a1d3-9d6690af96cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:28:02.072777 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78199e16-3699-4e9c-a1d3-9d6690af96cd admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:02.080974 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0c3cf-6d97-4921-a897-66e8d129aa8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:02.081799 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0c3cf-6d97-4921-a897-66e8d129aa8d service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:02.082086 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0c3cf-6d97-4921-a897-66e8d129aa8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:02.082359 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0c3cf-6d97-4921-a897-66e8d129aa8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:02.093397 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa0c3cf-6d97-4921-a897-66e8d129aa8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:02.094416 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa0c3cf-6d97-4921-a897-66e8d129aa8d service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:02.105062 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1179/2374] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:28:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:28:03.815859 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f16eb6-1ddf-40bc-a853-b67099f8a2a6 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:03.816384 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f16eb6-1ddf-40bc-a853-b67099f8a2a6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:03.816572 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f16eb6-1ddf-40bc-a853-b67099f8a2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:03.845586 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-c7f16eb6-1ddf-40bc-a853-b67099f8a2a6 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:28:03.851920 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c7f16eb6-1ddf-40bc-a853-b67099f8a2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:28:03.882422 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1196/2375] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Oct 27 13:28:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:28:03.915294 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0c3cf-6d97-4921-a897-66e8d129aa8d service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:03.916970 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-caa0c3cf-6d97-4921-a897-66e8d129aa8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:28:04.028308 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:28:04.058924 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0c3cf-6d97-4921-a897-66e8d129aa8d service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:04.065365 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a2cea7-e196-41f2-96a5-c58114276070 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719e4bf834d6490b96066e55a26fb159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:04.066136 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2cea7-e196-41f2-96a5-c58114276070 service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:04.066591 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2cea7-e196-41f2-96a5-c58114276070 service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:04.066879 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2cea7-e196-41f2-96a5-c58114276070 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:04.076478 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a2cea7-e196-41f2-96a5-c58114276070 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:04.078166 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a2cea7-e196-41f2-96a5-c58114276070 service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:04.091326 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1180/2376] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:28:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:28:07.026330 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e361d-d41e-4351-90e5-4125e1bc3b24 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:07.027194 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e361d-d41e-4351-90e5-4125e1bc3b24 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:07.027537 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e361d-d41e-4351-90e5-4125e1bc3b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:07.051443 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-5c1e361d-d41e-4351-90e5-4125e1bc3b24 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:28:07.052696 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5c1e361d-d41e-4351-90e5-4125e1bc3b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:28:07.062096 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1197/2377] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Oct 27 13:28:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:28:07.076408 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a2cea7-e196-41f2-96a5-c58114276070 service nova] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:07.078733 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-65a2cea7-e196-41f2-96a5-c58114276070 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:28:07.094898 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a2cea7-e196-41f2-96a5-c58114276070 service nova] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:07.108628 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c71b6-2d49-4c1e-99e4-4fc28f2860c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719e4bf834d6490b96066e55a26fb159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:07.109290 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c71b6-2d49-4c1e-99e4-4fc28f2860c1 service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:07.109660 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c71b6-2d49-4c1e-99e4-4fc28f2860c1 service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:07.109989 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c71b6-2d49-4c1e-99e4-4fc28f2860c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:07.115229 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e9b93-06d1-4b58-9390-ad7a69f034c8 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:07.115556 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e9b93-06d1-4b58-9390-ad7a69f034c8 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:07.115914 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e9b93-06d1-4b58-9390-ad7a69f034c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:07.120492 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c71b6-2d49-4c1e-99e4-4fc28f2860c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:07.122540 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c71b6-2d49-4c1e-99e4-4fc28f2860c1 service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:07.135531 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1181/2378] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:28:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:28:07.154598 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-4c0e9b93-06d1-4b58-9390-ad7a69f034c8 None None] MFA Rules not processed for user `3f2b905999294b31b3cb981184a22bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:28:07.155831 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4c0e9b93-06d1-4b58-9390-ad7a69f034c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:28:07.188129 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:28:07.232839 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1198/2379] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:28:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:28:07.237430 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c71b6-2d49-4c1e-99e4-4fc28f2860c1 service nova] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:07.247743 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c71b6-2d49-4c1e-99e4-4fc28f2860c1 service nova] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:07.252342 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ead52a-17ff-4710-870d-de251c326318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:07.252946 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ead52a-17ff-4710-870d-de251c326318 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:07.253227 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ead52a-17ff-4710-870d-de251c326318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:07.253497 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ead52a-17ff-4710-870d-de251c326318 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:07.254176 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ead52a-17ff-4710-870d-de251c326318 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:07.256147 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ead52a-17ff-4710-870d-de251c326318 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:07.284761 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1182/2380] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:28:07 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:28:07.289157 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e9b93-06d1-4b58-9390-ad7a69f034c8 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:07.300858 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e9b93-06d1-4b58-9390-ad7a69f034c8 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:07.358401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19c6eb-5ad9-485c-89cf-53ab67ab71e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:07.358992 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19c6eb-5ad9-485c-89cf-53ab67ab71e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:07.359270 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19c6eb-5ad9-485c-89cf-53ab67ab71e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:07.359541 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19c6eb-5ad9-485c-89cf-53ab67ab71e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:07.360167 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b19c6eb-5ad9-485c-89cf-53ab67ab71e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:07.362121 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b19c6eb-5ad9-485c-89cf-53ab67ab71e4 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:07.385109 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1199/2381] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:28:07 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:28:07.389464 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ead52a-17ff-4710-870d-de251c326318 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:07.399958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ead52a-17ff-4710-870d-de251c326318 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:07.405784 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3730f-7a1e-4462-830f-69ecec9d6469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:07.406387 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3730f-7a1e-4462-830f-69ecec9d6469 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:07.406665 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3730f-7a1e-4462-830f-69ecec9d6469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:07.406933 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3730f-7a1e-4462-830f-69ecec9d6469 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:07.407578 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f3730f-7a1e-4462-830f-69ecec9d6469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:07.409190 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f3730f-7a1e-4462-830f-69ecec9d6469 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:07.423981 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1183/2382] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:28:07.425266 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19c6eb-5ad9-485c-89cf-53ab67ab71e4 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:07.435705 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19c6eb-5ad9-485c-89cf-53ab67ab71e4 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:07.440569 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48e53a-4331-4ef3-b1cd-38543e09888f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:07.441218 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48e53a-4331-4ef3-b1cd-38543e09888f admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:07.441493 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48e53a-4331-4ef3-b1cd-38543e09888f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:07.441796 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48e53a-4331-4ef3-b1cd-38543e09888f admin admin] PATH_INFO: `/v3/projects/db9a625c52ad4085b1327dfc0b312d30/users/469a74351bf149fb8211d95e0c88bc69/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:07.456894 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a48e53a-4331-4ef3-b1cd-38543e09888f admin admin] RBAC: Authorizing `identity:create_grant(project_id=db9a625c52ad4085b1327dfc0b312d30, user_id=469a74351bf149fb8211d95e0c88bc69, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:07.459629 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a48e53a-4331-4ef3-b1cd-38543e09888f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:07.473795 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1200/2383] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:28:07 2022] PUT /identity/v3/projects/db9a625c52ad4085b1327dfc0b312d30/users/469a74351bf149fb8211d95e0c88bc69/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:28:07.477735 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3730f-7a1e-4462-830f-69ecec9d6469 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:07.488327 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3730f-7a1e-4462-830f-69ecec9d6469 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:07.547627 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15141fc6-8c7b-4ecd-bb0a-e938240df9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:07.548240 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15141fc6-8c7b-4ecd-bb0a-e938240df9c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:07.548537 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15141fc6-8c7b-4ecd-bb0a-e938240df9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:07.548793 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15141fc6-8c7b-4ecd-bb0a-e938240df9c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:07.549434 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15141fc6-8c7b-4ecd-bb0a-e938240df9c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:07.551087 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15141fc6-8c7b-4ecd-bb0a-e938240df9c6 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:07.561524 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1184/2384] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:28:07.565761 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48e53a-4331-4ef3-b1cd-38543e09888f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:07.578383 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48e53a-4331-4ef3-b1cd-38543e09888f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:07.583031 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf243374-92d4-445d-8b01-40ca2dd40b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:07.583681 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf243374-92d4-445d-8b01-40ca2dd40b73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:07.583958 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf243374-92d4-445d-8b01-40ca2dd40b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:07.584228 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf243374-92d4-445d-8b01-40ca2dd40b73 admin admin] PATH_INFO: `/v3/projects/db9a625c52ad4085b1327dfc0b312d30/users/469a74351bf149fb8211d95e0c88bc69/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:07.586217 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf243374-92d4-445d-8b01-40ca2dd40b73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db9a625c52ad4085b1327dfc0b312d30, user_id=469a74351bf149fb8211d95e0c88bc69, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:07.588867 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf243374-92d4-445d-8b01-40ca2dd40b73 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:07.600314 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1201/2385] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:28:07 2022] PUT /identity/v3/projects/db9a625c52ad4085b1327dfc0b312d30/users/469a74351bf149fb8211d95e0c88bc69/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:28:11.281999 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeac8ba-e546-4042-918f-5afcf7d7aa11 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:11.282537 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeac8ba-e546-4042-918f-5afcf7d7aa11 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:11.282866 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeac8ba-e546-4042-918f-5afcf7d7aa11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:11.336658 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-2aeac8ba-e546-4042-918f-5afcf7d7aa11 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:28:11.338123 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2aeac8ba-e546-4042-918f-5afcf7d7aa11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:28:11.472029 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1185/2386] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Oct 27 13:28:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:28:11.486998 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf243374-92d4-445d-8b01-40ca2dd40b73 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:11.619310 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf243374-92d4-445d-8b01-40ca2dd40b73 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:11.625597 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ef643-4ef9-410c-adaa-bbbc13ff3209 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719e4bf834d6490b96066e55a26fb159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:11.626531 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ef643-4ef9-410c-adaa-bbbc13ff3209 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:11.626815 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ef643-4ef9-410c-adaa-bbbc13ff3209 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:11.627087 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ef643-4ef9-410c-adaa-bbbc13ff3209 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:11.637116 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ef643-4ef9-410c-adaa-bbbc13ff3209 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:11.638659 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ef643-4ef9-410c-adaa-bbbc13ff3209 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:11.650153 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1202/2387] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:28:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:28:13.063554 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c05a11-b241-4efe-b24b-1d8e269068cf None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:13.064059 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c05a11-b241-4efe-b24b-1d8e269068cf None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:13.064178 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c05a11-b241-4efe-b24b-1d8e269068cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:13.103036 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-a6c05a11-b241-4efe-b24b-1d8e269068cf None None] MFA Rules not processed for user `469a74351bf149fb8211d95e0c88bc69`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:28:13.104512 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a6c05a11-b241-4efe-b24b-1d8e269068cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:28:13.116716 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:28:13.184498 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1186/2388] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:28:13 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:28:13.197857 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ef643-4ef9-410c-adaa-bbbc13ff3209 service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:13.199435 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c57ef643-4ef9-410c-adaa-bbbc13ff3209 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:28:13.212581 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:28:13.285000 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ef643-4ef9-410c-adaa-bbbc13ff3209 service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:13.288526 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16656925-664a-45fb-b09d-17adab25366e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2298dbfcf7b74668902781401f77215e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:13.289125 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16656925-664a-45fb-b09d-17adab25366e service glance] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:13.289399 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16656925-664a-45fb-b09d-17adab25366e service glance] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:13.289709 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16656925-664a-45fb-b09d-17adab25366e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:13.348964 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16656925-664a-45fb-b09d-17adab25366e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:13.350474 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16656925-664a-45fb-b09d-17adab25366e service glance] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:13.359495 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1203/2389] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:28:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:28:13.494925 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c1ab0-b2fd-4ed0-9e3d-5c35df419951 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:13.495216 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c1ab0-b2fd-4ed0-9e3d-5c35df419951 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:13.495489 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c1ab0-b2fd-4ed0-9e3d-5c35df419951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:13.518880 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-111c1ab0-b2fd-4ed0-9e3d-5c35df419951 None None] MFA Rules not processed for user `cffe930429614615adc2e63e165b9c45`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:28:13.520183 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-111c1ab0-b2fd-4ed0-9e3d-5c35df419951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:28:13.590067 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1187/2390] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Oct 27 13:28:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:28:13.636410 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16656925-664a-45fb-b09d-17adab25366e service glance] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:13.637903 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-16656925-664a-45fb-b09d-17adab25366e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:28:13.711620 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16656925-664a-45fb-b09d-17adab25366e service glance] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:13.717369 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42ffc8-470c-48df-8c97-99e7a4b313c2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62769acbfca242d6a0b0fe5a6b8bc108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:13.718029 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42ffc8-470c-48df-8c97-99e7a4b313c2 service swift] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:13.718310 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42ffc8-470c-48df-8c97-99e7a4b313c2 service swift] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:13.718580 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42ffc8-470c-48df-8c97-99e7a4b313c2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:13.727909 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa42ffc8-470c-48df-8c97-99e7a4b313c2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:13.729571 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa42ffc8-470c-48df-8c97-99e7a4b313c2 service swift] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:13.739536 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1204/2391] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Oct 27 13:28:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 13:28:23.583181 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=49 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:28:23.719842 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35debe16-f232-4337-9935-9e24116b53b9 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:23.720476 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35debe16-f232-4337-9935-9e24116b53b9 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:23.720763 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35debe16-f232-4337-9935-9e24116b53b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:23.735233 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=76 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:28:23.742522 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-35debe16-f232-4337-9935-9e24116b53b9 None None] MFA Rules not processed for user `3f2b905999294b31b3cb981184a22bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:28:23.744081 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-35debe16-f232-4337-9935-9e24116b53b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:28:23.751798 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1188/2392] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:28:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:28:25.811364 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918d7b4-baf3-49f0-8b1a-efe01603e20c None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:25.812226 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918d7b4-baf3-49f0-8b1a-efe01603e20c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:25.812226 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918d7b4-baf3-49f0-8b1a-efe01603e20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:25.833138 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-0918d7b4-baf3-49f0-8b1a-efe01603e20c None None] MFA Rules not processed for user `cffe930429614615adc2e63e165b9c45`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:28:25.834394 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0918d7b4-baf3-49f0-8b1a-efe01603e20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:28:25.842331 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1205/2393] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Oct 27 13:28:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:28:25.855670 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35debe16-f232-4337-9935-9e24116b53b9 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:25.868290 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35debe16-f232-4337-9935-9e24116b53b9 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:25.874493 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0affa2-cf19-4407-b99d-bf9a3d602731 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62769acbfca242d6a0b0fe5a6b8bc108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:25.875140 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0affa2-cf19-4407-b99d-bf9a3d602731 service swift] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:25.875530 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0affa2-cf19-4407-b99d-bf9a3d602731 service swift] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:25.875805 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0affa2-cf19-4407-b99d-bf9a3d602731 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:25.884755 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0affa2-cf19-4407-b99d-bf9a3d602731 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:25.886295 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0affa2-cf19-4407-b99d-bf9a3d602731 service swift] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:25.896161 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1189/2394] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Oct 27 13:28:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 13:28:26.101284 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6ab9b-e0f5-4e74-bcae-fe3c1d4b1648 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:26.102219 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6ab9b-e0f5-4e74-bcae-fe3c1d4b1648 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:26.102515 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6ab9b-e0f5-4e74-bcae-fe3c1d4b1648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:26.145563 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-60b6ab9b-e0f5-4e74-bcae-fe3c1d4b1648 None None] MFA Rules not processed for user `cffe930429614615adc2e63e165b9c45`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:28:26.146868 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-60b6ab9b-e0f5-4e74-bcae-fe3c1d4b1648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:28:26.198579 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1206/2395] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Oct 27 13:28:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:28:26.245126 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0affa2-cf19-4407-b99d-bf9a3d602731 service swift] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:26.272128 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0affa2-cf19-4407-b99d-bf9a3d602731 service swift] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:26.289050 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c14c7-81c2-4a64-aa0e-d0010a04db7d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62769acbfca242d6a0b0fe5a6b8bc108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:26.290262 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c14c7-81c2-4a64-aa0e-d0010a04db7d service swift] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:26.290818 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c14c7-81c2-4a64-aa0e-d0010a04db7d service swift] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:26.291375 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c14c7-81c2-4a64-aa0e-d0010a04db7d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:26.312639 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6c14c7-81c2-4a64-aa0e-d0010a04db7d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:26.315913 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6c14c7-81c2-4a64-aa0e-d0010a04db7d service swift] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:26.347919 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1190/2396] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Oct 27 13:28:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 13:28:36.127473 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=6 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:28:36.333376 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=15 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:28:43.331348 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1cb20a-eb7d-4b8e-a0a7-2ecc665c066f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:43.331937 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1cb20a-eb7d-4b8e-a0a7-2ecc665c066f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:43.331937 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1cb20a-eb7d-4b8e-a0a7-2ecc665c066f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:43.351105 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-dc1cb20a-eb7d-4b8e-a0a7-2ecc665c066f None None] MFA Rules not processed for user `cffe930429614615adc2e63e165b9c45`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:28:43.352353 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-dc1cb20a-eb7d-4b8e-a0a7-2ecc665c066f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:28:43.360050 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1207/2397] 10.222.0.52 () {58 vars in 967 bytes} [Thu Oct 27 13:28:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:28:43.373248 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c14c7-81c2-4a64-aa0e-d0010a04db7d service swift] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:43.383882 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c14c7-81c2-4a64-aa0e-d0010a04db7d service swift] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:43.390308 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334164c8-9ebe-4398-aaa4-177d27fa8166 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62769acbfca242d6a0b0fe5a6b8bc108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:43.390961 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334164c8-9ebe-4398-aaa4-177d27fa8166 service swift] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:43.391234 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334164c8-9ebe-4398-aaa4-177d27fa8166 service swift] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:43.391501 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334164c8-9ebe-4398-aaa4-177d27fa8166 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:43.402228 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334164c8-9ebe-4398-aaa4-177d27fa8166 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:43.404848 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334164c8-9ebe-4398-aaa4-177d27fa8166 service swift] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:43.413739 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1191/2398] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Oct 27 13:28:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 13:28:44.136861 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1cb20a-eb7d-4b8e-a0a7-2ecc665c066f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:44.138793 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-dc1cb20a-eb7d-4b8e-a0a7-2ecc665c066f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:28:44.154913 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1cb20a-eb7d-4b8e-a0a7-2ecc665c066f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:44.160354 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28377360-d085-4394-9ace-7a512d5585a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:44.161057 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28377360-d085-4394-9ace-7a512d5585a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:44.161405 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28377360-d085-4394-9ace-7a512d5585a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:44.162779 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28377360-d085-4394-9ace-7a512d5585a3 admin admin] PATH_INFO: `/v3/users/cdb0e2b312244e9fbfa41fedd8a4f7fd` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:44.162974 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28377360-d085-4394-9ace-7a512d5585a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdb0e2b312244e9fbfa41fedd8a4f7fd)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:44.165229 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28377360-d085-4394-9ace-7a512d5585a3 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:44.215705 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-28377360-d085-4394-9ace-7a512d5585a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdb0e2b312244e9fbfa41fedd8a4f7fd'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:44.216475 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-28377360-d085-4394-9ace-7a512d5585a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdb0e2b312244e9fbfa41fedd8a4f7fd'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:44.224079 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-28377360-d085-4394-9ace-7a512d5585a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdb0e2b312244e9fbfa41fedd8a4f7fd'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:44.236962 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-28377360-d085-4394-9ace-7a512d5585a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdb0e2b312244e9fbfa41fedd8a4f7fd'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:44.237723 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-28377360-d085-4394-9ace-7a512d5585a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdb0e2b312244e9fbfa41fedd8a4f7fd'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:44.252352 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1208/2399] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:28:44 2022] DELETE /identity/v3/users/cdb0e2b312244e9fbfa41fedd8a4f7fd => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:28:44.432164 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334164c8-9ebe-4398-aaa4-177d27fa8166 service swift] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:44.443526 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334164c8-9ebe-4398-aaa4-177d27fa8166 service swift] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:44.501461 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f204dc-3a18-412d-af8c-e8f055cd3d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:44.502133 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f204dc-3a18-412d-af8c-e8f055cd3d32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:44.502412 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f204dc-3a18-412d-af8c-e8f055cd3d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:44.502681 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f204dc-3a18-412d-af8c-e8f055cd3d32 admin admin] PATH_INFO: `/v3/projects/50b120a9b98e4fd78f36f33a83a28894` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:44.503793 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f204dc-3a18-412d-af8c-e8f055cd3d32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50b120a9b98e4fd78f36f33a83a28894)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:44.505859 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f204dc-3a18-412d-af8c-e8f055cd3d32 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:44.555445 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f8f204dc-3a18-412d-af8c-e8f055cd3d32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50b120a9b98e4fd78f36f33a83a28894', 'request_id': 'req-f8f204dc-3a18-412d-af8c-e8f055cd3d32'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:44.564247 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f8f204dc-3a18-412d-af8c-e8f055cd3d32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50b120a9b98e4fd78f36f33a83a28894', 'request_id': 'req-f8f204dc-3a18-412d-af8c-e8f055cd3d32'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:44.570958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f8f204dc-3a18-412d-af8c-e8f055cd3d32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50b120a9b98e4fd78f36f33a83a28894', 'request_id': 'req-f8f204dc-3a18-412d-af8c-e8f055cd3d32'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:44.582565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f8f204dc-3a18-412d-af8c-e8f055cd3d32 admin admin] The token cache is being invalidate because project 50b120a9b98e4fd78f36f33a83a28894 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:28:44.582857 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f8f204dc-3a18-412d-af8c-e8f055cd3d32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:44.583610 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f8f204dc-3a18-412d-af8c-e8f055cd3d32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:44.585259 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1192/2400] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:28:44 2022] DELETE /identity/v3/projects/50b120a9b98e4fd78f36f33a83a28894 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:28:45.471434 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28377360-d085-4394-9ace-7a512d5585a3 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:45.472953 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-28377360-d085-4394-9ace-7a512d5585a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:28:45.489164 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28377360-d085-4394-9ace-7a512d5585a3 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:45.549293 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840248a8-eca6-47b7-a9ea-b6bf1456f455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:45.549971 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840248a8-eca6-47b7-a9ea-b6bf1456f455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:45.550243 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840248a8-eca6-47b7-a9ea-b6bf1456f455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:45.550514 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840248a8-eca6-47b7-a9ea-b6bf1456f455 admin admin] PATH_INFO: `/v3/users/2bdd5350dc824a2a892c4a6662ed90e2` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:45.551645 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840248a8-eca6-47b7-a9ea-b6bf1456f455 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bdd5350dc824a2a892c4a6662ed90e2)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:45.553569 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840248a8-eca6-47b7-a9ea-b6bf1456f455 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:45.603627 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-840248a8-eca6-47b7-a9ea-b6bf1456f455 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bdd5350dc824a2a892c4a6662ed90e2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:45.604262 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-840248a8-eca6-47b7-a9ea-b6bf1456f455 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bdd5350dc824a2a892c4a6662ed90e2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:45.611922 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-840248a8-eca6-47b7-a9ea-b6bf1456f455 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bdd5350dc824a2a892c4a6662ed90e2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:45.622466 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:28:45.627370 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-840248a8-eca6-47b7-a9ea-b6bf1456f455 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bdd5350dc824a2a892c4a6662ed90e2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:45.628182 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-840248a8-eca6-47b7-a9ea-b6bf1456f455 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bdd5350dc824a2a892c4a6662ed90e2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:45.642190 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1209/2401] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:28:45 2022] DELETE /identity/v3/users/2bdd5350dc824a2a892c4a6662ed90e2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:28:45.832426 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f204dc-3a18-412d-af8c-e8f055cd3d32 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:45.833903 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f8f204dc-3a18-412d-af8c-e8f055cd3d32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:28:45.846928 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f204dc-3a18-412d-af8c-e8f055cd3d32 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:45.905745 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac2ba2-cf6e-4a52-82fe-bc74b98a98d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:45.906391 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac2ba2-cf6e-4a52-82fe-bc74b98a98d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:45.906664 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac2ba2-cf6e-4a52-82fe-bc74b98a98d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:45.906936 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac2ba2-cf6e-4a52-82fe-bc74b98a98d6 admin admin] PATH_INFO: `/v3/projects/a11e6b771b0a424c85acb3343297434f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:45.908049 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac2ba2-cf6e-4a52-82fe-bc74b98a98d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a11e6b771b0a424c85acb3343297434f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:45.910017 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac2ba2-cf6e-4a52-82fe-bc74b98a98d6 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:45.932031 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:28:45.959607 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-36ac2ba2-cf6e-4a52-82fe-bc74b98a98d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a11e6b771b0a424c85acb3343297434f', 'request_id': 'req-36ac2ba2-cf6e-4a52-82fe-bc74b98a98d6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:45.968495 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-36ac2ba2-cf6e-4a52-82fe-bc74b98a98d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a11e6b771b0a424c85acb3343297434f', 'request_id': 'req-36ac2ba2-cf6e-4a52-82fe-bc74b98a98d6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:45.975136 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-36ac2ba2-cf6e-4a52-82fe-bc74b98a98d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a11e6b771b0a424c85acb3343297434f', 'request_id': 'req-36ac2ba2-cf6e-4a52-82fe-bc74b98a98d6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:45.989392 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-36ac2ba2-cf6e-4a52-82fe-bc74b98a98d6 admin admin] The token cache is being invalidate because project a11e6b771b0a424c85acb3343297434f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:28:45.989702 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-36ac2ba2-cf6e-4a52-82fe-bc74b98a98d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:45.990340 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-36ac2ba2-cf6e-4a52-82fe-bc74b98a98d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:45.991836 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1193/2402] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:28:45 2022] DELETE /identity/v3/projects/a11e6b771b0a424c85acb3343297434f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:28:45.996906 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c762c-376d-4f5a-8843-ff694eb99a7f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:45.997238 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c762c-376d-4f5a-8843-ff694eb99a7f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:45.997517 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c762c-376d-4f5a-8843-ff694eb99a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:46.017715 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-304c762c-376d-4f5a-8843-ff694eb99a7f None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:28:46.018924 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-304c762c-376d-4f5a-8843-ff694eb99a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:28:46.084589 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1210/2403] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:28:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:28:46.092340 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0a957-def3-493c-a305-4d9237a661a1 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:46.092692 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0a957-def3-493c-a305-4d9237a661a1 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:46.093040 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0a957-def3-493c-a305-4d9237a661a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:46.114393 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-3ad0a957-def3-493c-a305-4d9237a661a1 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:28:46.115696 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3ad0a957-def3-493c-a305-4d9237a661a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:28:46.124975 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1194/2404] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:28:46.129416 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c762c-376d-4f5a-8843-ff694eb99a7f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:46.139623 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c762c-376d-4f5a-8843-ff694eb99a7f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:46.144514 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c6942-5061-4b99-babf-e628c3b7d364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:46.145190 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c6942-5061-4b99-babf-e628c3b7d364 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:46.145524 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c6942-5061-4b99-babf-e628c3b7d364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:46.145890 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c6942-5061-4b99-babf-e628c3b7d364 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:46.146611 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c6942-5061-4b99-babf-e628c3b7d364 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:28:46.146987 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c6942-5061-4b99-babf-e628c3b7d364 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:46.148639 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c6942-5061-4b99-babf-e628c3b7d364 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:46.160865 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1211/2405] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:28:46.165362 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0a957-def3-493c-a305-4d9237a661a1 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:46.175361 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0a957-def3-493c-a305-4d9237a661a1 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:46.180544 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92640646-8e45-4058-8469-eaa5ec578924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:46.181147 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92640646-8e45-4058-8469-eaa5ec578924 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:46.181415 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92640646-8e45-4058-8469-eaa5ec578924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:46.181716 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92640646-8e45-4058-8469-eaa5ec578924 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:46.182401 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92640646-8e45-4058-8469-eaa5ec578924 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:46.184439 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92640646-8e45-4058-8469-eaa5ec578924 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:46.214409 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1195/2406] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:28:46 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:28:46.219325 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c6942-5061-4b99-babf-e628c3b7d364 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:46.236877 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c6942-5061-4b99-babf-e628c3b7d364 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:46.304670 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd604d01-86db-469a-aec3-3320e8616978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:46.305274 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd604d01-86db-469a-aec3-3320e8616978 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:46.305582 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd604d01-86db-469a-aec3-3320e8616978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:46.305868 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd604d01-86db-469a-aec3-3320e8616978 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:46.306507 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd604d01-86db-469a-aec3-3320e8616978 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:46.308421 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd604d01-86db-469a-aec3-3320e8616978 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:46.332404 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1212/2407] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:28:46 2022] POST /identity/v3/users => generated 290 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:28:46.336182 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92640646-8e45-4058-8469-eaa5ec578924 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:46.347329 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92640646-8e45-4058-8469-eaa5ec578924 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:46.353206 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9342a0-02ba-4c79-bd4c-d2195e328c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:46.353953 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9342a0-02ba-4c79-bd4c-d2195e328c54 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:46.354254 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9342a0-02ba-4c79-bd4c-d2195e328c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:46.354644 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9342a0-02ba-4c79-bd4c-d2195e328c54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:46.355381 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9342a0-02ba-4c79-bd4c-d2195e328c54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:46.357071 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9342a0-02ba-4c79-bd4c-d2195e328c54 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:46.367681 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1196/2408] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:28:46.371877 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd604d01-86db-469a-aec3-3320e8616978 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:46.382477 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd604d01-86db-469a-aec3-3320e8616978 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:46.388412 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72202a0-d420-40d5-bde8-7305c9b1725f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:46.389008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72202a0-d420-40d5-bde8-7305c9b1725f admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:46.389283 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72202a0-d420-40d5-bde8-7305c9b1725f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:46.389573 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72202a0-d420-40d5-bde8-7305c9b1725f admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:46.390279 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72202a0-d420-40d5-bde8-7305c9b1725f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:46.391910 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72202a0-d420-40d5-bde8-7305c9b1725f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:46.403548 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1213/2409] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:28:46.407798 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9342a0-02ba-4c79-bd4c-d2195e328c54 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:46.418706 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9342a0-02ba-4c79-bd4c-d2195e328c54 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:46.423555 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837414a-f478-46f1-9036-d78138566ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:46.424223 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837414a-f478-46f1-9036-d78138566ef2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:46.424495 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837414a-f478-46f1-9036-d78138566ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:46.424761 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837414a-f478-46f1-9036-d78138566ef2 admin admin] PATH_INFO: `/v3/projects/0ea2907a54e7409da6276a6fb27fdb86/users/aabb95b3c28047559d548d5a5cda9742/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:46.440760 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8837414a-f478-46f1-9036-d78138566ef2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ea2907a54e7409da6276a6fb27fdb86, user_id=aabb95b3c28047559d548d5a5cda9742, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:46.443496 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8837414a-f478-46f1-9036-d78138566ef2 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:46.457772 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1197/2410] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:28:46 2022] PUT /identity/v3/projects/0ea2907a54e7409da6276a6fb27fdb86/users/aabb95b3c28047559d548d5a5cda9742/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:28:46.467954 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d93fd-6e1c-4380-8089-874858eb6755 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:46.468240 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d93fd-6e1c-4380-8089-874858eb6755 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:46.468515 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d93fd-6e1c-4380-8089-874858eb6755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:46.497291 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-0f1d93fd-6e1c-4380-8089-874858eb6755 None None] MFA Rules not processed for user `aabb95b3c28047559d548d5a5cda9742`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:28:46.498533 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0f1d93fd-6e1c-4380-8089-874858eb6755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:28:46.539653 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:28:46.565049 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1214/2411] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:28:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:28:46.576736 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837414a-f478-46f1-9036-d78138566ef2 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:46.578547 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8837414a-f478-46f1-9036-d78138566ef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:28:46.638079 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837414a-f478-46f1-9036-d78138566ef2 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:46.644052 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbce9a-0a7e-4c81-b0a5-c3de0dc31034 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:46.644932 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbce9a-0a7e-4c81-b0a5-c3de0dc31034 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:46.645276 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbce9a-0a7e-4c81-b0a5-c3de0dc31034 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:46.645619 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbce9a-0a7e-4c81-b0a5-c3de0dc31034 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:46.656221 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedbce9a-0a7e-4c81-b0a5-c3de0dc31034 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:46.657761 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedbce9a-0a7e-4c81-b0a5-c3de0dc31034 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:46.667667 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1198/2412] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:28:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:28:49.262620 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d93fd-6e1c-4380-8089-874858eb6755 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:49.326129 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d93fd-6e1c-4380-8089-874858eb6755 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:49.330908 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462a364-6727-4f07-bd76-1885e9363b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:49.331533 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462a364-6727-4f07-bd76-1885e9363b86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:49.331808 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462a364-6727-4f07-bd76-1885e9363b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:49.332083 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462a364-6727-4f07-bd76-1885e9363b86 admin admin] PATH_INFO: `/v3/users/aabb95b3c28047559d548d5a5cda9742` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:49.333217 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e462a364-6727-4f07-bd76-1885e9363b86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aabb95b3c28047559d548d5a5cda9742)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:49.335178 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e462a364-6727-4f07-bd76-1885e9363b86 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:49.388165 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e462a364-6727-4f07-bd76-1885e9363b86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aabb95b3c28047559d548d5a5cda9742'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:49.389039 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e462a364-6727-4f07-bd76-1885e9363b86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aabb95b3c28047559d548d5a5cda9742'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:49.396757 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e462a364-6727-4f07-bd76-1885e9363b86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aabb95b3c28047559d548d5a5cda9742'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:49.410115 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e462a364-6727-4f07-bd76-1885e9363b86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aabb95b3c28047559d548d5a5cda9742'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:49.410926 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e462a364-6727-4f07-bd76-1885e9363b86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aabb95b3c28047559d548d5a5cda9742'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:49.425858 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1215/2413] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:28:49 2022] DELETE /identity/v3/users/aabb95b3c28047559d548d5a5cda9742 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:28:49.430481 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab5758-7dc6-47fb-8726-29a8b9d77e05 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:49.430973 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab5758-7dc6-47fb-8726-29a8b9d77e05 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:49.431071 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab5758-7dc6-47fb-8726-29a8b9d77e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:49.454468 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-3dab5758-7dc6-47fb-8726-29a8b9d77e05 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:28:49.455873 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3dab5758-7dc6-47fb-8726-29a8b9d77e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:28:49.503915 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:28:49.540544 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1199/2414] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:28:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:28:49.550663 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462a364-6727-4f07-bd76-1885e9363b86 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:49.552062 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e462a364-6727-4f07-bd76-1885e9363b86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:28:49.613696 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462a364-6727-4f07-bd76-1885e9363b86 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:49.618027 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd749df-0e50-41c5-ac34-15f0e05a03bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:49.618716 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd749df-0e50-41c5-ac34-15f0e05a03bb service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:49.619062 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd749df-0e50-41c5-ac34-15f0e05a03bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:49.619255 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd749df-0e50-41c5-ac34-15f0e05a03bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:49.633866 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd749df-0e50-41c5-ac34-15f0e05a03bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:49.633866 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd749df-0e50-41c5-ac34-15f0e05a03bb service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:49.641091 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1216/2415] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:28:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:28:49.918882 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab5758-7dc6-47fb-8726-29a8b9d77e05 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:49.921215 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3dab5758-7dc6-47fb-8726-29a8b9d77e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:28:49.939291 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab5758-7dc6-47fb-8726-29a8b9d77e05 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:49.944759 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6f8d8-435f-4866-8001-0785169da7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:49.945616 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6f8d8-435f-4866-8001-0785169da7ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:49.945940 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6f8d8-435f-4866-8001-0785169da7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:49.946220 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6f8d8-435f-4866-8001-0785169da7ae admin admin] PATH_INFO: `/v3/projects/0ea2907a54e7409da6276a6fb27fdb86` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:49.947751 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea6f8d8-435f-4866-8001-0785169da7ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ea2907a54e7409da6276a6fb27fdb86)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:49.949895 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea6f8d8-435f-4866-8001-0785169da7ae admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:50.002836 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-eea6f8d8-435f-4866-8001-0785169da7ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ea2907a54e7409da6276a6fb27fdb86', 'request_id': 'req-eea6f8d8-435f-4866-8001-0785169da7ae'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:50.011563 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-eea6f8d8-435f-4866-8001-0785169da7ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ea2907a54e7409da6276a6fb27fdb86', 'request_id': 'req-eea6f8d8-435f-4866-8001-0785169da7ae'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:50.018389 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-eea6f8d8-435f-4866-8001-0785169da7ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ea2907a54e7409da6276a6fb27fdb86', 'request_id': 'req-eea6f8d8-435f-4866-8001-0785169da7ae'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:50.030159 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-eea6f8d8-435f-4866-8001-0785169da7ae admin admin] The token cache is being invalidate because project 0ea2907a54e7409da6276a6fb27fdb86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:28:50.030446 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-eea6f8d8-435f-4866-8001-0785169da7ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:50.031169 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-eea6f8d8-435f-4866-8001-0785169da7ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:28:50.032877 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1200/2416] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:28:49 2022] DELETE /identity/v3/projects/0ea2907a54e7409da6276a6fb27fdb86 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:28:50.037997 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27396381-22fb-4616-bd50-58233e8b82ec None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:50.038292 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27396381-22fb-4616-bd50-58233e8b82ec None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:50.038568 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27396381-22fb-4616-bd50-58233e8b82ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:50.046617 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:28:50.062337 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-27396381-22fb-4616-bd50-58233e8b82ec None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:28:50.063602 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-27396381-22fb-4616-bd50-58233e8b82ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:28:50.130767 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1217/2417] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:28:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:28:50.197498 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e774d-0bc0-4a6e-a726-8069fb4ca6d2 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:50.197975 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e774d-0bc0-4a6e-a726-8069fb4ca6d2 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:50.198076 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e774d-0bc0-4a6e-a726-8069fb4ca6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:50.222611 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-e12e774d-0bc0-4a6e-a726-8069fb4ca6d2 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:28:50.223829 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e12e774d-0bc0-4a6e-a726-8069fb4ca6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:28:50.233515 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1201/2418] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:28:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:28:50.238186 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27396381-22fb-4616-bd50-58233e8b82ec None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:50.248352 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27396381-22fb-4616-bd50-58233e8b82ec None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:50.254131 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e636ee-5704-4b75-b213-7c61550da706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:50.254663 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e636ee-5704-4b75-b213-7c61550da706 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:50.255048 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e636ee-5704-4b75-b213-7c61550da706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:50.255314 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e636ee-5704-4b75-b213-7c61550da706 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:50.255941 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e636ee-5704-4b75-b213-7c61550da706 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:28:50.256252 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e636ee-5704-4b75-b213-7c61550da706 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:50.257886 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e636ee-5704-4b75-b213-7c61550da706 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:50.270521 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1218/2419] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:28:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:28:50.275139 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e774d-0bc0-4a6e-a726-8069fb4ca6d2 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:50.285682 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e774d-0bc0-4a6e-a726-8069fb4ca6d2 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:50.291874 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c3a342-ecbd-49a3-84cc-e7071c38c243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:50.292484 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3a342-ecbd-49a3-84cc-e7071c38c243 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:50.292756 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3a342-ecbd-49a3-84cc-e7071c38c243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:50.293017 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3a342-ecbd-49a3-84cc-e7071c38c243 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:50.293719 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c3a342-ecbd-49a3-84cc-e7071c38c243 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:50.295643 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c3a342-ecbd-49a3-84cc-e7071c38c243 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:50.327354 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1202/2420] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:28:50 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:28:50.331838 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e636ee-5704-4b75-b213-7c61550da706 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:50.342541 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e636ee-5704-4b75-b213-7c61550da706 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:50.403025 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81229b9c-c464-492d-88f0-83c5b6bc95aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:50.403677 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81229b9c-c464-492d-88f0-83c5b6bc95aa admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:50.403955 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81229b9c-c464-492d-88f0-83c5b6bc95aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:50.404289 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81229b9c-c464-492d-88f0-83c5b6bc95aa admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:50.404958 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81229b9c-c464-492d-88f0-83c5b6bc95aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:50.406951 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81229b9c-c464-492d-88f0-83c5b6bc95aa admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:50.435776 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1219/2421] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:28:50 2022] POST /identity/v3/users => generated 283 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:28:50.441725 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c3a342-ecbd-49a3-84cc-e7071c38c243 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:50.456943 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c3a342-ecbd-49a3-84cc-e7071c38c243 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:50.462826 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbcbfbe-4b8a-4802-b618-e423963ebbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:50.463431 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcbfbe-4b8a-4802-b618-e423963ebbc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:50.463694 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcbfbe-4b8a-4802-b618-e423963ebbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:50.463960 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcbfbe-4b8a-4802-b618-e423963ebbc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:50.464641 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbcbfbe-4b8a-4802-b618-e423963ebbc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:50.466391 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbcbfbe-4b8a-4802-b618-e423963ebbc3 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:50.478326 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1203/2422] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:28:50.482440 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81229b9c-c464-492d-88f0-83c5b6bc95aa admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:50.493500 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81229b9c-c464-492d-88f0-83c5b6bc95aa admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:50.499071 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed91f4-4087-4ece-a63c-baf516ebc2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:50.499688 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed91f4-4087-4ece-a63c-baf516ebc2a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:50.499969 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed91f4-4087-4ece-a63c-baf516ebc2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:50.500244 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed91f4-4087-4ece-a63c-baf516ebc2a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:50.500950 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed91f4-4087-4ece-a63c-baf516ebc2a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:50.502888 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed91f4-4087-4ece-a63c-baf516ebc2a7 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:50.514042 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1220/2423] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:28:50.518584 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbcbfbe-4b8a-4802-b618-e423963ebbc3 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:50.530806 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbcbfbe-4b8a-4802-b618-e423963ebbc3 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:50.536120 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5074ba-93b5-4280-8edd-3d1e83b2541d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:50.536781 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5074ba-93b5-4280-8edd-3d1e83b2541d admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:50.537055 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5074ba-93b5-4280-8edd-3d1e83b2541d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:50.537326 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5074ba-93b5-4280-8edd-3d1e83b2541d admin admin] PATH_INFO: `/v3/projects/065a50e639c64ae58f7b7e0b457b7ca2/users/f5748256ac5443c98470e9a56555f054/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:50.553043 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5074ba-93b5-4280-8edd-3d1e83b2541d admin admin] RBAC: Authorizing `identity:create_grant(project_id=065a50e639c64ae58f7b7e0b457b7ca2, user_id=f5748256ac5443c98470e9a56555f054, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:50.555817 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5074ba-93b5-4280-8edd-3d1e83b2541d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:50.581867 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1204/2424] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:28:50 2022] PUT /identity/v3/projects/065a50e639c64ae58f7b7e0b457b7ca2/users/f5748256ac5443c98470e9a56555f054/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:28:50.592719 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14858af-2e7b-42b9-b2f5-f2eef8e28b87 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:50.593012 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14858af-2e7b-42b9-b2f5-f2eef8e28b87 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:50.593300 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14858af-2e7b-42b9-b2f5-f2eef8e28b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:50.626443 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e14858af-2e7b-42b9-b2f5-f2eef8e28b87 None None] MFA Rules not processed for user `f5748256ac5443c98470e9a56555f054`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:28:50.627770 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e14858af-2e7b-42b9-b2f5-f2eef8e28b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:28:50.702080 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1221/2425] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:28:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:28:50.702614 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:28:50.713912 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5074ba-93b5-4280-8edd-3d1e83b2541d admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:50.715765 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3d5074ba-93b5-4280-8edd-3d1e83b2541d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:28:50.779424 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5074ba-93b5-4280-8edd-3d1e83b2541d admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:50.783309 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16d616-b7ac-43ff-8dc7-bf357afa6666 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:50.783866 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16d616-b7ac-43ff-8dc7-bf357afa6666 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:50.784151 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16d616-b7ac-43ff-8dc7-bf357afa6666 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:50.784428 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16d616-b7ac-43ff-8dc7-bf357afa6666 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:50.796026 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba16d616-b7ac-43ff-8dc7-bf357afa6666 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:50.798179 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba16d616-b7ac-43ff-8dc7-bf357afa6666 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:50.809850 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1205/2426] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:28:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:28:53.549333 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14858af-2e7b-42b9-b2f5-f2eef8e28b87 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:28:53.551022 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e14858af-2e7b-42b9-b2f5-f2eef8e28b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:28:53.614477 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14858af-2e7b-42b9-b2f5-f2eef8e28b87 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:28:53.619035 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301c46a-af7c-480e-8749-631f30e2b0b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:28:53.619725 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301c46a-af7c-480e-8749-631f30e2b0b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:28:53.620072 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301c46a-af7c-480e-8749-631f30e2b0b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:28:53.620346 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301c46a-af7c-480e-8749-631f30e2b0b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:28:53.622287 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8301c46a-af7c-480e-8749-631f30e2b0b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:28:53.691933 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301c46a-af7c-480e-8749-631f30e2b0b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:28:53.693388 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301c46a-af7c-480e-8749-631f30e2b0b6 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:28:53.703267 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1222/2427] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:28:53 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:29:00.805705 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:29:03.698714 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=51 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:29:25.522565 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16d616-b7ac-43ff-8dc7-bf357afa6666 service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:29:25.590268 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16d616-b7ac-43ff-8dc7-bf357afa6666 service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:29:25.595625 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9f946-3c7e-4faf-a869-ab469f0a01f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:29:25.596244 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9f946-3c7e-4faf-a869-ab469f0a01f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:29:25.596519 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9f946-3c7e-4faf-a869-ab469f0a01f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:29:25.596786 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9f946-3c7e-4faf-a869-ab469f0a01f4 admin admin] PATH_INFO: `/v3/users/f5748256ac5443c98470e9a56555f054` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:29:25.598035 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9f946-3c7e-4faf-a869-ab469f0a01f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5748256ac5443c98470e9a56555f054)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:29:25.599961 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9f946-3c7e-4faf-a869-ab469f0a01f4 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:29:25.649656 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-21d9f946-3c7e-4faf-a869-ab469f0a01f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5748256ac5443c98470e9a56555f054'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:29:25.650389 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-21d9f946-3c7e-4faf-a869-ab469f0a01f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5748256ac5443c98470e9a56555f054'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:29:25.657918 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-21d9f946-3c7e-4faf-a869-ab469f0a01f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5748256ac5443c98470e9a56555f054'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:29:25.670583 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-21d9f946-3c7e-4faf-a869-ab469f0a01f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5748256ac5443c98470e9a56555f054'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:29:25.671304 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-21d9f946-3c7e-4faf-a869-ab469f0a01f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5748256ac5443c98470e9a56555f054'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:29:25.687489 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1206/2428] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:29:25 2022] DELETE /identity/v3/users/f5748256ac5443c98470e9a56555f054 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:29:25.691992 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7faba-0ba6-4c10-94f3-2c5011fbc8c3 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:29:25.692415 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7faba-0ba6-4c10-94f3-2c5011fbc8c3 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:29:25.692546 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7faba-0ba6-4c10-94f3-2c5011fbc8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:29:25.715929 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-77e7faba-0ba6-4c10-94f3-2c5011fbc8c3 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:29:25.717117 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-77e7faba-0ba6-4c10-94f3-2c5011fbc8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:29:25.780167 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1223/2429] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:29:25.790219 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9f946-3c7e-4faf-a869-ab469f0a01f4 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:29:25.791682 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-21d9f946-3c7e-4faf-a869-ab469f0a01f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:29:25.851139 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9f946-3c7e-4faf-a869-ab469f0a01f4 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:29:25.855541 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86eb95f-efa1-406e-8d90-d64ee28f36c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:29:25.856137 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86eb95f-efa1-406e-8d90-d64ee28f36c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:29:25.856413 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86eb95f-efa1-406e-8d90-d64ee28f36c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:29:25.856680 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86eb95f-efa1-406e-8d90-d64ee28f36c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:29:25.866786 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86eb95f-efa1-406e-8d90-d64ee28f36c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:29:25.868215 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86eb95f-efa1-406e-8d90-d64ee28f36c8 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:29:25.878144 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1207/2430] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:29:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:29:26.154965 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7faba-0ba6-4c10-94f3-2c5011fbc8c3 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:29:26.156446 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-77e7faba-0ba6-4c10-94f3-2c5011fbc8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:29:26.169128 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7faba-0ba6-4c10-94f3-2c5011fbc8c3 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:29:26.174700 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710caee-65e8-4d8f-8c47-f97cbd5fa89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:29:26.175343 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710caee-65e8-4d8f-8c47-f97cbd5fa89b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:29:26.175618 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710caee-65e8-4d8f-8c47-f97cbd5fa89b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:29:26.175887 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710caee-65e8-4d8f-8c47-f97cbd5fa89b admin admin] PATH_INFO: `/v3/projects/065a50e639c64ae58f7b7e0b457b7ca2` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:29:26.177105 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8710caee-65e8-4d8f-8c47-f97cbd5fa89b admin admin] RBAC: Authorizing `identity:delete_project(project_id=065a50e639c64ae58f7b7e0b457b7ca2)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:29:26.179106 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8710caee-65e8-4d8f-8c47-f97cbd5fa89b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:29:26.230694 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-8710caee-65e8-4d8f-8c47-f97cbd5fa89b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '065a50e639c64ae58f7b7e0b457b7ca2', 'request_id': 'req-8710caee-65e8-4d8f-8c47-f97cbd5fa89b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:29:26.236473 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-8710caee-65e8-4d8f-8c47-f97cbd5fa89b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '065a50e639c64ae58f7b7e0b457b7ca2', 'request_id': 'req-8710caee-65e8-4d8f-8c47-f97cbd5fa89b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:29:26.243670 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-8710caee-65e8-4d8f-8c47-f97cbd5fa89b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '065a50e639c64ae58f7b7e0b457b7ca2', 'request_id': 'req-8710caee-65e8-4d8f-8c47-f97cbd5fa89b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:29:26.258494 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-8710caee-65e8-4d8f-8c47-f97cbd5fa89b admin admin] The token cache is being invalidate because project 065a50e639c64ae58f7b7e0b457b7ca2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:29:26.258778 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-8710caee-65e8-4d8f-8c47-f97cbd5fa89b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:29:26.259385 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-8710caee-65e8-4d8f-8c47-f97cbd5fa89b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:29:26.260952 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1224/2431] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:29:26 2022] DELETE /identity/v3/projects/065a50e639c64ae58f7b7e0b457b7ca2 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:29:35.873999 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:29:36.255588 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:30:05.011236 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86eb95f-efa1-406e-8d90-d64ee28f36c8 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:30:05.012882 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a86eb95f-efa1-406e-8d90-d64ee28f36c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:30:05.076458 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86eb95f-efa1-406e-8d90-d64ee28f36c8 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:30:05.129036 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57630fc-5a2f-436b-bc35-b77bcdea4bd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:30:05.129679 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57630fc-5a2f-436b-bc35-b77bcdea4bd4 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:30:05.129955 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57630fc-5a2f-436b-bc35-b77bcdea4bd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:30:05.130225 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57630fc-5a2f-436b-bc35-b77bcdea4bd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:30:05.132257 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b57630fc-5a2f-436b-bc35-b77bcdea4bd4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:30:05.195190 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57630fc-5a2f-436b-bc35-b77bcdea4bd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:30:05.196624 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57630fc-5a2f-436b-bc35-b77bcdea4bd4 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:30:05.206410 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1208/2432] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:30:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:30:10.809006 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710caee-65e8-4d8f-8c47-f97cbd5fa89b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:30:10.810505 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8710caee-65e8-4d8f-8c47-f97cbd5fa89b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:30:10.812031 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57630fc-5a2f-436b-bc35-b77bcdea4bd4 service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:30:10.813993 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b57630fc-5a2f-436b-bc35-b77bcdea4bd4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:30:10.871959 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710caee-65e8-4d8f-8c47-f97cbd5fa89b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:30:10.875707 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d516f7-f0c0-4db8-96c9-2ece7022c9ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:30:10.876312 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d516f7-f0c0-4db8-96c9-2ece7022c9ce service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:30:10.876588 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d516f7-f0c0-4db8-96c9-2ece7022c9ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:30:10.876858 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d516f7-f0c0-4db8-96c9-2ece7022c9ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:30:10.877106 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57630fc-5a2f-436b-bc35-b77bcdea4bd4 service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:30:10.878766 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-58d516f7-f0c0-4db8-96c9-2ece7022c9ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:30:10.880820 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f57e24-446d-43b7-b050-b9bc98ceda79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:30:10.881426 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f57e24-446d-43b7-b050-b9bc98ceda79 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:30:10.881968 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f57e24-446d-43b7-b050-b9bc98ceda79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:30:10.882195 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f57e24-446d-43b7-b050-b9bc98ceda79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:30:10.884286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f7f57e24-446d-43b7-b050-b9bc98ceda79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:30:10.893879 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f57e24-446d-43b7-b050-b9bc98ceda79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:30:10.895327 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f57e24-446d-43b7-b050-b9bc98ceda79 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:30:10.904173 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1209/2433] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:30:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:30:10.956861 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d516f7-f0c0-4db8-96c9-2ece7022c9ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:30:10.958357 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d516f7-f0c0-4db8-96c9-2ece7022c9ce service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:30:10.969387 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1225/2434] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:30:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:30:12.270942 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f57e24-446d-43b7-b050-b9bc98ceda79 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:30:12.279907 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f57e24-446d-43b7-b050-b9bc98ceda79 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:30:12.283952 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5e6c4-cea1-4acc-b6ff-004adaaa055b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:30:12.284543 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5e6c4-cea1-4acc-b6ff-004adaaa055b service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:30:12.284814 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5e6c4-cea1-4acc-b6ff-004adaaa055b service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:30:12.285079 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5e6c4-cea1-4acc-b6ff-004adaaa055b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:30:12.286952 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-53e5e6c4-cea1-4acc-b6ff-004adaaa055b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:30:12.306350 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e5e6c4-cea1-4acc-b6ff-004adaaa055b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:30:12.308429 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e5e6c4-cea1-4acc-b6ff-004adaaa055b service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:30:12.317597 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:30:12.324711 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1210/2435] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:30:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:30:20.964693 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=54 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:31:18.582987 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d516f7-f0c0-4db8-96c9-2ece7022c9ce service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:18.585731 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-58d516f7-f0c0-4db8-96c9-2ece7022c9ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:18.602885 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d516f7-f0c0-4db8-96c9-2ece7022c9ce service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:18.610632 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55139bb3-09e9-416b-a968-fa6eb2a00cdc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719e4bf834d6490b96066e55a26fb159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:18.611426 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55139bb3-09e9-416b-a968-fa6eb2a00cdc service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:18.611797 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55139bb3-09e9-416b-a968-fa6eb2a00cdc service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:18.612135 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55139bb3-09e9-416b-a968-fa6eb2a00cdc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:18.614387 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-55139bb3-09e9-416b-a968-fa6eb2a00cdc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:18.630614 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55139bb3-09e9-416b-a968-fa6eb2a00cdc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:18.632401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55139bb3-09e9-416b-a968-fa6eb2a00cdc service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:18.644479 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1226/2436] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:31:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:31:26.450793 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b80aa5-25da-4c34-9d23-f0ba9c9fc739 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:26.451253 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b80aa5-25da-4c34-9d23-f0ba9c9fc739 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:26.451347 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b80aa5-25da-4c34-9d23-f0ba9c9fc739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:26.471166 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-81b80aa5-25da-4c34-9d23-f0ba9c9fc739 None None] MFA Rules not processed for user `cffe930429614615adc2e63e165b9c45`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:31:26.472385 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-81b80aa5-25da-4c34-9d23-f0ba9c9fc739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:26.530758 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1211/2437] 10.222.0.52 () {58 vars in 967 bytes} [Thu Oct 27 13:31:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:31:26.582496 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55139bb3-09e9-416b-a968-fa6eb2a00cdc service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:26.584292 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-55139bb3-09e9-416b-a968-fa6eb2a00cdc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:26.667450 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55139bb3-09e9-416b-a968-fa6eb2a00cdc service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:26.673009 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373980d7-007a-45cd-a470-e90f834cfc92 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62769acbfca242d6a0b0fe5a6b8bc108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:26.673644 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373980d7-007a-45cd-a470-e90f834cfc92 service swift] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:26.673926 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373980d7-007a-45cd-a470-e90f834cfc92 service swift] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:26.674200 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373980d7-007a-45cd-a470-e90f834cfc92 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:26.682498 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373980d7-007a-45cd-a470-e90f834cfc92 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:26.684088 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373980d7-007a-45cd-a470-e90f834cfc92 service swift] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:26.692681 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1227/2438] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Oct 27 13:31:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 13:31:30.244096 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b80aa5-25da-4c34-9d23-f0ba9c9fc739 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:30.245477 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-81b80aa5-25da-4c34-9d23-f0ba9c9fc739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:30.327285 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b80aa5-25da-4c34-9d23-f0ba9c9fc739 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:30.332346 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681ab69-bed8-46c4-ac9d-9e718276c9ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbcd6da4e42248a3b38101104fbc03cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:30.333002 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681ab69-bed8-46c4-ac9d-9e718276c9ba service placement] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:30.333277 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681ab69-bed8-46c4-ac9d-9e718276c9ba service placement] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:30.333556 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681ab69-bed8-46c4-ac9d-9e718276c9ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:30.335287 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-9681ab69-bed8-46c4-ac9d-9e718276c9ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:30.347142 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9681ab69-bed8-46c4-ac9d-9e718276c9ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:30.348786 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9681ab69-bed8-46c4-ac9d-9e718276c9ba service placement] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:30.359384 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1212/2439] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:31:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:31:33.655222 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373980d7-007a-45cd-a470-e90f834cfc92 service swift] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:33.656705 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-373980d7-007a-45cd-a470-e90f834cfc92 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:33.726733 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373980d7-007a-45cd-a470-e90f834cfc92 service swift] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:33.731014 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb4f9a-f8ef-46fe-a9ee-3185e601a6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:33.731641 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb4f9a-f8ef-46fe-a9ee-3185e601a6b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:33.731915 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb4f9a-f8ef-46fe-a9ee-3185e601a6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:33.732182 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb4f9a-f8ef-46fe-a9ee-3185e601a6b3 admin admin] PATH_INFO: `/v3/users/3f2b905999294b31b3cb981184a22bd1` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:33.733275 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb4f9a-f8ef-46fe-a9ee-3185e601a6b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f2b905999294b31b3cb981184a22bd1)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:33.742076 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb4f9a-f8ef-46fe-a9ee-3185e601a6b3 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:33.828765 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-24fb4f9a-f8ef-46fe-a9ee-3185e601a6b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f2b905999294b31b3cb981184a22bd1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:33.830256 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-24fb4f9a-f8ef-46fe-a9ee-3185e601a6b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f2b905999294b31b3cb981184a22bd1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:33.838325 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-24fb4f9a-f8ef-46fe-a9ee-3185e601a6b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f2b905999294b31b3cb981184a22bd1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:33.851450 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-24fb4f9a-f8ef-46fe-a9ee-3185e601a6b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f2b905999294b31b3cb981184a22bd1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:33.852336 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-24fb4f9a-f8ef-46fe-a9ee-3185e601a6b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f2b905999294b31b3cb981184a22bd1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:33.857715 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:31:33.873807 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1228/2440] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:31:33 2022] DELETE /identity/v3/users/3f2b905999294b31b3cb981184a22bd1 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:31:34.054834 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681ab69-bed8-46c4-ac9d-9e718276c9ba service placement] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:34.071221 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681ab69-bed8-46c4-ac9d-9e718276c9ba service placement] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:34.136595 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32739f-8dda-4b37-9740-6d055243876d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:34.137271 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32739f-8dda-4b37-9740-6d055243876d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:34.137560 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32739f-8dda-4b37-9740-6d055243876d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:34.138020 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32739f-8dda-4b37-9740-6d055243876d admin admin] PATH_INFO: `/v3/projects/72e633e959f94b839a3865267e6e684b` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:34.139177 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f32739f-8dda-4b37-9740-6d055243876d admin admin] RBAC: Authorizing `identity:delete_project(project_id=72e633e959f94b839a3865267e6e684b)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:34.141158 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f32739f-8dda-4b37-9740-6d055243876d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:34.181255 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:31:34.191643 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0f32739f-8dda-4b37-9740-6d055243876d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72e633e959f94b839a3865267e6e684b', 'request_id': 'req-0f32739f-8dda-4b37-9740-6d055243876d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:34.202329 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0f32739f-8dda-4b37-9740-6d055243876d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72e633e959f94b839a3865267e6e684b', 'request_id': 'req-0f32739f-8dda-4b37-9740-6d055243876d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:34.209994 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0f32739f-8dda-4b37-9740-6d055243876d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72e633e959f94b839a3865267e6e684b', 'request_id': 'req-0f32739f-8dda-4b37-9740-6d055243876d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:34.221075 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0f32739f-8dda-4b37-9740-6d055243876d admin admin] The token cache is being invalidate because project 72e633e959f94b839a3865267e6e684b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:31:34.221335 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0f32739f-8dda-4b37-9740-6d055243876d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:34.222031 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0f32739f-8dda-4b37-9740-6d055243876d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:34.223583 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1213/2441] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:31:34 2022] DELETE /identity/v3/projects/72e633e959f94b839a3865267e6e684b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:31:34.227612 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb4f9a-f8ef-46fe-a9ee-3185e601a6b3 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:34.229066 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-24fb4f9a-f8ef-46fe-a9ee-3185e601a6b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:34.243024 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb4f9a-f8ef-46fe-a9ee-3185e601a6b3 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:34.302444 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c02077-998c-44da-9703-3e663e53944a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:34.303087 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c02077-998c-44da-9703-3e663e53944a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:34.303363 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c02077-998c-44da-9703-3e663e53944a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:34.303634 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c02077-998c-44da-9703-3e663e53944a admin admin] PATH_INFO: `/v3/users/469a74351bf149fb8211d95e0c88bc69` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:34.304806 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c02077-998c-44da-9703-3e663e53944a admin admin] RBAC: Authorizing `identity:delete_user(user_id=469a74351bf149fb8211d95e0c88bc69)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:34.306790 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c02077-998c-44da-9703-3e663e53944a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:34.356518 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f9c02077-998c-44da-9703-3e663e53944a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '469a74351bf149fb8211d95e0c88bc69'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:34.357630 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f9c02077-998c-44da-9703-3e663e53944a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '469a74351bf149fb8211d95e0c88bc69'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:34.365234 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f9c02077-998c-44da-9703-3e663e53944a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '469a74351bf149fb8211d95e0c88bc69'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:34.378875 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f9c02077-998c-44da-9703-3e663e53944a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '469a74351bf149fb8211d95e0c88bc69'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:34.379657 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f9c02077-998c-44da-9703-3e663e53944a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '469a74351bf149fb8211d95e0c88bc69'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:34.398088 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1229/2442] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:31:34 2022] DELETE /identity/v3/users/469a74351bf149fb8211d95e0c88bc69 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:31:34.579616 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32739f-8dda-4b37-9740-6d055243876d admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:34.581156 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0f32739f-8dda-4b37-9740-6d055243876d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:34.594618 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32739f-8dda-4b37-9740-6d055243876d admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:34.654353 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47157bec-d115-4033-af23-1bc92c474907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:34.654984 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47157bec-d115-4033-af23-1bc92c474907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:34.655259 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47157bec-d115-4033-af23-1bc92c474907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:34.655581 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47157bec-d115-4033-af23-1bc92c474907 admin admin] PATH_INFO: `/v3/projects/db9a625c52ad4085b1327dfc0b312d30` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:34.656668 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47157bec-d115-4033-af23-1bc92c474907 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db9a625c52ad4085b1327dfc0b312d30)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:34.658614 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47157bec-d115-4033-af23-1bc92c474907 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:34.706375 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-47157bec-d115-4033-af23-1bc92c474907 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db9a625c52ad4085b1327dfc0b312d30', 'request_id': 'req-47157bec-d115-4033-af23-1bc92c474907'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:34.715357 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-47157bec-d115-4033-af23-1bc92c474907 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db9a625c52ad4085b1327dfc0b312d30', 'request_id': 'req-47157bec-d115-4033-af23-1bc92c474907'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:34.722345 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-47157bec-d115-4033-af23-1bc92c474907 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db9a625c52ad4085b1327dfc0b312d30', 'request_id': 'req-47157bec-d115-4033-af23-1bc92c474907'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:34.733311 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-47157bec-d115-4033-af23-1bc92c474907 admin admin] The token cache is being invalidate because project db9a625c52ad4085b1327dfc0b312d30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:31:34.733623 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-47157bec-d115-4033-af23-1bc92c474907 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:34.734276 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-47157bec-d115-4033-af23-1bc92c474907 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:34.735803 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1214/2443] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:31:34 2022] DELETE /identity/v3/projects/db9a625c52ad4085b1327dfc0b312d30 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:31:34.926313 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c02077-998c-44da-9703-3e663e53944a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:34.927871 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f9c02077-998c-44da-9703-3e663e53944a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:34.994705 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c02077-998c-44da-9703-3e663e53944a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:35.025841 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:31:35.047201 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e48487-6a72-4f01-b124-4f2bee8691d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:35.047825 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e48487-6a72-4f01-b124-4f2bee8691d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:35.048099 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e48487-6a72-4f01-b124-4f2bee8691d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:35.048364 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e48487-6a72-4f01-b124-4f2bee8691d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:35.050212 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c9e48487-6a72-4f01-b124-4f2bee8691d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:35.116216 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e48487-6a72-4f01-b124-4f2bee8691d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:35.117583 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e48487-6a72-4f01-b124-4f2bee8691d4 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:35.127356 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1230/2444] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:31:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:31:38.055356 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47157bec-d115-4033-af23-1bc92c474907 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:38.056872 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-47157bec-d115-4033-af23-1bc92c474907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:38.120346 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e48487-6a72-4f01-b124-4f2bee8691d4 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:38.123154 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c9e48487-6a72-4f01-b124-4f2bee8691d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:38.127737 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:31:38.137438 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e48487-6a72-4f01-b124-4f2bee8691d4 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:38.143586 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4820159-b71d-4bb8-b5b5-87ae978640ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:38.144568 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4820159-b71d-4bb8-b5b5-87ae978640ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:38.144838 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4820159-b71d-4bb8-b5b5-87ae978640ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:38.145308 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4820159-b71d-4bb8-b5b5-87ae978640ca admin admin] PATH_INFO: `/v3/users/041ffe6cdf2d42008f41858ebe015be8` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:38.146577 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4820159-b71d-4bb8-b5b5-87ae978640ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=041ffe6cdf2d42008f41858ebe015be8)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:38.147519 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47157bec-d115-4033-af23-1bc92c474907 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:38.148524 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4820159-b71d-4bb8-b5b5-87ae978640ca admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:38.153007 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2342129-7529-472f-aca9-1a4ae228a358 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbcd6da4e42248a3b38101104fbc03cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:38.153638 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2342129-7529-472f-aca9-1a4ae228a358 service placement] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:38.153934 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2342129-7529-472f-aca9-1a4ae228a358 service placement] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:38.154205 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2342129-7529-472f-aca9-1a4ae228a358 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:38.156034 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e2342129-7529-472f-aca9-1a4ae228a358 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:38.168693 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2342129-7529-472f-aca9-1a4ae228a358 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:38.170447 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2342129-7529-472f-aca9-1a4ae228a358 service placement] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:38.181284 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1215/2445] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:31:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:31:38.201699 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e4820159-b71d-4bb8-b5b5-87ae978640ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '041ffe6cdf2d42008f41858ebe015be8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:38.202160 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e4820159-b71d-4bb8-b5b5-87ae978640ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '041ffe6cdf2d42008f41858ebe015be8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:38.209457 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e4820159-b71d-4bb8-b5b5-87ae978640ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '041ffe6cdf2d42008f41858ebe015be8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:38.221665 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e4820159-b71d-4bb8-b5b5-87ae978640ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '041ffe6cdf2d42008f41858ebe015be8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:38.222353 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e4820159-b71d-4bb8-b5b5-87ae978640ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '041ffe6cdf2d42008f41858ebe015be8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:38.236628 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1231/2446] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:31:38 2022] DELETE /identity/v3/users/041ffe6cdf2d42008f41858ebe015be8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:31:38.430824 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2342129-7529-472f-aca9-1a4ae228a358 service placement] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:38.442339 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2342129-7529-472f-aca9-1a4ae228a358 service placement] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:38.503391 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f86c1a-a5da-4df9-ada9-448261618c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:38.504036 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f86c1a-a5da-4df9-ada9-448261618c00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:38.504399 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f86c1a-a5da-4df9-ada9-448261618c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:38.504725 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f86c1a-a5da-4df9-ada9-448261618c00 admin admin] PATH_INFO: `/v3/projects/d5e1d3a8ff354698b4bd5f81a4a04395` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:38.505975 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f86c1a-a5da-4df9-ada9-448261618c00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5e1d3a8ff354698b4bd5f81a4a04395)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:38.507885 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f86c1a-a5da-4df9-ada9-448261618c00 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:38.558515 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-37f86c1a-a5da-4df9-ada9-448261618c00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5e1d3a8ff354698b4bd5f81a4a04395', 'request_id': 'req-37f86c1a-a5da-4df9-ada9-448261618c00'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:38.568590 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-37f86c1a-a5da-4df9-ada9-448261618c00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5e1d3a8ff354698b4bd5f81a4a04395', 'request_id': 'req-37f86c1a-a5da-4df9-ada9-448261618c00'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:38.575909 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-37f86c1a-a5da-4df9-ada9-448261618c00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5e1d3a8ff354698b4bd5f81a4a04395', 'request_id': 'req-37f86c1a-a5da-4df9-ada9-448261618c00'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:38.587058 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-37f86c1a-a5da-4df9-ada9-448261618c00 admin admin] The token cache is being invalidate because project d5e1d3a8ff354698b4bd5f81a4a04395 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:31:38.587348 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-37f86c1a-a5da-4df9-ada9-448261618c00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:38.588020 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-37f86c1a-a5da-4df9-ada9-448261618c00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:38.590106 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1216/2447] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:31:38 2022] DELETE /identity/v3/projects/d5e1d3a8ff354698b4bd5f81a4a04395 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:31:38.600683 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e00b0-fa19-4afb-bde4-46bb7bf2bee6 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:38.600940 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e00b0-fa19-4afb-bde4-46bb7bf2bee6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:38.601234 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e00b0-fa19-4afb-bde4-46bb7bf2bee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:38.621884 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-3c2e00b0-fa19-4afb-bde4-46bb7bf2bee6 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:31:38.623086 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3c2e00b0-fa19-4afb-bde4-46bb7bf2bee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:38.672695 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:31:38.686690 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1232/2448] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:31:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:31:38.695782 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8757d-2162-4a63-aa02-8d1282f65046 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:38.696064 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8757d-2162-4a63-aa02-8d1282f65046 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:38.696337 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8757d-2162-4a63-aa02-8d1282f65046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:38.716105 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-73a8757d-2162-4a63-aa02-8d1282f65046 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:31:38.717325 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-73a8757d-2162-4a63-aa02-8d1282f65046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:38.725922 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1217/2449] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:31:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:31:38.730363 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e00b0-fa19-4afb-bde4-46bb7bf2bee6 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:38.740488 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e00b0-fa19-4afb-bde4-46bb7bf2bee6 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:38.746491 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24c3ee-f926-4065-8a67-fc013d8e9384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:38.747090 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24c3ee-f926-4065-8a67-fc013d8e9384 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:38.747369 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24c3ee-f926-4065-8a67-fc013d8e9384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:38.747632 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24c3ee-f926-4065-8a67-fc013d8e9384 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:38.748262 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be24c3ee-f926-4065-8a67-fc013d8e9384 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:31:38.748562 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be24c3ee-f926-4065-8a67-fc013d8e9384 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:38.750190 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be24c3ee-f926-4065-8a67-fc013d8e9384 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:38.762475 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1233/2450] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:31:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:31:38.766888 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8757d-2162-4a63-aa02-8d1282f65046 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:38.777038 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8757d-2162-4a63-aa02-8d1282f65046 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:38.782841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06efb45-04f3-41fd-a44f-5a194463388b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:38.783472 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06efb45-04f3-41fd-a44f-5a194463388b admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:38.783750 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06efb45-04f3-41fd-a44f-5a194463388b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:38.784022 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06efb45-04f3-41fd-a44f-5a194463388b admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:38.784652 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06efb45-04f3-41fd-a44f-5a194463388b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:38.786858 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06efb45-04f3-41fd-a44f-5a194463388b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:38.817583 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1218/2451] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:31:38 2022] POST /identity/v3/projects => generated 403 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:31:38.822012 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24c3ee-f926-4065-8a67-fc013d8e9384 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:38.832976 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24c3ee-f926-4065-8a67-fc013d8e9384 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:38.893317 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357f703-d15a-4e7e-929f-c9b3202ca687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:38.893939 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357f703-d15a-4e7e-929f-c9b3202ca687 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:38.894211 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357f703-d15a-4e7e-929f-c9b3202ca687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:38.894475 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357f703-d15a-4e7e-929f-c9b3202ca687 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:38.895209 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f357f703-d15a-4e7e-929f-c9b3202ca687 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:38.897306 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f357f703-d15a-4e7e-929f-c9b3202ca687 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:38.919564 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1234/2452] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:31:38 2022] POST /identity/v3/users => generated 302 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:31:38.923670 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06efb45-04f3-41fd-a44f-5a194463388b admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:38.934865 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06efb45-04f3-41fd-a44f-5a194463388b admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:38.940833 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004f1d4-a2ee-4edd-a6f8-73d517ee79ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:38.941432 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004f1d4-a2ee-4edd-a6f8-73d517ee79ed admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:38.941746 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004f1d4-a2ee-4edd-a6f8-73d517ee79ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:38.942166 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004f1d4-a2ee-4edd-a6f8-73d517ee79ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:38.942974 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004f1d4-a2ee-4edd-a6f8-73d517ee79ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:38.944604 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004f1d4-a2ee-4edd-a6f8-73d517ee79ed admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:38.955331 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1219/2453] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:31:38.959626 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357f703-d15a-4e7e-929f-c9b3202ca687 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:38.969709 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357f703-d15a-4e7e-929f-c9b3202ca687 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:38.974445 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b44ac-5401-46a0-8dca-6be6555236ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:38.975029 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b44ac-5401-46a0-8dca-6be6555236ec admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:38.975305 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b44ac-5401-46a0-8dca-6be6555236ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:38.975570 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b44ac-5401-46a0-8dca-6be6555236ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:38.976199 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b44ac-5401-46a0-8dca-6be6555236ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:38.977810 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b44ac-5401-46a0-8dca-6be6555236ec admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:38.988408 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1235/2454] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:31:38.992816 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004f1d4-a2ee-4edd-a6f8-73d517ee79ed admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:39.002887 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004f1d4-a2ee-4edd-a6f8-73d517ee79ed admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:39.007705 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e06a4c-130f-4f26-abfb-4fbadfeacb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:39.008354 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e06a4c-130f-4f26-abfb-4fbadfeacb13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:39.008830 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e06a4c-130f-4f26-abfb-4fbadfeacb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:39.009036 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e06a4c-130f-4f26-abfb-4fbadfeacb13 admin admin] PATH_INFO: `/v3/projects/84edb33aed7445cebfe4d0346d0e70d5/users/a656f04a96af4b298e320f591a05f229/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:39.024071 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e06a4c-130f-4f26-abfb-4fbadfeacb13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84edb33aed7445cebfe4d0346d0e70d5, user_id=a656f04a96af4b298e320f591a05f229, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:39.026863 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e06a4c-130f-4f26-abfb-4fbadfeacb13 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:39.041710 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1220/2455] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:31:38 2022] PUT /identity/v3/projects/84edb33aed7445cebfe4d0346d0e70d5/users/a656f04a96af4b298e320f591a05f229/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:31:39.046803 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7c153-cffa-4262-91b8-41aae1a24ef3 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:39.047128 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7c153-cffa-4262-91b8-41aae1a24ef3 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:39.047424 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7c153-cffa-4262-91b8-41aae1a24ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:39.068056 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-b9f7c153-cffa-4262-91b8-41aae1a24ef3 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:31:39.069298 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b9f7c153-cffa-4262-91b8-41aae1a24ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:39.131713 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1236/2456] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:31:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:31:39.141784 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e06a4c-130f-4f26-abfb-4fbadfeacb13 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:39.143743 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c1e06a4c-130f-4f26-abfb-4fbadfeacb13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:39.159407 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:31:39.211831 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e06a4c-130f-4f26-abfb-4fbadfeacb13 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:39.216176 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d161a70-4edd-49b8-bf67-eb118eaebaef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:39.216812 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d161a70-4edd-49b8-bf67-eb118eaebaef service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:39.217086 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d161a70-4edd-49b8-bf67-eb118eaebaef service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:39.217351 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d161a70-4edd-49b8-bf67-eb118eaebaef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:39.227241 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d161a70-4edd-49b8-bf67-eb118eaebaef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:39.228702 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d161a70-4edd-49b8-bf67-eb118eaebaef service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:39.239012 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1221/2457] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:31:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:31:39.887176 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4cd81-62c9-4320-8a03-9e08ac469a1b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:39.887455 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4cd81-62c9-4320-8a03-9e08ac469a1b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:39.887722 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4cd81-62c9-4320-8a03-9e08ac469a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:39.917114 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-7ba4cd81-62c9-4320-8a03-9e08ac469a1b None None] MFA Rules not processed for user `a656f04a96af4b298e320f591a05f229`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:31:39.918391 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7ba4cd81-62c9-4320-8a03-9e08ac469a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:39.969015 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:31:39.986426 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1237/2458] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:31:39 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:31:39.991063 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d161a70-4edd-49b8-bf67-eb118eaebaef service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:40.000824 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d161a70-4edd-49b8-bf67-eb118eaebaef service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:40.005597 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fbf2c-4fca-473e-afc0-5c0a36d42f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:40.006144 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fbf2c-4fca-473e-afc0-5c0a36d42f2b admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:40.006419 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fbf2c-4fca-473e-afc0-5c0a36d42f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:40.006702 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fbf2c-4fca-473e-afc0-5c0a36d42f2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:40.007316 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4fbf2c-4fca-473e-afc0-5c0a36d42f2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:40.009202 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4fbf2c-4fca-473e-afc0-5c0a36d42f2b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:40.039633 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1222/2459] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:31:39 2022] POST /identity/v3/projects => generated 401 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:31:40.043731 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4cd81-62c9-4320-8a03-9e08ac469a1b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:40.054864 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4cd81-62c9-4320-8a03-9e08ac469a1b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:40.115420 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e79df8-8b96-4df1-a5ee-2f3168824b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:40.116019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e79df8-8b96-4df1-a5ee-2f3168824b12 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:40.116296 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e79df8-8b96-4df1-a5ee-2f3168824b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:40.116565 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e79df8-8b96-4df1-a5ee-2f3168824b12 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:40.117191 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e79df8-8b96-4df1-a5ee-2f3168824b12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:40.119136 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e79df8-8b96-4df1-a5ee-2f3168824b12 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:40.141909 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1238/2460] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:31:40 2022] POST /identity/v3/users => generated 307 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:31:40.146116 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fbf2c-4fca-473e-afc0-5c0a36d42f2b admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:40.156881 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fbf2c-4fca-473e-afc0-5c0a36d42f2b admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:40.161930 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9647fa-7cd1-497f-84bf-b36b109faf27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:40.162501 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9647fa-7cd1-497f-84bf-b36b109faf27 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:40.162794 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9647fa-7cd1-497f-84bf-b36b109faf27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:40.163044 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9647fa-7cd1-497f-84bf-b36b109faf27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:40.163807 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9647fa-7cd1-497f-84bf-b36b109faf27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:40.165448 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9647fa-7cd1-497f-84bf-b36b109faf27 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:40.176245 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1223/2461] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:31:40.180341 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e79df8-8b96-4df1-a5ee-2f3168824b12 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:40.190849 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e79df8-8b96-4df1-a5ee-2f3168824b12 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:40.195729 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8266718b-7397-49be-bea8-b50750bfec23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:40.196372 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266718b-7397-49be-bea8-b50750bfec23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:40.196661 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266718b-7397-49be-bea8-b50750bfec23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:40.196921 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266718b-7397-49be-bea8-b50750bfec23 admin admin] PATH_INFO: `/v3/projects/000147a113074072b7090663984cef43/users/1d335bc53f5a48c981ef6fea012ed9d7/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:40.212007 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8266718b-7397-49be-bea8-b50750bfec23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=000147a113074072b7090663984cef43, user_id=1d335bc53f5a48c981ef6fea012ed9d7, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:40.214728 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8266718b-7397-49be-bea8-b50750bfec23 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:40.229527 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1239/2462] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:31:40 2022] PUT /identity/v3/projects/000147a113074072b7090663984cef43/users/1d335bc53f5a48c981ef6fea012ed9d7/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:31:40.233802 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9647fa-7cd1-497f-84bf-b36b109faf27 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:40.244366 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9647fa-7cd1-497f-84bf-b36b109faf27 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:40.302306 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb1e0a-5549-4535-bc9e-0a37910a2449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:40.302835 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb1e0a-5549-4535-bc9e-0a37910a2449 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:40.303113 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb1e0a-5549-4535-bc9e-0a37910a2449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:40.303387 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb1e0a-5549-4535-bc9e-0a37910a2449 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:40.304025 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb1e0a-5549-4535-bc9e-0a37910a2449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:40.305660 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb1e0a-5549-4535-bc9e-0a37910a2449 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:40.315855 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1224/2463] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:31:40.320359 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8266718b-7397-49be-bea8-b50750bfec23 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:40.330918 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8266718b-7397-49be-bea8-b50750bfec23 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:40.336160 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99cb87c-1830-4d9c-9b04-a9a805955ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:40.336803 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99cb87c-1830-4d9c-9b04-a9a805955ec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:40.337097 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99cb87c-1830-4d9c-9b04-a9a805955ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:40.337358 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99cb87c-1830-4d9c-9b04-a9a805955ec4 admin admin] PATH_INFO: `/v3/projects/000147a113074072b7090663984cef43/users/1d335bc53f5a48c981ef6fea012ed9d7/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:40.339511 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99cb87c-1830-4d9c-9b04-a9a805955ec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=000147a113074072b7090663984cef43, user_id=1d335bc53f5a48c981ef6fea012ed9d7, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:40.342200 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99cb87c-1830-4d9c-9b04-a9a805955ec4 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:40.352825 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1240/2464] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:31:40 2022] PUT /identity/v3/projects/000147a113074072b7090663984cef43/users/1d335bc53f5a48c981ef6fea012ed9d7/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:31:41.221079 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086f2ad-5c33-4c84-91dd-ec8a3d2b4d24 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:41.221677 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086f2ad-5c33-4c84-91dd-ec8a3d2b4d24 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:41.221787 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086f2ad-5c33-4c84-91dd-ec8a3d2b4d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:41.252539 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-f086f2ad-5c33-4c84-91dd-ec8a3d2b4d24 None None] MFA Rules not processed for user `1d335bc53f5a48c981ef6fea012ed9d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:31:41.253776 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f086f2ad-5c33-4c84-91dd-ec8a3d2b4d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:41.325372 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1225/2465] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:31:41 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:31:42.372906 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99cb87c-1830-4d9c-9b04-a9a805955ec4 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:42.437693 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99cb87c-1830-4d9c-9b04-a9a805955ec4 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:42.443186 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00998a4-15d1-4a1a-82b3-ab8c8fc9cf2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:42.443831 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00998a4-15d1-4a1a-82b3-ab8c8fc9cf2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:42.444107 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00998a4-15d1-4a1a-82b3-ab8c8fc9cf2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:42.444371 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00998a4-15d1-4a1a-82b3-ab8c8fc9cf2f admin admin] PATH_INFO: `/v3/users/a656f04a96af4b298e320f591a05f229` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:42.445510 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00998a4-15d1-4a1a-82b3-ab8c8fc9cf2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a656f04a96af4b298e320f591a05f229)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:42.447461 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00998a4-15d1-4a1a-82b3-ab8c8fc9cf2f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:42.494677 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:31:42.497568 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e00998a4-15d1-4a1a-82b3-ab8c8fc9cf2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a656f04a96af4b298e320f591a05f229'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:42.498863 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e00998a4-15d1-4a1a-82b3-ab8c8fc9cf2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a656f04a96af4b298e320f591a05f229'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:42.507442 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e00998a4-15d1-4a1a-82b3-ab8c8fc9cf2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a656f04a96af4b298e320f591a05f229'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:42.519355 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e00998a4-15d1-4a1a-82b3-ab8c8fc9cf2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a656f04a96af4b298e320f591a05f229'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:42.520226 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e00998a4-15d1-4a1a-82b3-ab8c8fc9cf2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a656f04a96af4b298e320f591a05f229'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:42.533555 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1241/2466] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:31:42 2022] DELETE /identity/v3/users/a656f04a96af4b298e320f591a05f229 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:31:42.720090 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086f2ad-5c33-4c84-91dd-ec8a3d2b4d24 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:42.726546 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:31:42.734111 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086f2ad-5c33-4c84-91dd-ec8a3d2b4d24 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:42.805283 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571f77b-7043-4354-88a3-f9da63554249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:42.805805 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571f77b-7043-4354-88a3-f9da63554249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:42.806081 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571f77b-7043-4354-88a3-f9da63554249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:42.806353 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571f77b-7043-4354-88a3-f9da63554249 admin admin] PATH_INFO: `/v3/projects/84edb33aed7445cebfe4d0346d0e70d5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:42.807535 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571f77b-7043-4354-88a3-f9da63554249 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84edb33aed7445cebfe4d0346d0e70d5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:42.809485 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571f77b-7043-4354-88a3-f9da63554249 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:42.866172 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1571f77b-7043-4354-88a3-f9da63554249 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84edb33aed7445cebfe4d0346d0e70d5', 'request_id': 'req-1571f77b-7043-4354-88a3-f9da63554249'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:42.875036 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1571f77b-7043-4354-88a3-f9da63554249 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84edb33aed7445cebfe4d0346d0e70d5', 'request_id': 'req-1571f77b-7043-4354-88a3-f9da63554249'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:42.881986 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1571f77b-7043-4354-88a3-f9da63554249 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84edb33aed7445cebfe4d0346d0e70d5', 'request_id': 'req-1571f77b-7043-4354-88a3-f9da63554249'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:42.893841 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1571f77b-7043-4354-88a3-f9da63554249 admin admin] The token cache is being invalidate because project 84edb33aed7445cebfe4d0346d0e70d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:31:42.894128 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1571f77b-7043-4354-88a3-f9da63554249 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:42.894847 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1571f77b-7043-4354-88a3-f9da63554249 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:42.896608 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1226/2467] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:31:42 2022] DELETE /identity/v3/projects/84edb33aed7445cebfe4d0346d0e70d5 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:31:42.903957 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00998a4-15d1-4a1a-82b3-ab8c8fc9cf2f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:42.907632 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e00998a4-15d1-4a1a-82b3-ab8c8fc9cf2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:42.922570 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00998a4-15d1-4a1a-82b3-ab8c8fc9cf2f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:42.985246 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e049d389-dee0-421e-928d-aaeb763748b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:42.985920 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049d389-dee0-421e-928d-aaeb763748b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:42.986190 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049d389-dee0-421e-928d-aaeb763748b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:42.986454 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049d389-dee0-421e-928d-aaeb763748b4 admin admin] PATH_INFO: `/v3/users/1d335bc53f5a48c981ef6fea012ed9d7` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:42.987730 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e049d389-dee0-421e-928d-aaeb763748b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d335bc53f5a48c981ef6fea012ed9d7)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:42.990149 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e049d389-dee0-421e-928d-aaeb763748b4 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:43.039112 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e049d389-dee0-421e-928d-aaeb763748b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d335bc53f5a48c981ef6fea012ed9d7'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:43.039753 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e049d389-dee0-421e-928d-aaeb763748b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d335bc53f5a48c981ef6fea012ed9d7'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:43.046933 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e049d389-dee0-421e-928d-aaeb763748b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d335bc53f5a48c981ef6fea012ed9d7'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:43.059112 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e049d389-dee0-421e-928d-aaeb763748b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d335bc53f5a48c981ef6fea012ed9d7'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:43.059826 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e049d389-dee0-421e-928d-aaeb763748b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d335bc53f5a48c981ef6fea012ed9d7'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:43.075120 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1242/2468] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:31:42 2022] DELETE /identity/v3/users/1d335bc53f5a48c981ef6fea012ed9d7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:31:43.270338 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571f77b-7043-4354-88a3-f9da63554249 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:43.271922 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1571f77b-7043-4354-88a3-f9da63554249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:43.285368 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571f77b-7043-4354-88a3-f9da63554249 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:43.353334 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a40b759-4066-4138-b520-8c2561e69023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:43.353990 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40b759-4066-4138-b520-8c2561e69023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:43.354261 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40b759-4066-4138-b520-8c2561e69023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:43.354525 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40b759-4066-4138-b520-8c2561e69023 admin admin] PATH_INFO: `/v3/projects/000147a113074072b7090663984cef43` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:43.355684 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a40b759-4066-4138-b520-8c2561e69023 admin admin] RBAC: Authorizing `identity:delete_project(project_id=000147a113074072b7090663984cef43)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:43.357622 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a40b759-4066-4138-b520-8c2561e69023 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:43.397983 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:31:43.409860 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-8a40b759-4066-4138-b520-8c2561e69023 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '000147a113074072b7090663984cef43', 'request_id': 'req-8a40b759-4066-4138-b520-8c2561e69023'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:43.418394 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-8a40b759-4066-4138-b520-8c2561e69023 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '000147a113074072b7090663984cef43', 'request_id': 'req-8a40b759-4066-4138-b520-8c2561e69023'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:43.424964 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-8a40b759-4066-4138-b520-8c2561e69023 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '000147a113074072b7090663984cef43', 'request_id': 'req-8a40b759-4066-4138-b520-8c2561e69023'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:43.435767 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-8a40b759-4066-4138-b520-8c2561e69023 admin admin] The token cache is being invalidate because project 000147a113074072b7090663984cef43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:31:43.436046 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-8a40b759-4066-4138-b520-8c2561e69023 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:43.436688 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-8a40b759-4066-4138-b520-8c2561e69023 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:43.438220 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1227/2469] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:31:43 2022] DELETE /identity/v3/projects/000147a113074072b7090663984cef43 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:31:43.443774 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fa45f-ec44-4451-a66a-25103aeee2df None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:43.444258 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fa45f-ec44-4451-a66a-25103aeee2df None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:43.444361 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fa45f-ec44-4451-a66a-25103aeee2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:43.465001 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-a06fa45f-ec44-4451-a66a-25103aeee2df None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:31:43.466238 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a06fa45f-ec44-4451-a66a-25103aeee2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:43.501626 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:31:43.530306 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1243/2470] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:31:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:31:43.539572 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274a17a-be8a-4a7a-8a7c-d0cf3529e851 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:43.539852 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274a17a-be8a-4a7a-8a7c-d0cf3529e851 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:43.540122 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274a17a-be8a-4a7a-8a7c-d0cf3529e851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:43.561371 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-5274a17a-be8a-4a7a-8a7c-d0cf3529e851 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:31:43.562589 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5274a17a-be8a-4a7a-8a7c-d0cf3529e851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:43.572049 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1228/2471] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:31:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:31:43.576401 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fa45f-ec44-4451-a66a-25103aeee2df None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:43.586433 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fa45f-ec44-4451-a66a-25103aeee2df None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:43.591330 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39ab7b-9b2f-46b6-b8f1-bf17e42b6f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:43.591920 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39ab7b-9b2f-46b6-b8f1-bf17e42b6f5d admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:43.592193 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39ab7b-9b2f-46b6-b8f1-bf17e42b6f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:43.592459 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39ab7b-9b2f-46b6-b8f1-bf17e42b6f5d admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:43.593122 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39ab7b-9b2f-46b6-b8f1-bf17e42b6f5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:31:43.593391 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39ab7b-9b2f-46b6-b8f1-bf17e42b6f5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:43.595034 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39ab7b-9b2f-46b6-b8f1-bf17e42b6f5d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:43.607194 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1244/2472] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:31:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:31:43.611490 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274a17a-be8a-4a7a-8a7c-d0cf3529e851 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:43.620735 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274a17a-be8a-4a7a-8a7c-d0cf3529e851 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:43.625648 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb4022-1732-43fd-b2e2-5a6099254b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:43.626234 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb4022-1732-43fd-b2e2-5a6099254b9c admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:43.626506 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb4022-1732-43fd-b2e2-5a6099254b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:43.626770 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb4022-1732-43fd-b2e2-5a6099254b9c admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:43.627402 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb4022-1732-43fd-b2e2-5a6099254b9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:43.629313 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb4022-1732-43fd-b2e2-5a6099254b9c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:43.658493 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1229/2473] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:31:43 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:31:43.662676 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39ab7b-9b2f-46b6-b8f1-bf17e42b6f5d admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:43.673044 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39ab7b-9b2f-46b6-b8f1-bf17e42b6f5d admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:43.735017 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059581aa-24dc-47dd-ae39-58d5f043da92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:43.735839 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059581aa-24dc-47dd-ae39-58d5f043da92 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:43.736206 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059581aa-24dc-47dd-ae39-58d5f043da92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:43.736563 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059581aa-24dc-47dd-ae39-58d5f043da92 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:43.737489 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059581aa-24dc-47dd-ae39-58d5f043da92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:43.740045 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059581aa-24dc-47dd-ae39-58d5f043da92 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:43.763533 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1245/2474] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:31:43 2022] POST /identity/v3/users => generated 285 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:31:43.767808 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb4022-1732-43fd-b2e2-5a6099254b9c admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:43.778304 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb4022-1732-43fd-b2e2-5a6099254b9c admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:43.783163 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5a2d1-0f3f-4a98-8b6b-724c84fbaf2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:43.783699 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5a2d1-0f3f-4a98-8b6b-724c84fbaf2c admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:43.783974 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5a2d1-0f3f-4a98-8b6b-724c84fbaf2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:43.784242 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5a2d1-0f3f-4a98-8b6b-724c84fbaf2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:43.784877 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5a2d1-0f3f-4a98-8b6b-724c84fbaf2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:43.786622 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5a2d1-0f3f-4a98-8b6b-724c84fbaf2c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:43.796809 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1230/2475] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:31:43.800803 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059581aa-24dc-47dd-ae39-58d5f043da92 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:43.811075 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059581aa-24dc-47dd-ae39-58d5f043da92 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:43.816022 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ec691-c2be-4f61-aa19-b7ddaf11cf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:43.816612 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ec691-c2be-4f61-aa19-b7ddaf11cf47 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:43.816915 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ec691-c2be-4f61-aa19-b7ddaf11cf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:43.817178 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ec691-c2be-4f61-aa19-b7ddaf11cf47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:43.818028 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ec691-c2be-4f61-aa19-b7ddaf11cf47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:43.819614 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ec691-c2be-4f61-aa19-b7ddaf11cf47 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:43.831356 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1246/2476] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:31:43.835696 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5a2d1-0f3f-4a98-8b6b-724c84fbaf2c admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:43.846031 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5a2d1-0f3f-4a98-8b6b-724c84fbaf2c admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:43.851219 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3874ea-9251-45bd-9b4e-d574015d1acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:43.851866 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3874ea-9251-45bd-9b4e-d574015d1acd admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:43.852140 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3874ea-9251-45bd-9b4e-d574015d1acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:43.852409 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3874ea-9251-45bd-9b4e-d574015d1acd admin admin] PATH_INFO: `/v3/projects/20029e045b974e6992b490d3b88fce7c/users/dbed5baa3f1e4c78886d553f4d42e290/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:43.867456 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3874ea-9251-45bd-9b4e-d574015d1acd admin admin] RBAC: Authorizing `identity:create_grant(project_id=20029e045b974e6992b490d3b88fce7c, user_id=dbed5baa3f1e4c78886d553f4d42e290, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:43.870156 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3874ea-9251-45bd-9b4e-d574015d1acd admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:43.885209 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1231/2477] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:31:43 2022] PUT /identity/v3/projects/20029e045b974e6992b490d3b88fce7c/users/dbed5baa3f1e4c78886d553f4d42e290/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:31:43.896900 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4228e2-105c-4ebb-b22d-52eccb9a849a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:43.897179 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4228e2-105c-4ebb-b22d-52eccb9a849a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:43.897446 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4228e2-105c-4ebb-b22d-52eccb9a849a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:43.927507 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-1e4228e2-105c-4ebb-b22d-52eccb9a849a None None] MFA Rules not processed for user `dbed5baa3f1e4c78886d553f4d42e290`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:31:43.928644 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1e4228e2-105c-4ebb-b22d-52eccb9a849a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:43.998391 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1247/2478] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:31:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:31:44.003129 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3874ea-9251-45bd-9b4e-d574015d1acd admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:44.070694 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3874ea-9251-45bd-9b4e-d574015d1acd admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:44.076240 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b131a0-9d10-46bc-968f-09e02a7d435a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:44.076858 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b131a0-9d10-46bc-968f-09e02a7d435a admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:44.077128 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b131a0-9d10-46bc-968f-09e02a7d435a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:44.077396 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b131a0-9d10-46bc-968f-09e02a7d435a admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:44.078066 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b131a0-9d10-46bc-968f-09e02a7d435a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:44.079952 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b131a0-9d10-46bc-968f-09e02a7d435a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:44.112427 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1232/2479] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:31:44 2022] POST /identity/v3/projects => generated 369 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:31:44.116919 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4228e2-105c-4ebb-b22d-52eccb9a849a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:44.127812 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4228e2-105c-4ebb-b22d-52eccb9a849a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:44.161158 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:31:44.187662 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9b3cc-481c-4e28-be93-07bc9e93d802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:44.188249 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9b3cc-481c-4e28-be93-07bc9e93d802 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:44.188526 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9b3cc-481c-4e28-be93-07bc9e93d802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:44.189140 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9b3cc-481c-4e28-be93-07bc9e93d802 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:44.189815 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba9b3cc-481c-4e28-be93-07bc9e93d802 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:44.191785 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba9b3cc-481c-4e28-be93-07bc9e93d802 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:44.214345 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1248/2480] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:31:44 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:31:44.218420 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b131a0-9d10-46bc-968f-09e02a7d435a admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:44.229023 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b131a0-9d10-46bc-968f-09e02a7d435a admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:44.233933 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174a510-2565-481c-80bc-37fe9f96912e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:44.234531 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174a510-2565-481c-80bc-37fe9f96912e admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:44.234806 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174a510-2565-481c-80bc-37fe9f96912e admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:44.235076 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174a510-2565-481c-80bc-37fe9f96912e admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:44.235717 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9174a510-2565-481c-80bc-37fe9f96912e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:44.237315 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9174a510-2565-481c-80bc-37fe9f96912e admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:44.248029 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1233/2481] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:31:44.252253 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9b3cc-481c-4e28-be93-07bc9e93d802 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:44.262876 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9b3cc-481c-4e28-be93-07bc9e93d802 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:44.268257 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0fc53-d338-4f62-b609-cae8cf7c21a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:44.268909 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0fc53-d338-4f62-b609-cae8cf7c21a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:44.269177 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0fc53-d338-4f62-b609-cae8cf7c21a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:44.269506 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0fc53-d338-4f62-b609-cae8cf7c21a4 admin admin] PATH_INFO: `/v3/projects/ac030437a2bd4c8981dd05133db142ca/users/84fb2eca358645a7b56ea7d2c22d8fde/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:44.284926 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b0fc53-d338-4f62-b609-cae8cf7c21a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac030437a2bd4c8981dd05133db142ca, user_id=84fb2eca358645a7b56ea7d2c22d8fde, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:44.287741 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b0fc53-d338-4f62-b609-cae8cf7c21a4 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:44.302048 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1249/2482] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:31:44 2022] PUT /identity/v3/projects/ac030437a2bd4c8981dd05133db142ca/users/84fb2eca358645a7b56ea7d2c22d8fde/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:31:44.306201 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174a510-2565-481c-80bc-37fe9f96912e admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:44.317324 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174a510-2565-481c-80bc-37fe9f96912e admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:44.349939 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:31:44.382630 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9945555-a613-4eca-aba2-ad5dfbea8a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:44.383236 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9945555-a613-4eca-aba2-ad5dfbea8a81 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:44.383510 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9945555-a613-4eca-aba2-ad5dfbea8a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:44.383776 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9945555-a613-4eca-aba2-ad5dfbea8a81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:44.384427 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9945555-a613-4eca-aba2-ad5dfbea8a81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:44.386092 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9945555-a613-4eca-aba2-ad5dfbea8a81 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:44.396311 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1234/2483] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:31:44.400620 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0fc53-d338-4f62-b609-cae8cf7c21a4 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:44.410975 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0fc53-d338-4f62-b609-cae8cf7c21a4 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:44.415656 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c47db-f578-4f10-bbce-7b8435d90499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:44.416305 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c47db-f578-4f10-bbce-7b8435d90499 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:44.416573 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c47db-f578-4f10-bbce-7b8435d90499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:44.416839 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c47db-f578-4f10-bbce-7b8435d90499 admin admin] PATH_INFO: `/v3/projects/ac030437a2bd4c8981dd05133db142ca/users/84fb2eca358645a7b56ea7d2c22d8fde/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:44.418758 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c47db-f578-4f10-bbce-7b8435d90499 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac030437a2bd4c8981dd05133db142ca, user_id=84fb2eca358645a7b56ea7d2c22d8fde, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:44.421376 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c47db-f578-4f10-bbce-7b8435d90499 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:44.432076 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1250/2484] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:31:44 2022] PUT /identity/v3/projects/ac030437a2bd4c8981dd05133db142ca/users/84fb2eca358645a7b56ea7d2c22d8fde/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:31:44.442965 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005adc45-f402-4d8e-b0d0-d34fbba14a32 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:44.443220 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005adc45-f402-4d8e-b0d0-d34fbba14a32 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:44.443493 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005adc45-f402-4d8e-b0d0-d34fbba14a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:44.472019 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-005adc45-f402-4d8e-b0d0-d34fbba14a32 None None] MFA Rules not processed for user `84fb2eca358645a7b56ea7d2c22d8fde`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:31:44.473252 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-005adc45-f402-4d8e-b0d0-d34fbba14a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:44.542983 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1235/2485] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:31:44 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:31:44.555440 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c47db-f578-4f10-bbce-7b8435d90499 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:44.557332 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-326c47db-f578-4f10-bbce-7b8435d90499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:44.616696 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c47db-f578-4f10-bbce-7b8435d90499 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:44.620589 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5948746-bedb-47c1-85b2-dcd350256d77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:44.621166 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5948746-bedb-47c1-85b2-dcd350256d77 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:44.621466 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5948746-bedb-47c1-85b2-dcd350256d77 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:44.621761 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5948746-bedb-47c1-85b2-dcd350256d77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:44.631213 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5948746-bedb-47c1-85b2-dcd350256d77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:44.632609 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5948746-bedb-47c1-85b2-dcd350256d77 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:44.642062 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1251/2486] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:31:44 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:31:44.696556 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005adc45-f402-4d8e-b0d0-d34fbba14a32 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:44.698051 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-005adc45-f402-4d8e-b0d0-d34fbba14a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:44.710268 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005adc45-f402-4d8e-b0d0-d34fbba14a32 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:44.714067 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5abc338-b71e-4384-b223-c1aa0b016f8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:44.714660 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5abc338-b71e-4384-b223-c1aa0b016f8b service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:44.714931 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5abc338-b71e-4384-b223-c1aa0b016f8b service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:44.715229 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5abc338-b71e-4384-b223-c1aa0b016f8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:44.772853 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5abc338-b71e-4384-b223-c1aa0b016f8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:44.774328 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5abc338-b71e-4384-b223-c1aa0b016f8b service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:44.783312 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1236/2487] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:31:44 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:31:48.152851 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5948746-bedb-47c1-85b2-dcd350256d77 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:48.218369 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5948746-bedb-47c1-85b2-dcd350256d77 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:48.223098 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a57dab-f167-46f4-aa49-e4958197de0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:48.223705 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a57dab-f167-46f4-aa49-e4958197de0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:48.223973 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a57dab-f167-46f4-aa49-e4958197de0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:48.224241 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a57dab-f167-46f4-aa49-e4958197de0d admin admin] PATH_INFO: `/v3/users/dbed5baa3f1e4c78886d553f4d42e290` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:48.225403 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a57dab-f167-46f4-aa49-e4958197de0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbed5baa3f1e4c78886d553f4d42e290)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:48.227323 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a57dab-f167-46f4-aa49-e4958197de0d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:48.264974 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:31:48.278617 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b1a57dab-f167-46f4-aa49-e4958197de0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbed5baa3f1e4c78886d553f4d42e290'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:48.279256 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b1a57dab-f167-46f4-aa49-e4958197de0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbed5baa3f1e4c78886d553f4d42e290'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:48.286127 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b1a57dab-f167-46f4-aa49-e4958197de0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbed5baa3f1e4c78886d553f4d42e290'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:48.298888 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b1a57dab-f167-46f4-aa49-e4958197de0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbed5baa3f1e4c78886d553f4d42e290'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:48.299903 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b1a57dab-f167-46f4-aa49-e4958197de0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbed5baa3f1e4c78886d553f4d42e290'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:48.318602 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1252/2488] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:31:48 2022] DELETE /identity/v3/users/dbed5baa3f1e4c78886d553f4d42e290 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:31:48.325313 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259f83f-7b2e-490f-8162-2591a8978473 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:48.325858 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259f83f-7b2e-490f-8162-2591a8978473 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:48.325968 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259f83f-7b2e-490f-8162-2591a8978473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:48.347856 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-f259f83f-7b2e-490f-8162-2591a8978473 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:31:48.349119 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f259f83f-7b2e-490f-8162-2591a8978473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:48.401239 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:31:48.413870 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1237/2489] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:31:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:31:48.424043 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a57dab-f167-46f4-aa49-e4958197de0d admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:48.425567 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b1a57dab-f167-46f4-aa49-e4958197de0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:48.484353 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a57dab-f167-46f4-aa49-e4958197de0d admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:48.488110 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aecc2ef-b23c-41c3-95ee-9137f998b068 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:48.488723 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecc2ef-b23c-41c3-95ee-9137f998b068 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:48.489019 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecc2ef-b23c-41c3-95ee-9137f998b068 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:48.489341 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecc2ef-b23c-41c3-95ee-9137f998b068 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:48.498557 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aecc2ef-b23c-41c3-95ee-9137f998b068 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:48.500011 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aecc2ef-b23c-41c3-95ee-9137f998b068 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:48.509767 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1253/2490] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:31:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:31:48.786612 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f259f83f-7b2e-490f-8162-2591a8978473 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:48.788096 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f259f83f-7b2e-490f-8162-2591a8978473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:48.800989 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f259f83f-7b2e-490f-8162-2591a8978473 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:48.806905 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac640061-1540-444c-92b9-57aab2015e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:48.807631 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac640061-1540-444c-92b9-57aab2015e2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:48.808006 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac640061-1540-444c-92b9-57aab2015e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:48.808339 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac640061-1540-444c-92b9-57aab2015e2b admin admin] PATH_INFO: `/v3/projects/20029e045b974e6992b490d3b88fce7c` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:48.809499 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac640061-1540-444c-92b9-57aab2015e2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=20029e045b974e6992b490d3b88fce7c)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:48.811441 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac640061-1540-444c-92b9-57aab2015e2b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:48.858855 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ac640061-1540-444c-92b9-57aab2015e2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20029e045b974e6992b490d3b88fce7c', 'request_id': 'req-ac640061-1540-444c-92b9-57aab2015e2b'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:48.867003 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ac640061-1540-444c-92b9-57aab2015e2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20029e045b974e6992b490d3b88fce7c', 'request_id': 'req-ac640061-1540-444c-92b9-57aab2015e2b'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:48.873686 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ac640061-1540-444c-92b9-57aab2015e2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20029e045b974e6992b490d3b88fce7c', 'request_id': 'req-ac640061-1540-444c-92b9-57aab2015e2b'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:48.884868 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ac640061-1540-444c-92b9-57aab2015e2b admin admin] The token cache is being invalidate because project 20029e045b974e6992b490d3b88fce7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:31:48.885153 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ac640061-1540-444c-92b9-57aab2015e2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:48.885865 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ac640061-1540-444c-92b9-57aab2015e2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:48.887387 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1238/2491] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:31:48 2022] DELETE /identity/v3/projects/20029e045b974e6992b490d3b88fce7c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:31:48.891705 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aecc2ef-b23c-41c3-95ee-9137f998b068 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:48.901668 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aecc2ef-b23c-41c3-95ee-9137f998b068 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:48.960681 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda838d5-ab2f-4489-a168-86dd599e7e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:48.961302 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda838d5-ab2f-4489-a168-86dd599e7e8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:48.961607 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda838d5-ab2f-4489-a168-86dd599e7e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:48.961879 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda838d5-ab2f-4489-a168-86dd599e7e8e admin admin] PATH_INFO: `/v3/users/84fb2eca358645a7b56ea7d2c22d8fde` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:48.963042 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda838d5-ab2f-4489-a168-86dd599e7e8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=84fb2eca358645a7b56ea7d2c22d8fde)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:48.964960 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda838d5-ab2f-4489-a168-86dd599e7e8e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:49.011436 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-eda838d5-ab2f-4489-a168-86dd599e7e8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84fb2eca358645a7b56ea7d2c22d8fde'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:49.012083 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-eda838d5-ab2f-4489-a168-86dd599e7e8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84fb2eca358645a7b56ea7d2c22d8fde'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:49.017349 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:31:49.019360 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-eda838d5-ab2f-4489-a168-86dd599e7e8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84fb2eca358645a7b56ea7d2c22d8fde'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:49.032958 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-eda838d5-ab2f-4489-a168-86dd599e7e8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84fb2eca358645a7b56ea7d2c22d8fde'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:49.033680 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-eda838d5-ab2f-4489-a168-86dd599e7e8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84fb2eca358645a7b56ea7d2c22d8fde'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:49.047510 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1254/2492] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:31:48 2022] DELETE /identity/v3/users/84fb2eca358645a7b56ea7d2c22d8fde => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:31:49.329645 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac640061-1540-444c-92b9-57aab2015e2b admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:49.331157 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ac640061-1540-444c-92b9-57aab2015e2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:49.349440 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac640061-1540-444c-92b9-57aab2015e2b admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:49.407777 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a2690-acd1-441b-9d2a-f90e3d23136d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:49.408406 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a2690-acd1-441b-9d2a-f90e3d23136d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:49.408677 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a2690-acd1-441b-9d2a-f90e3d23136d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:49.408944 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a2690-acd1-441b-9d2a-f90e3d23136d admin admin] PATH_INFO: `/v3/projects/ac030437a2bd4c8981dd05133db142ca` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:49.410075 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a2690-acd1-441b-9d2a-f90e3d23136d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac030437a2bd4c8981dd05133db142ca)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:49.412044 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a2690-acd1-441b-9d2a-f90e3d23136d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:49.459748 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-562a2690-acd1-441b-9d2a-f90e3d23136d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac030437a2bd4c8981dd05133db142ca', 'request_id': 'req-562a2690-acd1-441b-9d2a-f90e3d23136d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:49.468360 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-562a2690-acd1-441b-9d2a-f90e3d23136d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac030437a2bd4c8981dd05133db142ca', 'request_id': 'req-562a2690-acd1-441b-9d2a-f90e3d23136d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:49.475457 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-562a2690-acd1-441b-9d2a-f90e3d23136d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac030437a2bd4c8981dd05133db142ca', 'request_id': 'req-562a2690-acd1-441b-9d2a-f90e3d23136d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:49.486423 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-562a2690-acd1-441b-9d2a-f90e3d23136d admin admin] The token cache is being invalidate because project ac030437a2bd4c8981dd05133db142ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:31:49.486707 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-562a2690-acd1-441b-9d2a-f90e3d23136d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:49.487316 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-562a2690-acd1-441b-9d2a-f90e3d23136d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:49.488849 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1239/2493] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:31:49 2022] DELETE /identity/v3/projects/ac030437a2bd4c8981dd05133db142ca => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:31:49.494114 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e203c-66ef-43c8-95ef-3cbfeecfad43 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:49.494613 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e203c-66ef-43c8-95ef-3cbfeecfad43 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:49.494734 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e203c-66ef-43c8-95ef-3cbfeecfad43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:49.518150 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-a61e203c-66ef-43c8-95ef-3cbfeecfad43 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:31:49.519314 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a61e203c-66ef-43c8-95ef-3cbfeecfad43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:49.584197 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1255/2494] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:31:49.593196 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac1144-b060-451d-907b-f7318af8abf7 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:49.593474 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac1144-b060-451d-907b-f7318af8abf7 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:49.593766 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac1144-b060-451d-907b-f7318af8abf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:49.608555 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:31:49.614608 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-d5ac1144-b060-451d-907b-f7318af8abf7 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:31:49.616578 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d5ac1144-b060-451d-907b-f7318af8abf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:49.625286 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1240/2495] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:31:49.629746 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e203c-66ef-43c8-95ef-3cbfeecfad43 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:49.639711 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e203c-66ef-43c8-95ef-3cbfeecfad43 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:49.644714 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db096c-04db-4f7b-9947-184d071a33a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:49.645376 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db096c-04db-4f7b-9947-184d071a33a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:49.645695 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db096c-04db-4f7b-9947-184d071a33a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:49.645963 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db096c-04db-4f7b-9947-184d071a33a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:49.646602 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37db096c-04db-4f7b-9947-184d071a33a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:31:49.646895 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37db096c-04db-4f7b-9947-184d071a33a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:49.648490 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37db096c-04db-4f7b-9947-184d071a33a8 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:49.660469 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1256/2496] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:31:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:31:49.665793 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac1144-b060-451d-907b-f7318af8abf7 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:49.679086 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac1144-b060-451d-907b-f7318af8abf7 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:49.684282 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc06dc2-9a31-4032-b779-73a137cbac8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:49.684887 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc06dc2-9a31-4032-b779-73a137cbac8a admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:49.685156 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc06dc2-9a31-4032-b779-73a137cbac8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:49.685425 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc06dc2-9a31-4032-b779-73a137cbac8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:49.686094 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc06dc2-9a31-4032-b779-73a137cbac8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:49.687999 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc06dc2-9a31-4032-b779-73a137cbac8a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:49.720088 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1241/2497] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:31:49 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:31:49.724543 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db096c-04db-4f7b-9947-184d071a33a8 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:49.734342 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db096c-04db-4f7b-9947-184d071a33a8 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:49.790358 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76301a-c967-4e54-b005-37bb2f1204bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:49.790894 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76301a-c967-4e54-b005-37bb2f1204bc admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:49.791167 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76301a-c967-4e54-b005-37bb2f1204bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:49.791432 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76301a-c967-4e54-b005-37bb2f1204bc admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:49.792077 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76301a-c967-4e54-b005-37bb2f1204bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:49.794052 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76301a-c967-4e54-b005-37bb2f1204bc admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:49.817606 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1257/2498] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:31:49 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:31:49.821876 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc06dc2-9a31-4032-b779-73a137cbac8a admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:49.832859 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc06dc2-9a31-4032-b779-73a137cbac8a admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:49.838955 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae4076-8930-4915-8cf9-b7423f4e10ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:49.839597 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae4076-8930-4915-8cf9-b7423f4e10ba admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:49.839869 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae4076-8930-4915-8cf9-b7423f4e10ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:49.840136 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae4076-8930-4915-8cf9-b7423f4e10ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:49.840776 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae4076-8930-4915-8cf9-b7423f4e10ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:49.842447 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae4076-8930-4915-8cf9-b7423f4e10ba admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:49.853322 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1242/2499] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:31:49.857684 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76301a-c967-4e54-b005-37bb2f1204bc admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:49.868208 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76301a-c967-4e54-b005-37bb2f1204bc admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:49.873576 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f931b3a-2db0-4dd1-86a9-04d719a26fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:49.874212 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f931b3a-2db0-4dd1-86a9-04d719a26fee admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:49.874488 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f931b3a-2db0-4dd1-86a9-04d719a26fee admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:49.874760 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f931b3a-2db0-4dd1-86a9-04d719a26fee admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:49.875422 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f931b3a-2db0-4dd1-86a9-04d719a26fee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:49.877036 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f931b3a-2db0-4dd1-86a9-04d719a26fee admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:49.887964 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1258/2500] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:31:49.892564 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae4076-8930-4915-8cf9-b7423f4e10ba admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:49.902640 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae4076-8930-4915-8cf9-b7423f4e10ba admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:49.907394 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051bcea-1060-4502-9398-630977039f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:49.908057 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051bcea-1060-4502-9398-630977039f8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:49.908333 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051bcea-1060-4502-9398-630977039f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:49.908614 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051bcea-1060-4502-9398-630977039f8c admin admin] PATH_INFO: `/v3/projects/4c0b91cfe22b448ea40e106214f37223/users/9d677d4296264d3fa4a9c948ae1ea1df/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:49.923397 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1051bcea-1060-4502-9398-630977039f8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c0b91cfe22b448ea40e106214f37223, user_id=9d677d4296264d3fa4a9c948ae1ea1df, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:49.926154 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1051bcea-1060-4502-9398-630977039f8c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:49.941260 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1243/2501] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:31:49 2022] PUT /identity/v3/projects/4c0b91cfe22b448ea40e106214f37223/users/9d677d4296264d3fa4a9c948ae1ea1df/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:31:49.951669 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07795c91-2d82-41a2-84a1-17cc22421651 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:49.951952 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07795c91-2d82-41a2-84a1-17cc22421651 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:49.952222 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07795c91-2d82-41a2-84a1-17cc22421651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:49.980801 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-07795c91-2d82-41a2-84a1-17cc22421651 None None] MFA Rules not processed for user `9d677d4296264d3fa4a9c948ae1ea1df`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:31:49.982073 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-07795c91-2d82-41a2-84a1-17cc22421651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:50.008994 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:31:50.048913 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1259/2502] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:31:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:31:50.053651 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051bcea-1060-4502-9398-630977039f8c admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:50.121167 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051bcea-1060-4502-9398-630977039f8c admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:50.126362 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1265f0-09af-4bcd-9e5c-b174e01e14a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:50.126987 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1265f0-09af-4bcd-9e5c-b174e01e14a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:50.127254 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1265f0-09af-4bcd-9e5c-b174e01e14a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:50.127521 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1265f0-09af-4bcd-9e5c-b174e01e14a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:50.128154 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1265f0-09af-4bcd-9e5c-b174e01e14a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:50.130260 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1265f0-09af-4bcd-9e5c-b174e01e14a8 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:50.161937 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1244/2503] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:31:50 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:31:50.163153 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07795c91-2d82-41a2-84a1-17cc22421651 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:50.174817 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07795c91-2d82-41a2-84a1-17cc22421651 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:50.237129 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96ddad-f03d-4d82-b1e6-8d6013519e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:50.237955 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96ddad-f03d-4d82-b1e6-8d6013519e7b admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:50.238235 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96ddad-f03d-4d82-b1e6-8d6013519e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:50.238581 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96ddad-f03d-4d82-b1e6-8d6013519e7b admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:50.239544 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a96ddad-f03d-4d82-b1e6-8d6013519e7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:50.241502 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a96ddad-f03d-4d82-b1e6-8d6013519e7b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:50.264938 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1260/2504] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:31:50 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:31:50.270602 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1265f0-09af-4bcd-9e5c-b174e01e14a8 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:50.281802 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1265f0-09af-4bcd-9e5c-b174e01e14a8 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:50.286629 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1bf42c-6bbc-4e0e-a1e2-63bf3ac4ea60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:50.287234 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1bf42c-6bbc-4e0e-a1e2-63bf3ac4ea60 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:50.287535 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1bf42c-6bbc-4e0e-a1e2-63bf3ac4ea60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:50.287808 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1bf42c-6bbc-4e0e-a1e2-63bf3ac4ea60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:50.288480 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1bf42c-6bbc-4e0e-a1e2-63bf3ac4ea60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:50.290242 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1bf42c-6bbc-4e0e-a1e2-63bf3ac4ea60 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:50.301009 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1245/2505] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:31:50.305114 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96ddad-f03d-4d82-b1e6-8d6013519e7b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:50.315913 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96ddad-f03d-4d82-b1e6-8d6013519e7b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:50.321560 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3847a75-3fed-4748-9828-820869c557cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:50.322170 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3847a75-3fed-4748-9828-820869c557cd admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:50.322447 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3847a75-3fed-4748-9828-820869c557cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:50.322713 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3847a75-3fed-4748-9828-820869c557cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:50.323347 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3847a75-3fed-4748-9828-820869c557cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:50.324931 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3847a75-3fed-4748-9828-820869c557cd admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:50.335745 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1261/2506] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:31:50.341738 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1bf42c-6bbc-4e0e-a1e2-63bf3ac4ea60 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:50.356938 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1bf42c-6bbc-4e0e-a1e2-63bf3ac4ea60 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:50.364245 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be392c-f862-4919-94aa-a68a77b8812b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:50.364903 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be392c-f862-4919-94aa-a68a77b8812b admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:50.365177 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be392c-f862-4919-94aa-a68a77b8812b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:50.365447 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be392c-f862-4919-94aa-a68a77b8812b admin admin] PATH_INFO: `/v3/projects/8ceb252d371d4a6b985bb1240499284a/users/2c7ad3ff7203445e83857e8ecdd5adf6/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:50.381563 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be392c-f862-4919-94aa-a68a77b8812b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ceb252d371d4a6b985bb1240499284a, user_id=2c7ad3ff7203445e83857e8ecdd5adf6, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:50.384266 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be392c-f862-4919-94aa-a68a77b8812b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:50.399562 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1246/2507] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:31:50 2022] PUT /identity/v3/projects/8ceb252d371d4a6b985bb1240499284a/users/2c7ad3ff7203445e83857e8ecdd5adf6/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:31:50.411078 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a83ca-b838-4b88-97e6-bc3a992471ea None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:50.412581 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a83ca-b838-4b88-97e6-bc3a992471ea None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:50.412873 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a83ca-b838-4b88-97e6-bc3a992471ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:50.443097 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-910a83ca-b838-4b88-97e6-bc3a992471ea None None] MFA Rules not processed for user `2c7ad3ff7203445e83857e8ecdd5adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:31:50.444338 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-910a83ca-b838-4b88-97e6-bc3a992471ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:50.510993 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1262/2508] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:31:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:31:50.515533 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be392c-f862-4919-94aa-a68a77b8812b admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:50.568995 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:31:50.580747 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be392c-f862-4919-94aa-a68a77b8812b admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:50.586029 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81e47c-fdc1-4008-a49b-c29d33e8dc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:50.586639 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81e47c-fdc1-4008-a49b-c29d33e8dc89 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:50.586914 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81e47c-fdc1-4008-a49b-c29d33e8dc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:50.587187 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81e47c-fdc1-4008-a49b-c29d33e8dc89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:50.587818 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81e47c-fdc1-4008-a49b-c29d33e8dc89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:50.589803 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81e47c-fdc1-4008-a49b-c29d33e8dc89 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:50.619557 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1247/2509] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:31:50 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:31:50.623601 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a83ca-b838-4b88-97e6-bc3a992471ea None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:50.635318 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a83ca-b838-4b88-97e6-bc3a992471ea None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:50.670191 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:31:50.698376 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faacdb2d-b9bc-4639-8a45-daca4f8f7093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:50.699477 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacdb2d-b9bc-4639-8a45-daca4f8f7093 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:50.699760 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacdb2d-b9bc-4639-8a45-daca4f8f7093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:50.700035 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacdb2d-b9bc-4639-8a45-daca4f8f7093 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:50.700678 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faacdb2d-b9bc-4639-8a45-daca4f8f7093 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:50.702644 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faacdb2d-b9bc-4639-8a45-daca4f8f7093 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:50.725352 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1263/2510] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:31:50 2022] POST /identity/v3/users => generated 296 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:31:50.729563 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81e47c-fdc1-4008-a49b-c29d33e8dc89 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:50.740553 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81e47c-fdc1-4008-a49b-c29d33e8dc89 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:50.745780 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04587dd0-053c-4c80-8291-f9be2027ae71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:50.746426 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04587dd0-053c-4c80-8291-f9be2027ae71 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:50.746688 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04587dd0-053c-4c80-8291-f9be2027ae71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:50.746953 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04587dd0-053c-4c80-8291-f9be2027ae71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:50.747653 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04587dd0-053c-4c80-8291-f9be2027ae71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:50.749305 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04587dd0-053c-4c80-8291-f9be2027ae71 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:50.763200 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1248/2511] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:31:50.767351 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faacdb2d-b9bc-4639-8a45-daca4f8f7093 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:50.777765 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faacdb2d-b9bc-4639-8a45-daca4f8f7093 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:50.782935 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57800d0c-72f4-4409-9720-a942404aa961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:50.783604 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57800d0c-72f4-4409-9720-a942404aa961 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:50.783878 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57800d0c-72f4-4409-9720-a942404aa961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:50.784143 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57800d0c-72f4-4409-9720-a942404aa961 admin admin] PATH_INFO: `/v3/projects/6687f5d6e438497da06910aa8d4f4ba5/users/14bbb86fbb8d40dead6daf0c7ab30382/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:50.800456 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57800d0c-72f4-4409-9720-a942404aa961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6687f5d6e438497da06910aa8d4f4ba5, user_id=14bbb86fbb8d40dead6daf0c7ab30382, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:50.803335 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57800d0c-72f4-4409-9720-a942404aa961 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:50.819381 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1264/2512] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:31:50 2022] PUT /identity/v3/projects/6687f5d6e438497da06910aa8d4f4ba5/users/14bbb86fbb8d40dead6daf0c7ab30382/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:31:50.823357 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04587dd0-053c-4c80-8291-f9be2027ae71 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:50.833275 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04587dd0-053c-4c80-8291-f9be2027ae71 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:50.890125 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ddc3c0-53d0-4946-99df-67aa0599ce49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:50.890855 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ddc3c0-53d0-4946-99df-67aa0599ce49 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:50.891140 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ddc3c0-53d0-4946-99df-67aa0599ce49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:50.891426 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ddc3c0-53d0-4946-99df-67aa0599ce49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:50.892058 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ddc3c0-53d0-4946-99df-67aa0599ce49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:50.893694 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ddc3c0-53d0-4946-99df-67aa0599ce49 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:50.903690 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1249/2513] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:31:50.907991 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57800d0c-72f4-4409-9720-a942404aa961 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:50.918705 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57800d0c-72f4-4409-9720-a942404aa961 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:50.923593 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb6326-8515-48ce-9a45-17373a803aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:50.924242 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb6326-8515-48ce-9a45-17373a803aef admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:50.924552 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb6326-8515-48ce-9a45-17373a803aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:50.924824 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb6326-8515-48ce-9a45-17373a803aef admin admin] PATH_INFO: `/v3/projects/6687f5d6e438497da06910aa8d4f4ba5/users/14bbb86fbb8d40dead6daf0c7ab30382/roles/93bba834c17a4aa7afdc65c002a12975` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:50.926809 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb6326-8515-48ce-9a45-17373a803aef admin admin] RBAC: Authorizing `identity:create_grant(project_id=6687f5d6e438497da06910aa8d4f4ba5, user_id=14bbb86fbb8d40dead6daf0c7ab30382, role_id=93bba834c17a4aa7afdc65c002a12975)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:50.929606 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb6326-8515-48ce-9a45-17373a803aef admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:50.940321 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1265/2514] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:31:50 2022] PUT /identity/v3/projects/6687f5d6e438497da06910aa8d4f4ba5/users/14bbb86fbb8d40dead6daf0c7ab30382/roles/93bba834c17a4aa7afdc65c002a12975 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:31:50.950595 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fec49-8e1f-429d-a540-3445f561b1ad None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:50.950876 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fec49-8e1f-429d-a540-3445f561b1ad None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:50.951153 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fec49-8e1f-429d-a540-3445f561b1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:50.982066 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-545fec49-8e1f-429d-a540-3445f561b1ad None None] MFA Rules not processed for user `14bbb86fbb8d40dead6daf0c7ab30382`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:31:50.983467 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-545fec49-8e1f-429d-a540-3445f561b1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:51.055654 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1250/2515] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:31:50 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:31:51.068124 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb6326-8515-48ce-9a45-17373a803aef admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:51.070317 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9adb6326-8515-48ce-9a45-17373a803aef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:51.130981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb6326-8515-48ce-9a45-17373a803aef admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:51.135029 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e1ddae-8f6f-4af0-a750-4fc357e2efe3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:51.135625 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1ddae-8f6f-4af0-a750-4fc357e2efe3 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:51.135894 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1ddae-8f6f-4af0-a750-4fc357e2efe3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:51.136163 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1ddae-8f6f-4af0-a750-4fc357e2efe3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:51.145394 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e1ddae-8f6f-4af0-a750-4fc357e2efe3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:51.146918 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e1ddae-8f6f-4af0-a750-4fc357e2efe3 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:51.158248 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1266/2516] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:31:51 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:31:51.204200 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fec49-8e1f-429d-a540-3445f561b1ad None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:51.205802 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-545fec49-8e1f-429d-a540-3445f561b1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:51.219972 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fec49-8e1f-429d-a540-3445f561b1ad None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:51.224032 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e5175-abd9-4f8f-911d-f61d9c0c917a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:51.224643 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e5175-abd9-4f8f-911d-f61d9c0c917a service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:51.224918 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e5175-abd9-4f8f-911d-f61d9c0c917a service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:51.225182 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e5175-abd9-4f8f-911d-f61d9c0c917a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:51.272581 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:31:51.287632 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e5175-abd9-4f8f-911d-f61d9c0c917a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:51.289128 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e5175-abd9-4f8f-911d-f61d9c0c917a service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:51.299801 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1251/2517] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:31:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:31:54.252876 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e1ddae-8f6f-4af0-a750-4fc357e2efe3 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:54.315472 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e1ddae-8f6f-4af0-a750-4fc357e2efe3 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:54.320405 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc00ba-7658-4d22-b567-6194991f88b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:54.321039 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc00ba-7658-4d22-b567-6194991f88b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:54.321313 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc00ba-7658-4d22-b567-6194991f88b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:54.321610 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc00ba-7658-4d22-b567-6194991f88b5 admin admin] PATH_INFO: `/v3/users/9d677d4296264d3fa4a9c948ae1ea1df` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:54.322754 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc00ba-7658-4d22-b567-6194991f88b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d677d4296264d3fa4a9c948ae1ea1df)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:54.324666 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc00ba-7658-4d22-b567-6194991f88b5 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:54.366601 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:31:54.380386 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-91fc00ba-7658-4d22-b567-6194991f88b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d677d4296264d3fa4a9c948ae1ea1df'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:54.381070 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-91fc00ba-7658-4d22-b567-6194991f88b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d677d4296264d3fa4a9c948ae1ea1df'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:54.387937 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-91fc00ba-7658-4d22-b567-6194991f88b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d677d4296264d3fa4a9c948ae1ea1df'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:54.401407 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-91fc00ba-7658-4d22-b567-6194991f88b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d677d4296264d3fa4a9c948ae1ea1df'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:54.402167 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-91fc00ba-7658-4d22-b567-6194991f88b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d677d4296264d3fa4a9c948ae1ea1df'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:54.417126 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1267/2518] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:31:54 2022] DELETE /identity/v3/users/9d677d4296264d3fa4a9c948ae1ea1df => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:31:54.421854 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0b0de-3f5b-4d35-8712-1058e849d503 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:54.422343 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0b0de-3f5b-4d35-8712-1058e849d503 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:54.422439 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0b0de-3f5b-4d35-8712-1058e849d503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:54.441878 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-70f0b0de-3f5b-4d35-8712-1058e849d503 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:31:54.443235 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-70f0b0de-3f5b-4d35-8712-1058e849d503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:54.503711 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1252/2519] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:31:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:31:54.514064 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc00ba-7658-4d22-b567-6194991f88b5 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:54.515931 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-91fc00ba-7658-4d22-b567-6194991f88b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:54.576414 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc00ba-7658-4d22-b567-6194991f88b5 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:54.581387 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a4111-ae22-4ff2-951d-65dd8ebbf6c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:54.582050 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a4111-ae22-4ff2-951d-65dd8ebbf6c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:54.582325 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a4111-ae22-4ff2-951d-65dd8ebbf6c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:54.582602 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a4111-ae22-4ff2-951d-65dd8ebbf6c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:54.593066 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a4111-ae22-4ff2-951d-65dd8ebbf6c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:54.594526 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a4111-ae22-4ff2-951d-65dd8ebbf6c0 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:54.604408 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1268/2520] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:31:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:31:54.879423 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0b0de-3f5b-4d35-8712-1058e849d503 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:54.881462 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-70f0b0de-3f5b-4d35-8712-1058e849d503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:54.898048 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0b0de-3f5b-4d35-8712-1058e849d503 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:54.902994 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f1e66-922e-41d6-b573-01f70c9b4570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:54.903642 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f1e66-922e-41d6-b573-01f70c9b4570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:54.904046 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f1e66-922e-41d6-b573-01f70c9b4570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:54.904315 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f1e66-922e-41d6-b573-01f70c9b4570 admin admin] PATH_INFO: `/v3/projects/4c0b91cfe22b448ea40e106214f37223` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:54.905677 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f1e66-922e-41d6-b573-01f70c9b4570 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c0b91cfe22b448ea40e106214f37223)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:54.907613 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f1e66-922e-41d6-b573-01f70c9b4570 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:54.956682 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5c3f1e66-922e-41d6-b573-01f70c9b4570 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c0b91cfe22b448ea40e106214f37223', 'request_id': 'req-5c3f1e66-922e-41d6-b573-01f70c9b4570'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:54.965638 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5c3f1e66-922e-41d6-b573-01f70c9b4570 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c0b91cfe22b448ea40e106214f37223', 'request_id': 'req-5c3f1e66-922e-41d6-b573-01f70c9b4570'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:54.975762 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5c3f1e66-922e-41d6-b573-01f70c9b4570 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c0b91cfe22b448ea40e106214f37223', 'request_id': 'req-5c3f1e66-922e-41d6-b573-01f70c9b4570'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:54.991521 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5c3f1e66-922e-41d6-b573-01f70c9b4570 admin admin] The token cache is being invalidate because project 4c0b91cfe22b448ea40e106214f37223 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:31:54.991802 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5c3f1e66-922e-41d6-b573-01f70c9b4570 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:54.992507 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5c3f1e66-922e-41d6-b573-01f70c9b4570 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:54.994054 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1253/2521] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:31:54 2022] DELETE /identity/v3/projects/4c0b91cfe22b448ea40e106214f37223 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:31:54.998189 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a4111-ae22-4ff2-951d-65dd8ebbf6c0 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:55.008134 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a4111-ae22-4ff2-951d-65dd8ebbf6c0 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:55.067045 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197190ce-afd9-4702-9a59-a8d13107a3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:55.067715 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197190ce-afd9-4702-9a59-a8d13107a3ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:55.067990 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197190ce-afd9-4702-9a59-a8d13107a3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:55.068257 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197190ce-afd9-4702-9a59-a8d13107a3ee admin admin] PATH_INFO: `/v3/users/2c7ad3ff7203445e83857e8ecdd5adf6` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:55.069377 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197190ce-afd9-4702-9a59-a8d13107a3ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c7ad3ff7203445e83857e8ecdd5adf6)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:55.071318 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197190ce-afd9-4702-9a59-a8d13107a3ee admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:55.119320 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-197190ce-afd9-4702-9a59-a8d13107a3ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c7ad3ff7203445e83857e8ecdd5adf6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:55.120049 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-197190ce-afd9-4702-9a59-a8d13107a3ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c7ad3ff7203445e83857e8ecdd5adf6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:55.125834 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:31:55.127971 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-197190ce-afd9-4702-9a59-a8d13107a3ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c7ad3ff7203445e83857e8ecdd5adf6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:55.141900 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-197190ce-afd9-4702-9a59-a8d13107a3ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c7ad3ff7203445e83857e8ecdd5adf6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:55.142559 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-197190ce-afd9-4702-9a59-a8d13107a3ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c7ad3ff7203445e83857e8ecdd5adf6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:55.156249 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1269/2522] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:31:54 2022] DELETE /identity/v3/users/2c7ad3ff7203445e83857e8ecdd5adf6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:31:55.456958 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f1e66-922e-41d6-b573-01f70c9b4570 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:55.459067 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5c3f1e66-922e-41d6-b573-01f70c9b4570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:55.473956 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f1e66-922e-41d6-b573-01f70c9b4570 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:55.535807 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2f6b37-5172-46be-b3ad-4e367890893a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:55.536411 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f6b37-5172-46be-b3ad-4e367890893a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:55.536688 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f6b37-5172-46be-b3ad-4e367890893a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:55.536972 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f6b37-5172-46be-b3ad-4e367890893a admin admin] PATH_INFO: `/v3/projects/8ceb252d371d4a6b985bb1240499284a` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:55.538227 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2f6b37-5172-46be-b3ad-4e367890893a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ceb252d371d4a6b985bb1240499284a)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:55.540147 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2f6b37-5172-46be-b3ad-4e367890893a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:55.551546 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:31:55.598580 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ce2f6b37-5172-46be-b3ad-4e367890893a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ceb252d371d4a6b985bb1240499284a', 'request_id': 'req-ce2f6b37-5172-46be-b3ad-4e367890893a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:55.609214 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ce2f6b37-5172-46be-b3ad-4e367890893a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ceb252d371d4a6b985bb1240499284a', 'request_id': 'req-ce2f6b37-5172-46be-b3ad-4e367890893a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:55.616086 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ce2f6b37-5172-46be-b3ad-4e367890893a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ceb252d371d4a6b985bb1240499284a', 'request_id': 'req-ce2f6b37-5172-46be-b3ad-4e367890893a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:55.626569 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ce2f6b37-5172-46be-b3ad-4e367890893a admin admin] The token cache is being invalidate because project 8ceb252d371d4a6b985bb1240499284a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:31:55.626852 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ce2f6b37-5172-46be-b3ad-4e367890893a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:55.627504 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ce2f6b37-5172-46be-b3ad-4e367890893a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:55.629140 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1254/2523] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:31:55 2022] DELETE /identity/v3/projects/8ceb252d371d4a6b985bb1240499284a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:31:55.633485 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197190ce-afd9-4702-9a59-a8d13107a3ee admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:55.635414 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-197190ce-afd9-4702-9a59-a8d13107a3ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:55.648739 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197190ce-afd9-4702-9a59-a8d13107a3ee admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:55.710676 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb901fca-9521-44b0-a5a5-b1434db221d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:55.711300 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb901fca-9521-44b0-a5a5-b1434db221d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:55.711579 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb901fca-9521-44b0-a5a5-b1434db221d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:55.711851 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb901fca-9521-44b0-a5a5-b1434db221d9 admin admin] PATH_INFO: `/v3/users/14bbb86fbb8d40dead6daf0c7ab30382` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:55.713086 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb901fca-9521-44b0-a5a5-b1434db221d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14bbb86fbb8d40dead6daf0c7ab30382)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:55.715044 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb901fca-9521-44b0-a5a5-b1434db221d9 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:55.766430 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-eb901fca-9521-44b0-a5a5-b1434db221d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14bbb86fbb8d40dead6daf0c7ab30382'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:55.767070 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-eb901fca-9521-44b0-a5a5-b1434db221d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14bbb86fbb8d40dead6daf0c7ab30382'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:55.773963 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-eb901fca-9521-44b0-a5a5-b1434db221d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14bbb86fbb8d40dead6daf0c7ab30382'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:55.786343 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-eb901fca-9521-44b0-a5a5-b1434db221d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14bbb86fbb8d40dead6daf0c7ab30382'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:55.786975 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-eb901fca-9521-44b0-a5a5-b1434db221d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14bbb86fbb8d40dead6daf0c7ab30382'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:55.799899 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1270/2524] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:31:55 2022] DELETE /identity/v3/users/14bbb86fbb8d40dead6daf0c7ab30382 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:31:56.099847 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2f6b37-5172-46be-b3ad-4e367890893a admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:56.101475 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ce2f6b37-5172-46be-b3ad-4e367890893a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:56.116097 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2f6b37-5172-46be-b3ad-4e367890893a admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:56.173460 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd0459-5295-4cc7-aa31-34be704cf9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:56.174116 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd0459-5295-4cc7-aa31-34be704cf9a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:56.174394 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd0459-5295-4cc7-aa31-34be704cf9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:56.174665 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd0459-5295-4cc7-aa31-34be704cf9a4 admin admin] PATH_INFO: `/v3/projects/6687f5d6e438497da06910aa8d4f4ba5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:56.175805 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbd0459-5295-4cc7-aa31-34be704cf9a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6687f5d6e438497da06910aa8d4f4ba5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:56.178085 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbd0459-5295-4cc7-aa31-34be704cf9a4 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:56.226805 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0cbd0459-5295-4cc7-aa31-34be704cf9a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6687f5d6e438497da06910aa8d4f4ba5', 'request_id': 'req-0cbd0459-5295-4cc7-aa31-34be704cf9a4'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:56.237643 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0cbd0459-5295-4cc7-aa31-34be704cf9a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6687f5d6e438497da06910aa8d4f4ba5', 'request_id': 'req-0cbd0459-5295-4cc7-aa31-34be704cf9a4'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:56.244365 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0cbd0459-5295-4cc7-aa31-34be704cf9a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6687f5d6e438497da06910aa8d4f4ba5', 'request_id': 'req-0cbd0459-5295-4cc7-aa31-34be704cf9a4'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:56.257422 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0cbd0459-5295-4cc7-aa31-34be704cf9a4 admin admin] The token cache is being invalidate because project 6687f5d6e438497da06910aa8d4f4ba5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:31:56.257864 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0cbd0459-5295-4cc7-aa31-34be704cf9a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:56.258889 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0cbd0459-5295-4cc7-aa31-34be704cf9a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:31:56.261088 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1255/2525] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:31:56 2022] DELETE /identity/v3/projects/6687f5d6e438497da06910aa8d4f4ba5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:31:56.267319 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a07bf-87fe-42ea-9875-30363089c8d3 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:56.267600 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a07bf-87fe-42ea-9875-30363089c8d3 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:56.268229 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a07bf-87fe-42ea-9875-30363089c8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:56.289907 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-005a07bf-87fe-42ea-9875-30363089c8d3 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:31:56.291176 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-005a07bf-87fe-42ea-9875-30363089c8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:56.338284 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:31:56.354720 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1271/2526] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:31:56.363435 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fb164-6b93-441c-8483-3517dd4bcee4 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:56.363753 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fb164-6b93-441c-8483-3517dd4bcee4 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:56.364023 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fb164-6b93-441c-8483-3517dd4bcee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:56.384713 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-c08fb164-6b93-441c-8483-3517dd4bcee4 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:31:56.385956 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c08fb164-6b93-441c-8483-3517dd4bcee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:56.394260 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1256/2527] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:31:56.398625 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a07bf-87fe-42ea-9875-30363089c8d3 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:56.410977 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a07bf-87fe-42ea-9875-30363089c8d3 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:56.418880 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01673d31-375e-4251-9ee0-2c68429bc9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:56.419728 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01673d31-375e-4251-9ee0-2c68429bc9e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:56.420102 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01673d31-375e-4251-9ee0-2c68429bc9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:56.420413 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01673d31-375e-4251-9ee0-2c68429bc9e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:56.421353 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01673d31-375e-4251-9ee0-2c68429bc9e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:31:56.421772 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01673d31-375e-4251-9ee0-2c68429bc9e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:56.424284 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01673d31-375e-4251-9ee0-2c68429bc9e3 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:56.437415 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1272/2528] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:31:56.442848 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08fb164-6b93-441c-8483-3517dd4bcee4 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:56.452387 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08fb164-6b93-441c-8483-3517dd4bcee4 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:56.457970 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68d238-bd5e-4be0-b4d2-3075acbb70e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:56.458813 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68d238-bd5e-4be0-b4d2-3075acbb70e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:56.459216 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68d238-bd5e-4be0-b4d2-3075acbb70e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:56.459492 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68d238-bd5e-4be0-b4d2-3075acbb70e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:56.460143 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e68d238-bd5e-4be0-b4d2-3075acbb70e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:56.462095 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e68d238-bd5e-4be0-b4d2-3075acbb70e5 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:56.493669 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1257/2529] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:31:56 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:31:56.498291 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01673d31-375e-4251-9ee0-2c68429bc9e3 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:56.510009 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01673d31-375e-4251-9ee0-2c68429bc9e3 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:56.568944 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4e455-fe66-43da-b97f-33c7cb3e44df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:56.569564 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4e455-fe66-43da-b97f-33c7cb3e44df admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:56.569848 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4e455-fe66-43da-b97f-33c7cb3e44df admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:56.570114 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4e455-fe66-43da-b97f-33c7cb3e44df admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:56.570731 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f4e455-fe66-43da-b97f-33c7cb3e44df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:56.572644 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f4e455-fe66-43da-b97f-33c7cb3e44df admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:56.595852 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1273/2530] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:31:56 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:31:56.600227 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68d238-bd5e-4be0-b4d2-3075acbb70e5 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:56.605976 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:31:56.612329 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68d238-bd5e-4be0-b4d2-3075acbb70e5 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:56.618064 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b3ed0-382d-4476-94c3-8840f58199ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:56.618653 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b3ed0-382d-4476-94c3-8840f58199ed admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:56.618926 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b3ed0-382d-4476-94c3-8840f58199ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:56.619192 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b3ed0-382d-4476-94c3-8840f58199ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:56.619844 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3b3ed0-382d-4476-94c3-8840f58199ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:56.621469 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3b3ed0-382d-4476-94c3-8840f58199ed admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:56.631527 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1258/2531] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:31:56.635843 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4e455-fe66-43da-b97f-33c7cb3e44df admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:56.646593 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4e455-fe66-43da-b97f-33c7cb3e44df admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:56.651714 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f7e115-95df-4d39-94d1-d54aba6ed0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:56.652297 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7e115-95df-4d39-94d1-d54aba6ed0ea admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:56.652568 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7e115-95df-4d39-94d1-d54aba6ed0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:56.652833 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7e115-95df-4d39-94d1-d54aba6ed0ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:56.653522 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f7e115-95df-4d39-94d1-d54aba6ed0ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:56.655183 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f7e115-95df-4d39-94d1-d54aba6ed0ea admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:56.667030 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1274/2532] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:31:56.672655 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b3ed0-382d-4476-94c3-8840f58199ed admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:56.683893 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b3ed0-382d-4476-94c3-8840f58199ed admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:56.690280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c86f3-a278-4687-bb4f-28db15012d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:56.690939 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c86f3-a278-4687-bb4f-28db15012d42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:56.691218 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c86f3-a278-4687-bb4f-28db15012d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:56.691490 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c86f3-a278-4687-bb4f-28db15012d42 admin admin] PATH_INFO: `/v3/projects/088e7a1233764132bc4c45cf8064704c/users/51d6622361c849ec9a60eb2c3b78566c/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:56.707069 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c86f3-a278-4687-bb4f-28db15012d42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=088e7a1233764132bc4c45cf8064704c, user_id=51d6622361c849ec9a60eb2c3b78566c, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:56.709925 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c86f3-a278-4687-bb4f-28db15012d42 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:56.725174 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1259/2533] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:31:56 2022] PUT /identity/v3/projects/088e7a1233764132bc4c45cf8064704c/users/51d6622361c849ec9a60eb2c3b78566c/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:31:56.737895 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb8cee-65c9-422c-b156-d41d7d5fe77a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:56.738191 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb8cee-65c9-422c-b156-d41d7d5fe77a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:56.738456 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb8cee-65c9-422c-b156-d41d7d5fe77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:56.770015 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-55fb8cee-65c9-422c-b156-d41d7d5fe77a None None] MFA Rules not processed for user `51d6622361c849ec9a60eb2c3b78566c`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:31:56.771409 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-55fb8cee-65c9-422c-b156-d41d7d5fe77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:56.850040 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1275/2534] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:31:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:31:56.861878 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c86f3-a278-4687-bb4f-28db15012d42 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:31:56.864036 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-db2c86f3-a278-4687-bb4f-28db15012d42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:31:56.924060 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c86f3-a278-4687-bb4f-28db15012d42 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:31:56.928152 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c469062-e4ca-47f7-9082-bce13f8498f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:31:56.928761 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c469062-e4ca-47f7-9082-bce13f8498f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:31:56.929032 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c469062-e4ca-47f7-9082-bce13f8498f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:31:56.929296 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c469062-e4ca-47f7-9082-bce13f8498f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:31:56.938162 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c469062-e4ca-47f7-9082-bce13f8498f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:31:56.940259 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c469062-e4ca-47f7-9082-bce13f8498f7 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:31:56.949260 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1260/2535] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:31:56 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:32:02.380694 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb8cee-65c9-422c-b156-d41d7d5fe77a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:32:02.435101 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:32:02.452592 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb8cee-65c9-422c-b156-d41d7d5fe77a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:32:02.457444 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439e904-a91a-4eb0-98ce-585db088333e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:32:02.458098 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439e904-a91a-4eb0-98ce-585db088333e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:32:02.458654 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439e904-a91a-4eb0-98ce-585db088333e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:32:02.458919 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439e904-a91a-4eb0-98ce-585db088333e admin admin] PATH_INFO: `/v3/users/51d6622361c849ec9a60eb2c3b78566c` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:32:02.460051 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4439e904-a91a-4eb0-98ce-585db088333e admin admin] RBAC: Authorizing `identity:delete_user(user_id=51d6622361c849ec9a60eb2c3b78566c)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:32:02.461997 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4439e904-a91a-4eb0-98ce-585db088333e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:32:02.511209 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4439e904-a91a-4eb0-98ce-585db088333e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51d6622361c849ec9a60eb2c3b78566c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:32:02.511847 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4439e904-a91a-4eb0-98ce-585db088333e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51d6622361c849ec9a60eb2c3b78566c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:32:02.519162 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4439e904-a91a-4eb0-98ce-585db088333e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51d6622361c849ec9a60eb2c3b78566c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:32:02.532360 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4439e904-a91a-4eb0-98ce-585db088333e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51d6622361c849ec9a60eb2c3b78566c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:32:02.533017 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4439e904-a91a-4eb0-98ce-585db088333e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51d6622361c849ec9a60eb2c3b78566c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:32:02.547783 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1276/2536] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:32:02 2022] DELETE /identity/v3/users/51d6622361c849ec9a60eb2c3b78566c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:32:02.552437 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2335470-8269-40de-9965-fab6edee3c93 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:32:02.552938 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2335470-8269-40de-9965-fab6edee3c93 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:32:02.552938 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2335470-8269-40de-9965-fab6edee3c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:32:02.572896 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-a2335470-8269-40de-9965-fab6edee3c93 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:32:02.574111 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a2335470-8269-40de-9965-fab6edee3c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:32:02.635510 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1261/2537] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:32:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:32:02.645208 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439e904-a91a-4eb0-98ce-585db088333e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:32:02.646619 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4439e904-a91a-4eb0-98ce-585db088333e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:32:02.708129 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439e904-a91a-4eb0-98ce-585db088333e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:32:02.712336 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6cedba-296b-4c2f-93a2-81d3925fb220 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:32:02.712939 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cedba-296b-4c2f-93a2-81d3925fb220 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:32:02.713214 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cedba-296b-4c2f-93a2-81d3925fb220 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:32:02.713481 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cedba-296b-4c2f-93a2-81d3925fb220 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:32:02.724030 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6cedba-296b-4c2f-93a2-81d3925fb220 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:32:02.725600 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6cedba-296b-4c2f-93a2-81d3925fb220 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:32:02.735608 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1277/2538] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:32:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:32:03.008305 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2335470-8269-40de-9965-fab6edee3c93 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:32:03.009859 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a2335470-8269-40de-9965-fab6edee3c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:32:03.022361 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2335470-8269-40de-9965-fab6edee3c93 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:32:03.027369 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6812f-3571-4b67-b6f6-ea565db439fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:32:03.028073 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6812f-3571-4b67-b6f6-ea565db439fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:32:03.028417 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6812f-3571-4b67-b6f6-ea565db439fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:32:03.029352 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6812f-3571-4b67-b6f6-ea565db439fe admin admin] PATH_INFO: `/v3/projects/088e7a1233764132bc4c45cf8064704c` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:32:03.031012 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6812f-3571-4b67-b6f6-ea565db439fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=088e7a1233764132bc4c45cf8064704c)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:32:03.032727 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6812f-3571-4b67-b6f6-ea565db439fe admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:32:03.083996 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9ae6812f-3571-4b67-b6f6-ea565db439fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '088e7a1233764132bc4c45cf8064704c', 'request_id': 'req-9ae6812f-3571-4b67-b6f6-ea565db439fe'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:32:03.091617 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9ae6812f-3571-4b67-b6f6-ea565db439fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '088e7a1233764132bc4c45cf8064704c', 'request_id': 'req-9ae6812f-3571-4b67-b6f6-ea565db439fe'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:32:03.098269 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9ae6812f-3571-4b67-b6f6-ea565db439fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '088e7a1233764132bc4c45cf8064704c', 'request_id': 'req-9ae6812f-3571-4b67-b6f6-ea565db439fe'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:32:03.102452 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:32:03.110518 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9ae6812f-3571-4b67-b6f6-ea565db439fe admin admin] The token cache is being invalidate because project 088e7a1233764132bc4c45cf8064704c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:32:03.110984 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9ae6812f-3571-4b67-b6f6-ea565db439fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:32:03.112260 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9ae6812f-3571-4b67-b6f6-ea565db439fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:32:03.113840 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1262/2539] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:32:03 2022] DELETE /identity/v3/projects/088e7a1233764132bc4c45cf8064704c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:32:03.119705 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf56f4c-4833-45c0-89eb-874e6128b0ef None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:32:03.120022 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf56f4c-4833-45c0-89eb-874e6128b0ef None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:32:03.120298 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf56f4c-4833-45c0-89eb-874e6128b0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:32:03.141008 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-dcf56f4c-4833-45c0-89eb-874e6128b0ef None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:32:03.142243 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-dcf56f4c-4833-45c0-89eb-874e6128b0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:32:03.203247 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1278/2540] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:32:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:32:03.211268 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a43534-6406-4b4f-9b8e-5bee74646c34 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:32:03.211536 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a43534-6406-4b4f-9b8e-5bee74646c34 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:32:03.211820 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a43534-6406-4b4f-9b8e-5bee74646c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:32:03.231734 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-74a43534-6406-4b4f-9b8e-5bee74646c34 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:32:03.232945 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-74a43534-6406-4b4f-9b8e-5bee74646c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:32:03.241201 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1263/2541] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:32:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:32:03.245573 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf56f4c-4833-45c0-89eb-874e6128b0ef None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:32:03.256249 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf56f4c-4833-45c0-89eb-874e6128b0ef None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:32:03.261874 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d32b9-411d-43c6-be4a-7bafd21fbea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:32:03.262460 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d32b9-411d-43c6-be4a-7bafd21fbea2 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:32:03.262732 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d32b9-411d-43c6-be4a-7bafd21fbea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:32:03.262996 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d32b9-411d-43c6-be4a-7bafd21fbea2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:32:03.263607 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d32b9-411d-43c6-be4a-7bafd21fbea2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:32:03.263904 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d32b9-411d-43c6-be4a-7bafd21fbea2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:32:03.265490 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d32b9-411d-43c6-be4a-7bafd21fbea2 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:32:03.267924 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:32:03.277768 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1279/2542] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:32:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:32:03.282040 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a43534-6406-4b4f-9b8e-5bee74646c34 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:32:03.291432 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a43534-6406-4b4f-9b8e-5bee74646c34 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:32:03.296249 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab5dfc-d315-4f53-b0ed-b653fb28a511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:32:03.296837 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab5dfc-d315-4f53-b0ed-b653fb28a511 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:32:03.297106 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab5dfc-d315-4f53-b0ed-b653fb28a511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:32:03.297374 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab5dfc-d315-4f53-b0ed-b653fb28a511 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:32:03.298039 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dab5dfc-d315-4f53-b0ed-b653fb28a511 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:32:03.299960 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dab5dfc-d315-4f53-b0ed-b653fb28a511 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:32:03.329998 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1264/2543] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:32:03 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:32:03.334262 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d32b9-411d-43c6-be4a-7bafd21fbea2 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:32:03.344499 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d32b9-411d-43c6-be4a-7bafd21fbea2 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:32:03.402569 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384199c-c0fd-4d63-a16d-cacad709e558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:32:03.403290 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384199c-c0fd-4d63-a16d-cacad709e558 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:32:03.403405 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384199c-c0fd-4d63-a16d-cacad709e558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:32:03.403705 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384199c-c0fd-4d63-a16d-cacad709e558 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:32:03.404333 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3384199c-c0fd-4d63-a16d-cacad709e558 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:32:03.406284 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3384199c-c0fd-4d63-a16d-cacad709e558 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:32:03.428363 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1280/2544] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:32:03 2022] POST /identity/v3/users => generated 285 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:32:03.432668 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab5dfc-d315-4f53-b0ed-b653fb28a511 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:32:03.443635 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab5dfc-d315-4f53-b0ed-b653fb28a511 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:32:03.448443 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b4970-12a3-4ae1-aa17-bcd3a2626ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:32:03.449036 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b4970-12a3-4ae1-aa17-bcd3a2626ffc admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:32:03.449312 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b4970-12a3-4ae1-aa17-bcd3a2626ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:32:03.449618 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b4970-12a3-4ae1-aa17-bcd3a2626ffc admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:32:03.450280 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b4970-12a3-4ae1-aa17-bcd3a2626ffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:32:03.451870 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b4970-12a3-4ae1-aa17-bcd3a2626ffc admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:32:03.461959 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1265/2545] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 13:32:03.465794 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384199c-c0fd-4d63-a16d-cacad709e558 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:32:03.475988 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384199c-c0fd-4d63-a16d-cacad709e558 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:32:03.480990 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cdb042-f8ce-4c07-ad6f-12ff520d0dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:32:03.481620 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cdb042-f8ce-4c07-ad6f-12ff520d0dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:32:03.481899 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cdb042-f8ce-4c07-ad6f-12ff520d0dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:32:03.482169 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cdb042-f8ce-4c07-ad6f-12ff520d0dc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:32:03.482801 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cdb042-f8ce-4c07-ad6f-12ff520d0dc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:32:03.484380 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cdb042-f8ce-4c07-ad6f-12ff520d0dc6 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:32:03.495054 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1281/2546] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 13:32:03.499238 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b4970-12a3-4ae1-aa17-bcd3a2626ffc admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:32:03.509855 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b4970-12a3-4ae1-aa17-bcd3a2626ffc admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:32:03.515111 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b460c9-da4f-47ae-8986-7d634d917395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:32:03.515761 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b460c9-da4f-47ae-8986-7d634d917395 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:32:03.516046 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b460c9-da4f-47ae-8986-7d634d917395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:32:03.516289 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b460c9-da4f-47ae-8986-7d634d917395 admin admin] PATH_INFO: `/v3/projects/b02659bcff4e4e7d94f605f1ba987eda/users/bb96da3fdf6d42a3942d9f4bab0a429c/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:32:03.531174 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b460c9-da4f-47ae-8986-7d634d917395 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b02659bcff4e4e7d94f605f1ba987eda, user_id=bb96da3fdf6d42a3942d9f4bab0a429c, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:32:03.533846 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b460c9-da4f-47ae-8986-7d634d917395 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:32:03.548904 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1266/2547] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:32:03 2022] PUT /identity/v3/projects/b02659bcff4e4e7d94f605f1ba987eda/users/bb96da3fdf6d42a3942d9f4bab0a429c/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:32:03.560198 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee507d-8ec7-4f4d-83e6-9e19a80587d3 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:32:03.560517 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee507d-8ec7-4f4d-83e6-9e19a80587d3 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:32:03.560862 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee507d-8ec7-4f4d-83e6-9e19a80587d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:32:03.592703 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-93ee507d-8ec7-4f4d-83e6-9e19a80587d3 None None] MFA Rules not processed for user `bb96da3fdf6d42a3942d9f4bab0a429c`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:32:03.593952 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-93ee507d-8ec7-4f4d-83e6-9e19a80587d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:32:03.663703 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1282/2548] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:32:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:32:03.676783 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b460c9-da4f-47ae-8986-7d634d917395 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:32:03.678623 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c2b460c9-da4f-47ae-8986-7d634d917395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:32:03.737787 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b460c9-da4f-47ae-8986-7d634d917395 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:32:03.742102 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18cbc44-85fd-4f02-b466-ef7af74c06cb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2298dbfcf7b74668902781401f77215e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:32:03.742701 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18cbc44-85fd-4f02-b466-ef7af74c06cb service glance] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:32:03.742976 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18cbc44-85fd-4f02-b466-ef7af74c06cb service glance] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:32:03.743247 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18cbc44-85fd-4f02-b466-ef7af74c06cb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:32:03.752005 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18cbc44-85fd-4f02-b466-ef7af74c06cb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:32:03.753432 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18cbc44-85fd-4f02-b466-ef7af74c06cb service glance] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:32:03.762517 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1267/2549] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:32:03 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:32:13.660171 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=68,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:32:13.758348 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:DELETE=1,keystone:SELECT=55,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:32:30.042411 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee507d-8ec7-4f4d-83e6-9e19a80587d3 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:32:30.108051 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee507d-8ec7-4f4d-83e6-9e19a80587d3 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:32:30.113718 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004eb55e-68eb-45ef-aa3f-123cde29e2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:32:30.114380 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004eb55e-68eb-45ef-aa3f-123cde29e2d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:32:30.114733 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004eb55e-68eb-45ef-aa3f-123cde29e2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:32:30.115009 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004eb55e-68eb-45ef-aa3f-123cde29e2d3 admin admin] PATH_INFO: `/v3/users/bb96da3fdf6d42a3942d9f4bab0a429c` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:32:30.116308 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004eb55e-68eb-45ef-aa3f-123cde29e2d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb96da3fdf6d42a3942d9f4bab0a429c)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:32:30.118350 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004eb55e-68eb-45ef-aa3f-123cde29e2d3 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:32:30.168863 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-004eb55e-68eb-45ef-aa3f-123cde29e2d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb96da3fdf6d42a3942d9f4bab0a429c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:32:30.169572 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-004eb55e-68eb-45ef-aa3f-123cde29e2d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb96da3fdf6d42a3942d9f4bab0a429c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:32:30.176514 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-004eb55e-68eb-45ef-aa3f-123cde29e2d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb96da3fdf6d42a3942d9f4bab0a429c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:32:30.189565 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-004eb55e-68eb-45ef-aa3f-123cde29e2d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb96da3fdf6d42a3942d9f4bab0a429c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:32:30.190238 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-004eb55e-68eb-45ef-aa3f-123cde29e2d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb96da3fdf6d42a3942d9f4bab0a429c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:32:30.206527 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1283/2550] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:32:30 2022] DELETE /identity/v3/users/bb96da3fdf6d42a3942d9f4bab0a429c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:32:30.211239 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f24e5-73e4-4601-a68b-c3a55ef5e086 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:32:30.211779 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f24e5-73e4-4601-a68b-c3a55ef5e086 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:32:30.211893 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f24e5-73e4-4601-a68b-c3a55ef5e086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:32:30.231936 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-982f24e5-73e4-4601-a68b-c3a55ef5e086 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:32:30.233285 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-982f24e5-73e4-4601-a68b-c3a55ef5e086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:32:30.297108 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1268/2551] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:32:30.307167 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004eb55e-68eb-45ef-aa3f-123cde29e2d3 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:32:30.308596 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-004eb55e-68eb-45ef-aa3f-123cde29e2d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:32:30.367979 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004eb55e-68eb-45ef-aa3f-123cde29e2d3 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:32:30.372307 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf04d698-dcc5-44d1-9825-73079768c899 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:32:30.372902 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04d698-dcc5-44d1-9825-73079768c899 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:32:30.373206 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04d698-dcc5-44d1-9825-73079768c899 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:32:30.373474 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04d698-dcc5-44d1-9825-73079768c899 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:32:30.383627 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf04d698-dcc5-44d1-9825-73079768c899 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:32:30.385058 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf04d698-dcc5-44d1-9825-73079768c899 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:32:30.394716 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1284/2552] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:32:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:32:30.678058 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f24e5-73e4-4601-a68b-c3a55ef5e086 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:32:30.679513 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-982f24e5-73e4-4601-a68b-c3a55ef5e086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:32:30.691465 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f24e5-73e4-4601-a68b-c3a55ef5e086 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:32:30.696778 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca9b82b-0f08-488a-ac6d-39f3ad76d989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:32:30.697468 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9b82b-0f08-488a-ac6d-39f3ad76d989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:32:30.697784 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9b82b-0f08-488a-ac6d-39f3ad76d989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:32:30.698054 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9b82b-0f08-488a-ac6d-39f3ad76d989 admin admin] PATH_INFO: `/v3/projects/b02659bcff4e4e7d94f605f1ba987eda` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:32:30.699163 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca9b82b-0f08-488a-ac6d-39f3ad76d989 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b02659bcff4e4e7d94f605f1ba987eda)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:32:30.701073 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca9b82b-0f08-488a-ac6d-39f3ad76d989 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:32:30.754399 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4ca9b82b-0f08-488a-ac6d-39f3ad76d989 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b02659bcff4e4e7d94f605f1ba987eda', 'request_id': 'req-4ca9b82b-0f08-488a-ac6d-39f3ad76d989'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:32:30.762849 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4ca9b82b-0f08-488a-ac6d-39f3ad76d989 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b02659bcff4e4e7d94f605f1ba987eda', 'request_id': 'req-4ca9b82b-0f08-488a-ac6d-39f3ad76d989'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:32:30.769506 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4ca9b82b-0f08-488a-ac6d-39f3ad76d989 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b02659bcff4e4e7d94f605f1ba987eda', 'request_id': 'req-4ca9b82b-0f08-488a-ac6d-39f3ad76d989'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:32:30.779968 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4ca9b82b-0f08-488a-ac6d-39f3ad76d989 admin admin] The token cache is being invalidate because project b02659bcff4e4e7d94f605f1ba987eda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:32:30.780253 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4ca9b82b-0f08-488a-ac6d-39f3ad76d989 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:32:30.780913 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4ca9b82b-0f08-488a-ac6d-39f3ad76d989 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:32:30.782439 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1269/2553] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:32:30 2022] DELETE /identity/v3/projects/b02659bcff4e4e7d94f605f1ba987eda => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:32:30.789827 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f198ad-7620-428b-a07b-f29c1f604b3c None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:32:30.790187 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f198ad-7620-428b-a07b-f29c1f604b3c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:32:30.790459 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f198ad-7620-428b-a07b-f29c1f604b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:32:30.810907 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-74f198ad-7620-428b-a07b-f29c1f604b3c None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:32:30.812178 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-74f198ad-7620-428b-a07b-f29c1f604b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:32:30.829783 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:32:30.875834 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1285/2554] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:32:30.883873 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b11cf4-66ab-40eb-8db5-87b39e051c08 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:32:30.884161 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b11cf4-66ab-40eb-8db5-87b39e051c08 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:32:30.884463 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b11cf4-66ab-40eb-8db5-87b39e051c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:32:30.904923 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-87b11cf4-66ab-40eb-8db5-87b39e051c08 None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:32:30.906145 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-87b11cf4-66ab-40eb-8db5-87b39e051c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:32:30.914408 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1270/2555] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:32:30.918600 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f198ad-7620-428b-a07b-f29c1f604b3c None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:32:30.928310 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f198ad-7620-428b-a07b-f29c1f604b3c None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:32:30.933269 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbc4c5-8ee8-488f-a7eb-ec56d8b65b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:32:30.933892 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbc4c5-8ee8-488f-a7eb-ec56d8b65b63 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:32:30.934163 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbc4c5-8ee8-488f-a7eb-ec56d8b65b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:32:30.934431 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbc4c5-8ee8-488f-a7eb-ec56d8b65b63 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:32:30.935065 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cbc4c5-8ee8-488f-a7eb-ec56d8b65b63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 13:32:30.935363 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cbc4c5-8ee8-488f-a7eb-ec56d8b65b63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:32:30.937015 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cbc4c5-8ee8-488f-a7eb-ec56d8b65b63 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:32:30.949060 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1286/2556] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Oct 27 13:32:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:32:30.953560 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b11cf4-66ab-40eb-8db5-87b39e051c08 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:32:30.962850 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b11cf4-66ab-40eb-8db5-87b39e051c08 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:32:30.968425 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e73a63-6dea-4bc3-a37d-0f024466278f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:32:30.969013 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e73a63-6dea-4bc3-a37d-0f024466278f admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:32:30.969287 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e73a63-6dea-4bc3-a37d-0f024466278f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:32:30.969583 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e73a63-6dea-4bc3-a37d-0f024466278f admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:32:30.970208 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e73a63-6dea-4bc3-a37d-0f024466278f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:32:30.972104 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e73a63-6dea-4bc3-a37d-0f024466278f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:32:31.001996 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1271/2557] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Oct 27 13:32:30 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:32:31.006491 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbc4c5-8ee8-488f-a7eb-ec56d8b65b63 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:32:31.016981 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbc4c5-8ee8-488f-a7eb-ec56d8b65b63 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:32:31.080181 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ed02f-d04b-4936-8fff-571d3a1e4ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:32:31.080845 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ed02f-d04b-4936-8fff-571d3a1e4ac7 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:32:31.081036 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ed02f-d04b-4936-8fff-571d3a1e4ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:32:31.081303 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ed02f-d04b-4936-8fff-571d3a1e4ac7 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:32:31.081974 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ed02f-d04b-4936-8fff-571d3a1e4ac7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:32:31.083872 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ed02f-d04b-4936-8fff-571d3a1e4ac7 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:32:31.107929 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1287/2558] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Oct 27 13:32:31 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:32:31.112312 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e73a63-6dea-4bc3-a37d-0f024466278f admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:32:31.123407 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e73a63-6dea-4bc3-a37d-0f024466278f admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:32:31.128645 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6121fe-34d4-49ec-88fa-7ea1a3b8b929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:32:31.129207 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6121fe-34d4-49ec-88fa-7ea1a3b8b929 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:32:31.129479 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6121fe-34d4-49ec-88fa-7ea1a3b8b929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:32:31.129779 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6121fe-34d4-49ec-88fa-7ea1a3b8b929 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:32:31.130417 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6121fe-34d4-49ec-88fa-7ea1a3b8b929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:32:31.132036 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6121fe-34d4-49ec-88fa-7ea1a3b8b929 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:32:31.142910 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1272/2559] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:32:31.146759 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ed02f-d04b-4936-8fff-571d3a1e4ac7 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:32:31.156752 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ed02f-d04b-4936-8fff-571d3a1e4ac7 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:32:31.161593 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10cfd0f-fc2b-4a57-88b6-5d7da9512faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:32:31.162190 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10cfd0f-fc2b-4a57-88b6-5d7da9512faf admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:32:31.162465 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10cfd0f-fc2b-4a57-88b6-5d7da9512faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:32:31.162738 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10cfd0f-fc2b-4a57-88b6-5d7da9512faf admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:32:31.163368 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10cfd0f-fc2b-4a57-88b6-5d7da9512faf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:32:31.164943 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10cfd0f-fc2b-4a57-88b6-5d7da9512faf admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:32:31.176857 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1288/2560] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Oct 27 13:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:32:31.180960 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6121fe-34d4-49ec-88fa-7ea1a3b8b929 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:32:31.192563 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6121fe-34d4-49ec-88fa-7ea1a3b8b929 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:32:31.199134 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0fa62-a912-4cb8-a670-aae7fffbf441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:32:31.199832 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0fa62-a912-4cb8-a670-aae7fffbf441 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:32:31.200109 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0fa62-a912-4cb8-a670-aae7fffbf441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:32:31.200367 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0fa62-a912-4cb8-a670-aae7fffbf441 admin admin] PATH_INFO: `/v3/projects/c877b47a6167425eb0b271c21ac960c1/users/76ee547fceae4b0db742fc9ca4e8b70d/roles/3a0f9a2e42334ab59845114892813223` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:32:31.215828 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f0fa62-a912-4cb8-a670-aae7fffbf441 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c877b47a6167425eb0b271c21ac960c1, user_id=76ee547fceae4b0db742fc9ca4e8b70d, role_id=3a0f9a2e42334ab59845114892813223)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:32:31.218826 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f0fa62-a912-4cb8-a670-aae7fffbf441 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:32:31.233150 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1273/2561] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Oct 27 13:32:31 2022] PUT /identity/v3/projects/c877b47a6167425eb0b271c21ac960c1/users/76ee547fceae4b0db742fc9ca4e8b70d/roles/3a0f9a2e42334ab59845114892813223 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:32:31.243699 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110431c-03e8-447b-8053-f5dc3b3ae29a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:32:31.243975 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110431c-03e8-447b-8053-f5dc3b3ae29a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:32:31.244250 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110431c-03e8-447b-8053-f5dc3b3ae29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:32:31.273559 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-6110431c-03e8-447b-8053-f5dc3b3ae29a None None] MFA Rules not processed for user `76ee547fceae4b0db742fc9ca4e8b70d`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:32:31.274831 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6110431c-03e8-447b-8053-f5dc3b3ae29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:32:31.341519 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1289/2562] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:32:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:32:31.352623 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0fa62-a912-4cb8-a670-aae7fffbf441 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:32:31.354643 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-19f0fa62-a912-4cb8-a670-aae7fffbf441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:32:31.379035 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:32:31.426684 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0fa62-a912-4cb8-a670-aae7fffbf441 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:32:31.430946 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0a67f-8cf5-43e8-a6f9-837aedba093d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa785d7f18b54de48a0ec78ec8642e17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:32:31.431557 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0a67f-8cf5-43e8-a6f9-837aedba093d service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:32:31.431842 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0a67f-8cf5-43e8-a6f9-837aedba093d service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:32:31.432109 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0a67f-8cf5-43e8-a6f9-837aedba093d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:32:31.441791 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f0a67f-8cf5-43e8-a6f9-837aedba093d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:32:31.443239 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f0a67f-8cf5-43e8-a6f9-837aedba093d service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:32:31.452594 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1274/2563] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:32:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:32:41.338338 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:32:41.448440 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=17 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:32:41.783485 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6110431c-03e8-447b-8053-f5dc3b3ae29a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:32:41.895550 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6110431c-03e8-447b-8053-f5dc3b3ae29a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:32:41.901457 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89e8cd-e904-41bc-9195-48dbbffef08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:32:41.902183 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89e8cd-e904-41bc-9195-48dbbffef08b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:32:41.902460 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89e8cd-e904-41bc-9195-48dbbffef08b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:32:41.902723 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89e8cd-e904-41bc-9195-48dbbffef08b admin admin] PATH_INFO: `/v3/users/76ee547fceae4b0db742fc9ca4e8b70d` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:32:41.903959 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a89e8cd-e904-41bc-9195-48dbbffef08b admin admin] RBAC: Authorizing `identity:delete_user(user_id=76ee547fceae4b0db742fc9ca4e8b70d)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:32:41.906055 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a89e8cd-e904-41bc-9195-48dbbffef08b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:32:41.956994 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0a89e8cd-e904-41bc-9195-48dbbffef08b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76ee547fceae4b0db742fc9ca4e8b70d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:32:41.957681 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0a89e8cd-e904-41bc-9195-48dbbffef08b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76ee547fceae4b0db742fc9ca4e8b70d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:32:41.964775 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0a89e8cd-e904-41bc-9195-48dbbffef08b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76ee547fceae4b0db742fc9ca4e8b70d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:32:41.977429 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0a89e8cd-e904-41bc-9195-48dbbffef08b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76ee547fceae4b0db742fc9ca4e8b70d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:32:41.978180 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0a89e8cd-e904-41bc-9195-48dbbffef08b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76ee547fceae4b0db742fc9ca4e8b70d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:32:41.994329 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1290/2564] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Oct 27 13:32:41 2022] DELETE /identity/v3/users/76ee547fceae4b0db742fc9ca4e8b70d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:32:41.999290 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0f3e3-622e-451f-9830-e2df6a8d1ccd None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:32:41.999510 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0f3e3-622e-451f-9830-e2df6a8d1ccd None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:32:41.999751 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0f3e3-622e-451f-9830-e2df6a8d1ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:32:42.055720 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-33b0f3e3-622e-451f-9830-e2df6a8d1ccd None None] MFA Rules not processed for user `cc57ef7f9089496cb07d829e5172cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:32:42.057593 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-33b0f3e3-622e-451f-9830-e2df6a8d1ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:32:42.126481 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1275/2565] 10.222.0.52 () {58 vars in 958 bytes} [Thu Oct 27 13:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:32:42.136499 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89e8cd-e904-41bc-9195-48dbbffef08b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:32:42.138115 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0a89e8cd-e904-41bc-9195-48dbbffef08b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:32:42.181723 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:32:42.218005 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89e8cd-e904-41bc-9195-48dbbffef08b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:32:42.222114 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8349b-4b79-4fab-9a04-096fb11cfec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:32:42.222725 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8349b-4b79-4fab-9a04-096fb11cfec2 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:32:42.223003 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8349b-4b79-4fab-9a04-096fb11cfec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:32:42.223254 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8349b-4b79-4fab-9a04-096fb11cfec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:32:42.232434 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8349b-4b79-4fab-9a04-096fb11cfec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:32:42.234068 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8349b-4b79-4fab-9a04-096fb11cfec2 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:32:42.243717 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1291/2566] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:32:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:32:42.527485 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0f3e3-622e-451f-9830-e2df6a8d1ccd None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:32:42.529271 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-33b0f3e3-622e-451f-9830-e2df6a8d1ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:32:42.542575 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0f3e3-622e-451f-9830-e2df6a8d1ccd None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:32:42.548223 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562774d-482c-4c36-a300-7bc6482c0d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc57ef7f9089496cb07d829e5172cc92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818c3abbd7494faeb4f418fcf977e5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:32:42.548893 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562774d-482c-4c36-a300-7bc6482c0d54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:32:42.549180 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562774d-482c-4c36-a300-7bc6482c0d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:32:42.549446 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562774d-482c-4c36-a300-7bc6482c0d54 admin admin] PATH_INFO: `/v3/projects/c877b47a6167425eb0b271c21ac960c1` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:32:42.550735 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1562774d-482c-4c36-a300-7bc6482c0d54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c877b47a6167425eb0b271c21ac960c1)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:32:42.552736 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1562774d-482c-4c36-a300-7bc6482c0d54 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:32:42.603752 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1562774d-482c-4c36-a300-7bc6482c0d54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c877b47a6167425eb0b271c21ac960c1', 'request_id': 'req-1562774d-482c-4c36-a300-7bc6482c0d54'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:32:42.612463 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1562774d-482c-4c36-a300-7bc6482c0d54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c877b47a6167425eb0b271c21ac960c1', 'request_id': 'req-1562774d-482c-4c36-a300-7bc6482c0d54'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:32:42.619843 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1562774d-482c-4c36-a300-7bc6482c0d54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c877b47a6167425eb0b271c21ac960c1', 'request_id': 'req-1562774d-482c-4c36-a300-7bc6482c0d54'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:32:42.631191 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1562774d-482c-4c36-a300-7bc6482c0d54 admin admin] The token cache is being invalidate because project c877b47a6167425eb0b271c21ac960c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 13:32:42.631488 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1562774d-482c-4c36-a300-7bc6482c0d54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:32:42.632176 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1562774d-482c-4c36-a300-7bc6482c0d54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 13:32:42.633819 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1276/2567] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Oct 27 13:32:42 2022] DELETE /identity/v3/projects/c877b47a6167425eb0b271c21ac960c1 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:32:52.150633 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8349b-4b79-4fab-9a04-096fb11cfec2 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:32:52.152319 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2dd8349b-4b79-4fab-9a04-096fb11cfec2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:32:52.248291 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8349b-4b79-4fab-9a04-096fb11cfec2 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:32:52.319553 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6290c0-8b22-447b-9216-be2dcf8ed188 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbcd6da4e42248a3b38101104fbc03cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:32:52.320193 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6290c0-8b22-447b-9216-be2dcf8ed188 service placement] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:32:52.320480 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6290c0-8b22-447b-9216-be2dcf8ed188 service placement] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:32:52.320755 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6290c0-8b22-447b-9216-be2dcf8ed188 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:32:52.322732 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-bb6290c0-8b22-447b-9216-be2dcf8ed188 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:32:52.334305 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6290c0-8b22-447b-9216-be2dcf8ed188 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:32:52.335928 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6290c0-8b22-447b-9216-be2dcf8ed188 service placement] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:32:52.346369 dv-cinder-862432-3-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1292/2568] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:32:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:32:52.627985 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=66,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:33:02.342154 dv-cinder-862432-3-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=83 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:35:45.903654 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562774d-482c-4c36-a300-7bc6482c0d54 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:35:45.905646 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1562774d-482c-4c36-a300-7bc6482c0d54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:35:45.990453 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562774d-482c-4c36-a300-7bc6482c0d54 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:35:45.994522 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231a1fa-f350-46e2-910b-28cd56773f6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd803f074332a4216aee8a38220faa10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0be19dd5a0df4cf79fe2ec14d11521f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:35:45.995123 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231a1fa-f350-46e2-910b-28cd56773f6a service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:35:45.995394 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231a1fa-f350-46e2-910b-28cd56773f6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:35:45.995645 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231a1fa-f350-46e2-910b-28cd56773f6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:35:45.997438 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8231a1fa-f350-46e2-910b-28cd56773f6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:35:46.007294 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231a1fa-f350-46e2-910b-28cd56773f6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:35:46.008713 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231a1fa-f350-46e2-910b-28cd56773f6a service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 13:35:46.016855 dv-cinder-862432-3-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1277/2569] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Oct 27 13:35:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:35:56.013680 dv-cinder-862432-3-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=35 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}